AI chat bots promote harmful eating disorder content, according to a report by an online safety group. The report states that popular AI chat bots can glorify unrealistic body images and provide dangerous advice. This has led to the perpetuation of eating disorders in young people, which are among the deadliest forms of mental illness, especially prevalent among adolescent girls.
The report examined how AI chat bots handle the topic of eating disorders. It found that some of the most popular AI chat bots encourage and exacerbate eating disorders among young users. These chat bots may be highly vulnerable to the harmful content generated by untested and unsafe generative AI models.
The report also looked at image generating AI platforms, which produce pictures glorifying unrealistic body images. These platforms contribute to the glorification of extremely thin young women and promote unhealthy body standards.
The report highlights the need for AI developers and governments to prioritize user safety by implementing safety by design principles. This includes transparency, accountability, and responsibility in training AI models.
It is crucial to address the harmful impact of AI chat bots on mental health, particularly in relation to eating disorders. By taking proactive measures, we can ensure that AI technology is used responsibly and does not contribute to the perpetuation of harmful behaviors and body image issues.
