OpenAI launches Trusted Contact feature

OpenAI has announced “Trusted Contact,” an optional safety feature designed to help in situations where a user talks about self-harm during conversations with ChatGPT. If the system detects signs of possible self-harm, it can alert a trusted person chosen by the user, such as a family member or friend, so they can check in and offer support. The feature comes at a time when OpenAI is facing several lawsuits from families who claim their loved ones became influenced by conversations with ChatGPT.

These lawsuits allege the chatbot sometimes responding in ways that appeared to encourage harmful thoughts or failed to stop dangerous conversations. In some cases, they claim the chatbot even discussed or helped plan self-harm methods. However, the courts have not yet determined whether OpenAI is legally responsible.

If ChatGPT’s monitoring systems detect that a user may be discussing self-harm in a serious or dangerous way, the user will first be informed that their chosen “Trusted Contact” could be notified. After that, a specially trained human review team checks the conversation to decide whether the situation appears genuinely concerning.

If the reviewers believe there is a serious safety risk, ChatGPT can send a short alert to the user’s trusted contact through email, text message, or the ChatGPT app. OpenAI said the alert will only state that the user may be going through a mental health crisis or discussing self-harm in a concerning way. It will not share the user’s private chats or conversation details.