Opinion editor’s note: Strib Voices publishes a mix of guest commentaries online and in print each day. To contribute, click here.
At some point, if you haven’t already, you’ll experience a mental health challenge. Each year, one in five American adults has a mental health disorder and this number continues to grow. To keep up, therapists have incorporated artificial intelligence into their practices. While AI makes therapy more accessible, it raises several ethical issues. These concerns include bias as well as the lack of privacy, transparency and meaningful relationships.
AI has become woven into the fabric of our society. It can be beneficial but only if implemented ethically. So far, this hasn’t been the case. AI is being used for therapy and administrative tasks, subsequently replacing humans. Chatbots converse with patients and other types of AI categorize documents. AI also quickly analyzes data such as brain scans. But at what cost?
AI is inherently biased. It’s developed through human-generated data that is incomplete or unevenly favors one group. This results in one patient receiving different and potentially better advice than another patient based on factors such as gender or race. This is especially problematic because users tend to believe any information provided by AI. The implementation of AI in health care often glosses over informed consent. Users, especially those already vulnerable due to mental health disorders, should be aware of all the risks and benefits. These issues with informed consent showcase the lack of transparency in AI.
Decisions made by AI also lack transparency. They don’t provide evidence or an explanation. This is especially concerning in health care because clinicians can’t determine how or why a recommendation was given. There is no way to prove or replicate AI’s interpretation making it difficult to adjust a treatment plan.
Another concern with AI is that it collects and stores your personal data. This includes sensitive information such as your address. Many AI systems work independently without human support. The unchecked operation of AI could lead to your data being leaked. Some companies also sell data to third parties. For example, AI can track your location to personalize advertisements. Users often don’t consent to this and aren’t aware it’s happening.
AI is also insufficient in understanding human connection. It doesn’t respond effectively to human emotions. AI only considers the empirical evidence when making recommendations and diagnoses. The recommendations are not always accurate because AI doesn’t consider the nuances of human behavior. Human connection not only solves these problems but should be prioritized because it has benefits such as a longer life span and higher self-esteem.