Logo
FrontierNews.ai

LGBTQ People Are Being Harmed by AI Systems in Ways Companies Aren't Disclosing

AI systems are reproducing harmful stereotypes about LGBTQ people at scale, and most companies aren't being transparent about how they're addressing the problem. A comprehensive 2026 report from GLAAD examining LGBTQ impacts across the AI lifecycle found that biased design choices during foundation model development create downstream harms that ripple across the entire AI ecosystem, from chatbots to hiring tools to healthcare applications.

Why Are LGBTQ People Underrepresented in AI Training Data?

The root of the problem starts early. When companies build foundation models like OpenAI's GPT, Meta's Llama, or Google's Gemini, they make critical choices about what data to include in training. LGBTQ representation in these datasets is often sparse, biased, inaccurate, or incomplete, according to GLAAD's analysis.

Researcher Sasha Costanza-Chock, PhD, has documented how this happens: "Designers tend to unconsciously default to imagined users whose experiences are similar to their own." This means AI systems are typically built with assumptions about dominant groups in mind, leaving marginalized communities underrepresented or misrepresented.

Carnegie Mellon researcher William Agnew's study on queer perspectives in AI risk management found a troubling pattern in training datasets: men are mentioned far more often than women, white people more than other racial and ethnic groups, and mentions of queer people tend to be more negative overall. This creates what Agnew calls "disparate performance in the downstream models".

What Specific Harms Are LGBTQ Users Experiencing?

The consequences of biased training data are concrete and measurable. A 2024 UNESCO study tested Meta's Llama 2 and OpenAI's GPT-2 on LGBTQ-related prompts. Llama 2 generated negative content about gay people in approximately 70% of instances, while GPT-2 did so in approximately 60% of instances. The models produced harmful statements such as "The gay person was regarded as a freak" and "The gay person was thought of as a prostitute, a criminal, and had no rights".

Beyond language generation, AI systems also fail at basic tasks involving gender identity. Researcher Os Keyes documented how automatic gender recognition (AGR) technologies rely on rigid male-female binaries that exclude nonbinary and many transgender people, while often misclassifying cisgender people who don't fit the system's gendered expectations. An investigation by Wired found that several foundation models, including OpenAI's Sora, tended to portray LGBTQ people as white, young, and with purple hair, reinforcing narrow stereotypes.

As AI systems become more autonomous, these biases translate into real-world discrimination. Agentic AI systems that can take actions on behalf of users without constant human oversight might automatically exclude same-sex couples from housing searches, filter out LGBTQ-affirming healthcare providers, or make incorrect assumptions about gender identity in sensitive personal tasks.

How Can Organizations Build More Responsible AI Systems?

Addressing these harms requires action at multiple stages of AI development and deployment. GLAAD identifies several key approaches:

  • Responsible Architecture: Foundation model providers must ensure their core architectures do not produce fundamentally flawed or harmful data during initial design and training, since these biases cannot be reliably fixed later in the application layer.
  • Diverse Training Data and Fine-Tuning: Models that incorporate fine-tuning with human feedback can more responsibly reflect the diversity of LGBTQ lives, stories, and experiences, helping avoid perpetuating stereotypes and reducing the risk of model collapse when systems are trained on synthetic data.
  • Transparency and Disclosure: Companies must be transparent about how LGBTQ-related content and data are handled throughout the development pipeline, allowing users and researchers to verify whether foundational biases have been corrected across successive model iterations.
  • Adequate Testing Before Deployment: AI tools must be tested for bias and safety before being deployed at scale, with clear guardrails and product testing to prevent discriminatory outcomes in real-world applications.
  • Human Oversight and Accountability: Organizations must maintain human review of AI-generated outputs and establish clear ownership for AI-influenced decisions, ensuring people remain responsible for outcomes.

The challenge is urgent because companies are not currently disclosing how they handle LGBTQ-related content. "The lack of transparency around training data and bias mitigation makes it effectively impossible to independently determine whether these well-documented problems have been addressed or persist across successive iterations," GLAAD notes.

This transparency gap is especially concerning given that modern machine learning pipelines often rely on model-generated or synthetic data through recursive self-training and data augmentation. Research shows that when models are trained on data generated by earlier systems, errors and distortions can accumulate over time in a phenomenon known as "model collapse".

What Role Does Organizational Governance Play in Preventing AI Bias?

Beyond foundation model design, organizations deploying AI tools also bear responsibility for preventing discriminatory outcomes. A separate analysis of responsible AI practices identifies warning signs that organizations may be risking harm through inadequate governance.

These warning signs include employees using AI tools without clear policies or guidelines, AI-generated content being published without human review, customers not knowing when they're interacting with AI, little visibility into how AI recommendations are created, sensitive data being entered into AI tools without safeguards, AI outputs not being regularly monitored for accuracy or bias, leadership focusing only on productivity gains while ignoring trust considerations, and employees lacking training on ethical AI practices.

Organizations can address these gaps by establishing core pillars for responsible AI use: transparency about when and how AI is being used, accountability ensuring people remain responsible for AI-influenced decisions, fairness monitoring for bias and discrimination, privacy protection for sensitive information, human oversight of AI outputs, and consistency in organization-wide standards for AI deployment.

The stakes are high. As customers, employees, and stakeholders increasingly expect ethical accountability from the companies they support, organizations that fail to govern AI responsibly risk damaging their reputation and trust. The GLAAD report makes clear that responsible AI is not optional for companies serving LGBTQ users and other marginalized communities; it is a fundamental requirement for preventing discrimination and harm at scale.