Logo
FrontierNews.ai

ChatGPT and GPT-4 Are Biased Toward Western Values, New Study Finds

OpenAI's GPT-3.5, GPT-4, and GPT-4o models consistently misrepresent the moral values of non-Western nations, favoring Western priorities like individual care and equality while downplaying values like purity and respect for authority that matter more in other cultures. Researchers from UMass Amherst and UC Berkeley tested these models against over 90,000 human participants across 48 countries and found a significant cultural blind spot that could have real consequences as AI becomes embedded in education, healthcare, content moderation, and policy decisions worldwide.

What Did the Study Actually Measure?

The research team asked GPT-3.5, GPT-4, and GPT-4o to respond to a moral foundations questionnaire as if they were average citizens from 48 different nations. The questionnaire measured six core moral values: care, equality, proportionality (rewarding people based on their contribution), loyalty, authority or respect for legitimate authorities, and purity (concern with preserving what is seen as natural or sacred).

Participants were asked to rate their agreement with statements like "I think the human body should be treated like a temple, housing something sacred within" and "It upsets me when people use foul language like it is nothing." When the AI models were prompted to respond as citizens of specific countries, they systematically aligned more with Western moral patterns, even when instructed to represent non-Western perspectives.

Why Does This Bias Matter in Practice?

The implications extend far beyond academic research. Generative AI systems are increasingly used for tasks that require understanding what people value as right, wrong, fair, disrespectful, or sacred. Consider a few real-world scenarios: an AI model helping draft public health messaging during a pandemic, moderating online content, translating poetry, or advising a multinational company on workplace collaboration.

In each case, the system needs an accurate model of what different cultures actually care about. When AI misrepresents these values, it can lead to what researchers call "moral stereotyping." Someone seeking advice on an interpersonal conflict or feedback on international collaboration might receive guidance that reflects primarily Western values while overlooking what matters most in their own cultural context. This could perpetuate existing cultural biases or lead to conclusions that feel misaligned with non-Western perspectives.

How to Recognize and Address AI Cultural Bias?

  • Audit AI Outputs Across Cultures: Test language models on moral reasoning tasks using diverse cultural datasets, not just English-language internet content, to identify where Western bias creeps in.
  • Diversify Training Data Sources: Expand the sources used to train models beyond English-dominant internet content to include perspectives and values from non-Western regions and languages.
  • Test Real-World Applications: Move beyond survey settings to evaluate whether AI systems make similar cultural errors when actually used in education, healthcare, content moderation, and workplace settings.
  • Involve Cultural Experts in Model Development: Include researchers and practitioners from non-Western backgrounds in the design and evaluation of AI systems intended for global use.

The study found that GPT models overestimated the moral concerns of Western nations like the United States and Australia while underestimating those of non-Western nations such as Morocco and Nigeria. This pattern held even when the models were explicitly prompted to respond as average citizens of those countries, suggesting the bias is deeply embedded in how these systems learned about the world.

What Explains This Western-Centric Bias?

The researchers identified a plausible explanation: models learn about the world through language, and much of their training data comes from the internet, which is more accessible and dominant in the Western, English-speaking world. However, this explanation remains untested. The study also raises several unanswered questions that future research will need to address.

Aliah Zewail, a PhD candidate in social psychology at UMass Amherst, and Alexandra Figueroa, a postdoctoral scholar at UC Berkeley, noted that important gaps remain in understanding the scope of this problem. "First, it remains unclear whether these patterns appear in newer models or models training in languages other than English," they explained. "Second, the reasons for these moral distortions are not well understood. Third, it is not yet known whether these moral biases appear outside survey settings".

"Generative AI is increasingly used for a wide range of tasks across cultures, including education, therapy, communication and even policy decisions. There is a real risk of cultural bias if AI assumes the whole world, ranging from Argentina and Egypt to Japan and Zimbabwe, ought to pursue the same values as the Western world," the researchers stated.

Aliah Zewail and Alexandra Figueroa, UMass Amherst and UC Berkeley

The findings align with earlier research showing that GPT's underlying "psychology" tends to be more aligned with Western individuals. This research was published in the Proceedings of the National Academy of Sciences, one of the most prestigious peer-reviewed journals in the United States.

As AI systems become more integrated into global decision-making, understanding and correcting these cultural biases will be essential. The stakes are high: if AI models misrepresent human values across cultures, they risk amplifying existing cultural blind spots and creating new disparities in how different populations experience AI-powered services and advice.