A recent study by Anthropic highlights noticeable differences in AI-generated responses from Claude depending on the language used. Queries posed in Arabic or Hindi yield warmer, more accommodative answers compared to those made in English or Russian, which tend to be more rigorous and cautionary.

Key Findings of the Research

The research was comprehensive, analyzing approximately 5,000 conversations for each model-language pairing from the 20 most utilized languages on Claude.ai. Instead of merely counting responses, the study identified over 3,000 unique values embedded within them, compressing these into four primary axes that explain around 15% of the variability in responses.

  • Deference vs. Caution: This axis represents Claude's inclination to accommodate user preferences versus its tendency to prioritize risk considerations.
  • Warmth vs. Rigor: Responses can exhibit either a friendly approach or a more analytical, detailed style.
  • Candor vs. Execution: This aspect reflects how openly Claude communicates versus its ability to take action based on user input.

Significantly, the two model versions examined, Opus 4.6 and Opus 4.7, displayed distinct tendencies. The former leaned towards warmth and execution, while the latter favored caution and rigor.

Research Methodology

The process began with a previous analysis of 700,000 anonymized conversations. From this data, researchers clustered similar values, forming 339 high-level categories. They employed privacy-preserving tools during their analysis to ensure user confidentiality while categorizing the values present in each conversation. By controlling for factors like task type and user-expressed values, the study precisely measured Claude’s inherent tendencies.

The focus on language as a factor in value expression reveals critical insights into how multicultural contexts can shape AI interaction. For instance, the choice of language impacts not just the style but the fundamental approach Claude takes when formulating its responses.

This material is informational and does not constitute financial advice.