Cross-Cultural LLM Safety Evaluation

Cross-Cultural LLM Safety Evaluation

Assessing AI risks in Kazakh-Russian bilingual contexts

This research introduces Qorgau, a novel dataset designed specifically for evaluating LLM safety in bilingual environments, addressing a critical gap in security research that has primarily focused on English-only contexts.

  • Examines language- and region-specific risks that emerge in Kazakh-Russian bilingual settings
  • Reveals how safety findings in bilingual contexts can differ significantly from monolingual evaluations
  • Provides a framework for culturally-relevant safety assessment in Central Asian contexts
  • Highlights the importance of culturally-specific approaches to AI safety evaluation

This work is essential for security professionals as it demonstrates that responsible AI deployment requires evaluating safety across diverse linguistic and cultural contexts, not just in dominant languages.

Original paper: Qorgau: Evaluating LLM Safety in Kazakh-Russian Bilingual Contexts

8 | 20