Prompt Coaching for Inclusiveness: A Media Literacy Approach to Increase Users' Awareness of Algorithmic Bias and Prompting Efficacy
  • Chen, Cheng
  • Liao, Mengqi
  • Phadnis, Aditya Anand
  • Li, Yao
  • High, Andrew
  • ... Sundar, S. Shyam
  • 외 1명
Citations

SCOPUS

1

초록

Large language models often produce biased or stereotypical outputs. One way to reduce this possibility is to be more inclusive in our prompts, but doing so may not come naturally to most users. Therefore, we designed a tool that coaches users to write more inclusive prompts - a strategy that leverages design friction to provide a media literacy intervention. Data from a user study (N=344) show that compared to no coaching, inclusive prompt coaching directly increased users' awareness of algorithmic bias and their perceived prompting efficacy. It also indirectly enhanced their trust in the system and perceived trust calibration through cognitive elaboration. However, inclusive prompt coaching resulted in a less satisfying user experience. These findings have implications for ethical interventions in prompting for better communicating and combating algorithmic bias. We discuss the benefits and limitations of inclusive prompt coaching, as well as ways to balance usability for long-term adoption of generative AI systems.

키워드

Algorithmic bias awarenessInclusivenessPrompt coachingPrompting efficacyTrust in AIUser experience
제목
Prompt Coaching for Inclusiveness: A Media Literacy Approach to Increase Users' Awareness of Algorithmic Bias and Prompting Efficacy
저자
Chen, ChengLiao, MengqiPhadnis, Aditya AnandLi, YaoHigh, AndrewAbdullah, SaeedSundar, S. Shyam
DOI
10.1145/3772318.3791542
발행일
2026
유형
Conference Paper
저널명
Conference on Human Factors in Computing Systems - Proceedings