Wang
Prompt-based interfaces for Large Language Models (LLMs) have made prototyping and building AI-powered applications easier than ever before. However, identifying potential harms that may arise from AI applications remains a challenge, particularly during ∗The work was done when the authors were at Google Research. This work is licensed under a Creative Commons Attribution 4.0 International License. CHI ’24, May 11–16, 2024, Honolulu, HI, USA © 2024 Copyright held by the owner/author(s). ACM ISBN 979-8-4007-0330-0/24/05. [https://doi.org/10.1145/3613904.3642335](https://doi.org/10.1145/3613904.3642335) prompt-based prototyping. To address this, we present Farsight, a novel in situ interactive tool that helps people identify potential harms from the AI applications they are prototyping. Based on a user’s prompt, Farsight highlights news articles about relevant AI incidents and allows users to explore and edit LLM-generated use cases, stakeholders, and harms. We report design insights from a co- design study with 10 AI prototypers and findings from a user study with 42 AI prototypers. After using Farsight, AI prototypers in our user study are better able to independently identify potential harms associated with a prompt and find our tool more useful and usable than existing resources. Their qualitative feedback also highlights that Farsight encourages them to focus on end-users and think beyond immediate harms. We discuss these findings and reflect on 1 arXiv:2402.15350v2 [cs.HC] 2 Jul 2024 CHI ’24, May 11–16, 2024, Honolulu, HI, USA Zijie J. Wang, et al. their implications for designing AI prototyping experiences that meaningfully engage with AI harms. Farsight is publicly accessible at: [https://pair-code.github.io/farsight](https://pair-code.github.io/farsight). CCS CONCEPTS • Human-centered computing →Interactive systems and tools; • Computing methodologies →Machine learning.