How should ai systems talk to users when collecting their personal information? effects of role framing and self-referencing on human-ai interaction

AI systems collect our personal information in order to provide personalized services, raising privacy concerns and making users leery. As a result, systems have begun emphasizing overt over covert collection of information by directly asking users. This poses an important question for ethical interaction design, which is dedicated to improving user experience while promoting informed decision-making: Should the interface tout the benefits of information disclosure and frame itself as a help-provider? Or, should it appear as a help-seeker? We decided to find out by creating a mockup of a news recommendation system called Mindz and conducting an online user study (N=293) with the following four variations: AI system as help seeker vs. help provider vs. both vs. neither. Data showed that even though all participants received the same recommendations, power users tended to trust a help-seeking Mindz more whereas non-power users favored one that is both help-seeker and help-provider.

Files

Metadata

Work Title How should ai systems talk to users when collecting their personal information? effects of role framing and self-referencing on human-ai interaction
Access
Open Access
Creators
  1. Mengqi Liao
  2. S. Shyam Sundar
Keyword
  1. Human-AI Interaction
  2. social cues
  3. social presence of AI
  4. power usage
License In Copyright (Rights Reserved)
Work Type Article
Publisher
  1. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ‘21)
Publication Date May 7, 2021
Publisher Identifier (DOI)
  1. https://doi.org/10.1145/3411764.3445415
Deposited October 14, 2024

Versions

Analytics

Collections

This resource is currently not in any collection.

Work History

Version 1
published

  • Created
  • Added AI_Help_CHI21.docx
  • Added Creator Mengqi Liao
  • Added Creator S. Shyam Sundar
  • Published
  • Updated
  • Updated Keyword, Publication Date Show Changes
    Keyword
    • Human-AI Interaction, social cues, social presence of AI, power usage
    Publication Date
    • 2021-05-08
    • 2021-05-07
  • Updated Work Title Show Changes
    Work Title
    • How should ai systems talk to users when collecting their personal information? efects of role framing and self-referencing on human-ai interaction
    • How should ai systems talk to users when collecting their personal information? effects of role framing and self-referencing on human-ai interaction