Human-computer synergies in prosthetic interactions

Remote sighted assistance provides prosthetic support to people with visual impairments (PVI) through internet-mediated conversational interactions. In these interactions, PVI broadcast live video to remotely-located, sighted people who engage in speech interactions with PVI to create prosthetic support. These interactions can be quite nuanced, creative, and effective. In this paper, we present a design investigation of remote sighted assistance (RSA) in which computer vision capabilities are integrated into the prosthetic interaction, supporting the human participants in various ways. Our study involved creating design scenarios to identify and concretize future possibilities in order to articulate and analyze design rationale for these scenarios, that is to say, strengths and challenges of RSA integrated with CV. We discuss implications for the design of the next generation of remote sighted assistance.

Files

Metadata

Work Title Human-computer synergies in prosthetic interactions
Access
Open Access
Creators
  1. John M. Carroll
  2. Sooyeon Lee
  3. Madison Reddie
  4. Jordan Beck
  5. Mary Beth Rosson
Keyword
  1. Computer Vision (CV)
  2. Design envisionment scenarios
  3. Prosthetic interactions
  4. People with Visual Impairments (PVI)
  5. Remote Sighted Assistance (RSA)
License CC BY-NC-ND 4.0 (Attribution-NonCommercial-NoDerivatives)
Work Type Article
Publisher
  1. Interaction Design and Architecture(s) Journal
Publication Date May 10, 2020
Publisher Identifier (DOI)
  1. http://doi.org/10.55612/s-5002-044-002
Deposited August 02, 2022

Versions

Analytics

Collections

This resource is currently not in any collection.

Work History

Version 1
published

  • Created
  • Added C4V-IxDA-2020-1.pdf
  • Added Creator John M. Carroll
  • Added Creator Sooyeon Lee
  • Added Creator Madison Reddie
  • Added Creator Jordan Beck
  • Added Creator Mary Beth Rosson
  • Published
  • Updated Description Show Changes
    Description
    • <jats:p>Remote sighted assistance provides prosthetic support to people with visual impairments (PVI) through internet-mediated conversational interactions. In these interactions, PVI broadcast live video to remotely-located, sighted people who engage in speech interactions with PVI to create prosthetic support. These interactions can be quite nuanced, creative, and effective. In this paper, we present a design investigation of remote sighted assistance (RSA) in which computer vision capabilities are integrated into the prosthetic interaction, supporting the human participants in various ways. Our study involved creating design scenarios to identify and concretize future possibilities in order to articulate and analyze design rationale for these scenarios, that is to say, strengths and challenges of RSA integrated with CV. We discuss implications for the design of the next generation of remote sighted assistance.</jats:p>
    • <jats:p>Remote sighted assistance provides prosthetic support to people with visual impairments (PVI) through internet-mediated conversational interactions. In these interactions, PVI broadcast live video to remotely-located, sighted people who engage in speech interactions with PVI to create prosthetic support. These interactions can be quite nuanced, creative, and effective. In this paper, we present a design investigation of remote sighted assistance (RSA) in which computer vision capabilities are integrated into the prosthetic interaction, supporting the human participants in various ways. Our study involved creating design scenarios to identify and concretize future possibilities in order to articulate and analyze design rationale for these scenarios, that is to say, strengths and challenges of RSA integrated with CV. We discuss implications for the design of the next generation of remote sighted assistance.
  • Updated Description Show Changes
    Description
    • <jats:p>Remote sighted assistance provides prosthetic support to people with visual impairments (PVI) through internet-mediated conversational interactions. In these interactions, PVI broadcast live video to remotely-located, sighted people who engage in speech interactions with PVI to create prosthetic support. These interactions can be quite nuanced, creative, and effective. In this paper, we present a design investigation of remote sighted assistance (RSA) in which computer vision capabilities are integrated into the prosthetic interaction, supporting the human participants in various ways. Our study involved creating design scenarios to identify and concretize future possibilities in order to articulate and analyze design rationale for these scenarios, that is to say, strengths and challenges of RSA integrated with CV. We discuss implications for the design of the next generation of remote sighted assistance.
    • Remote sighted assistance provides prosthetic support to people with visual impairments (PVI) through internet-mediated conversational interactions. In these interactions, PVI broadcast live video to remotely-located, sighted people who engage in speech interactions with PVI to create prosthetic support. These interactions can be quite nuanced, creative, and effective. In this paper, we present a design investigation of remote sighted assistance (RSA) in which computer vision capabilities are integrated into the prosthetic interaction, supporting the human participants in various ways. Our study involved creating design scenarios to identify and concretize future possibilities in order to articulate and analyze design rationale for these scenarios, that is to say, strengths and challenges of RSA integrated with CV. We discuss implications for the design of the next generation of remote sighted assistance.
  • Updated Source, Keyword, Publisher, and 1 more Show Changes
    Source
    • Interaction Design and Architecture(s)
    Keyword
    • Computer Vision (CV), Design envisionment scenarios, Prosthetic interactions, People with Visual Impairments (PVI), Remote Sighted Assistance (RSA)
    Publisher
    • Association for Smart Learning Ecosystems and Regional Development
    • Interaction Design and Architecture(s) Journal
    Publisher Identifier (DOI)
    • 10.55612/s-5002-044-002
    • http://doi.org/10.55612/s-5002-044-002
  • Updated