This paper describes ObjectResponder - a tool that allows designers to use Artificial Intelligence (AI) to rapidly prototype concepts for context-aware intelligent interaction in the wild. To our knowledge, there are currently no available tools for designing and prototyping with AI within the actual context of use. Our application uses Google Cloud Vision to allow designers assigning chat bot-like responses to objects recognized by the smart-phone camera. This enables designers to use object recognition labels as a means to diverge on possible interpretations of the context and start generating ideas that can then be immediately tested and iterated. Initial results suggest that looking at the world from the perspective of the AI may enable designers to balance human and nonhuman biases, enrich a designer's understanding of the context, and open up unexpected directions for idea generation.

Original languageEnglish
Title of host publicationDIS 2019 - Proceedings of the 2019 ACM Designing Interactive Systems Conference
Place of PublicationNew York, NY, USA
PublisherAssociation for Computing Machinery (ACM)
Number of pages6
ISBN (Electronic)978-1-4503-5850-7
Publication statusPublished - 2019
Event2019 ACM Conference on Designing Interactive Systems, DIS 2019 - San Diego, United States
Duration: 23 Jun 201928 Jun 2019


Conference2019 ACM Conference on Designing Interactive Systems, DIS 2019
CountryUnited States
CitySan Diego

    Research areas

  • Computer vision, Interaction design, Machine learning, Prototyping

ID: 56822037