“what i see is what you get” explorations of live artwork generation, artificial intelligence, and human interaction in a pedagogical environment

Ana Herruzo, Nikita Pashenkov

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

In this paper we review the overall process for the design, development, and deployment of “What I See Is What You Get”, an experiential installation that creates live interactive visuals, by analyzing human facial expressions and behaviors, accompanied by text generated using Machine Learning algorithms trained on the art collection of The J. Paul Getty Museum in Los Angeles. The project is developed by students and faculty in an academic environment and exhibited at the Getty Museum. We also study the pedagogical process implemented to address the curriculum’s learning outcomes in an “applied” environment while designing a contemporary new media art piece. Special attention is paid to the level and quality of the interaction between users and the piece, demonstrating how advances in technology and computing such as Deep Learning and Natural Language Processing can contribute to deeper connections and new layers of interactivity.

Original languageEnglish (US)
Title of host publicationInteractivity, Game Creation, Design, Learning, and Innovation - 8th EAI International Conference, ArtsIT 2019, and 4th EAI International Conference, DLI 2019, Proceedings
EditorsAnthony Brooks, Eva Irene Brooks
PublisherSpringer
Pages343-359
Number of pages17
ISBN (Print)9783030532932
DOIs
StatePublished - 2020
Externally publishedYes
Event8th EAI International Conference on ArtsIT, Interactivity and Game Creation, ArtsIT 2019, and the 4th EAI International Conference on Design, Learning, and Innovation, DLI 2019 - Aalborg, Denmark
Duration: Nov 6 2019Nov 8 2019

Publication series

NameLecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
Volume328 LNICST
ISSN (Print)1867-8211

Conference

Conference8th EAI International Conference on ArtsIT, Interactivity and Game Creation, ArtsIT 2019, and the 4th EAI International Conference on Design, Learning, and Innovation, DLI 2019
Country/TerritoryDenmark
CityAalborg
Period11/6/1911/8/19

Keywords

  • Applied computing
  • Artificial intelligence
  • Creative Technologies
  • Higher education
  • Information visualization
  • Interactive art
  • Machine learning
  • New media technologies
  • Real-time generated graphics

ASJC Scopus subject areas

  • Computer Networks and Communications

Fingerprint

Dive into the research topics of '“what i see is what you get” explorations of live artwork generation, artificial intelligence, and human interaction in a pedagogical environment'. Together they form a unique fingerprint.

Cite this