Interactive Installation, Projection Mapping, AI

Messages in Motion

What is the impact of new technologies on the understanding of intentions in human communication?

OVERVIEW
ORGANISATION

Royal College of Art

YEAR

2023

PROJECT

Interactive Installation

ROLE

Experience Designer

THE WHY

New technologies are being introduced to make online communication easier and to reduce gaps between people.

As communication becomes increasingly digital, we start to lose elements that come with face-to-face communication. The loss of translation of intention in the digital way of life can be considered an important issue that needs to be addressed, as it can have significant implications in personal and professional relationships.
THE PROJECT

Messages in Motion is an interactive installation

It uses projection mapping, voice transcription, translation and AI to observe the effects of one message going through multiple mediums.
PART I

Body Language &
Emotion Recognition AI

Conveying the message using only body language while the AI was used to recognise the emotion on the participants’ face.
PART II

Body Language &
Emotion Recognition AI

Conveying the message using only body language while the AI was used to recognise the emotion on the participants’ face.
PART III

The Final Message

The third participant uses text and emojis to explain their comprehension on the initial message.
THE AIM

By isolating different parts of face-to-face communication using technology, participants could observe how the meaning to the message changed at each step.

video

The Installation Film

MY ROLE

Experience Designer

This project was a combination of Projection Mapping, AI, and speech transcription and translation. It examined the uses of these technologies and their impact on the comprehension and conveyance of intentionality in communication.
‍
Main Responsibilities:
1. Research and Concept
‍2. Planni
‍3. Testing
4. Live Speech Transcription and Translation Projection
collaborators: annop khunwong, xinyi lai
process

The Film

IntroductionOverviewThe ProjectMy RoleProcess