1. Embodied Model of Affect




performance at Mills College, Sept. 29, 2024

Embodied model of Affect combines choreography, biophysical sensing, and emotive state visualization to present a performance that discuss face to face interactions with non-human and human. It is an ambitious project that we try to 1) visualize the emotive states using biosensor data and customized algorithms, 2) explore how face to face connection changes emotive states, 3) using choreography as medium of communication to show audience the above concepts; let the audience experience this detailed and intrusive observation of a performative act, and 4) introspectively observe how we change as performers when our biological data is exposed and speculation is proposed to the public.


During the performance, real-time electrocardiogram (ECG) data is collected through sensors attached to the performers' bodies. This data is transmitted to a sound interface and an analysis interface. The sound interface produces the performers’ heartbeats in two distinct tones, while the analysis interface uses heart rate to measure arousal and heart rate variability to determine valence, mapping these onto James Russell’s Model of Affect to represent the performers' emotive states.
 

Valence and arousal chart from James Russell, 1980, “A Circumplex Model of Affect.”

The performance begins with Chloe on the left and me on the right, both facing a mannequin head. This positioning prevents us from seeing each other’s faces or expressions. Behind us, a projection displays our emotive states, represented through colors, poetic words, and images—Chloe’s on the left and mine on the right.

We remain in this configuration for an extended period, listening to our heartbeats, adjusting to the audience and stage setting, and attempting to regulate our emotive states to reach a neutral point on the valence-arousal chart. Gradually, we begin communicating through mirrored gestures, slowly moving toward a face-to-face interaction.While we initially expected our emotive states to shift from less aroused to more aroused during this transition, the opposite occurred -as we came face-to-face, our emotive states became calmer and more pleasant.


This project is an attempt to fulfill my desire to learn more about my psychological state during the performance and gain more somatic awareness through the help of technology. I am aware that my body may perform differently when it is being monitored, and the algorithms is just an approximation if best, distortion at its worst, investigating into self-surveillance will be a future research topic.


full performance video, Sept. 29, 2024