Coding Emotion

Coding Emotion (in Processing) by Harjot Bal

View at OpenProcessing:

Click here for CODE

Click the mouse to toggle Neutral vs. Emotions. After mouse click, hover from left to right of the sketch window to view simulated emotions.

Data is used from a paper that evaluated subjects who were asked to portray four slightly ambiguous emotions. This project simulates a neutral face which is then manipulated via code to portray pride, interest, joy, and pleasure. This project aims to create a code framework which allows for the input of values that correspond to the degree to which a certain facial feature exudes a certain emotion. Please view the source code for a better understanding.

The data used in the project is pulled from a study which measures emotion via FACS (facial action coding system). The faces shown in the processing sketch are a result of the agreed upon manifestation of facial expressions as chosen by actors asked to portray certain emotions. Simply put, consensus is to input what magnitude is to output.

REF:Mortillaro, M., Mehu, M., & Scherer, K.R. (2011). Subtly different positive emotions can be distinguished by their facial expressions. Social Psychological and Personality Science, 2(3), 262-271.

*Note: Variables for emotions that appear twice for one facial feature do so in order to account for movements tied to not only the individual feature but also the movement of a feature that it is also linked to (i.e. jaw and chin).

*Note: Emotion variables that appear to be divided by 2 actually account for the equal movement of two simultaneously moving parts of a whole facial feature (i.e. as the mouth opens up the top half moves half of the entire distance as does the lower half in order to account for the entire mouth having moved the actual amount as a whole).

Related Entries