Session details (Main track)

Long Talk: 20 mins each (16 + 4 Q&A)

Flash Talk: 5 mins each + 12 mins joint Q&A at the end

The program table can also be seen at the bottom of this page.

 

Long Talk Session 1: Applications (I): Assistive Tech, Speech, Video

[10/19 Day 1; 10:15am-11:35am]

Session Chair: Jean Claude Martin

  • Paper 41 :
    Assistive Video Filters for People with Parkinson’s Disease to Remove Tremors and Adjust Voice.
    Kurtis Haut, Adira Blumenthal, Sarah Atterbury, Xiaofei Zhou, Wasifur Rahman, Emanuela Natali, Rafayet Ali and Ehsan Hoque
  • Paper 37:
    Audio and ASR-based Filled Pause Detection.
    Aggelina Chatziagapi, Dimitris Sgouropoulos, Constantinos Karouzos, Thomas Melistas, Theodoros Giannakopoulos, Athanasios Katsamanis and Shrikanth Narayanan
  • Paper 50:
    Evaluating Temporal Patterns in Applied Infant Affect Recognition.
    Allen Chang, Lauren Klein, Marcelo R. Rosales, Weiyang Deng, Beth A. Smith and Maja J. Matarić
  • Paper 102:
    Bias Reducing Multitask Learning on Mental Health Prediction.
    Khadija Zanna, Kusha Sridhar, Han Yu and Akane Sano

 

Long Talk Session 2: Affect Detection from Speech and Physiology

[10/19 Day 1; 5:30pm-6:50pm]

Session Chair: Akane Sano

  1. Paper 96:
    Monologue versus Conversation: Differences in Emotion Perception and Acoustic Expressivity.
    Woan-Shiuan Chien, Shreya Upadhyay, Wei-Cheng Lin, Ya-Tse Wu, Bo-Hao Su, Carlos Busso and Chi-Chun Lee
  2. Paper 45:
    Context- and movement-aware analysis of physiological responses in the urban environment using wearable sensors.
    Dimitra Dritsa and Nimish Biloria
  3. Paper 72:
    Profiling of low back pain patients for the design of a tailored coaching application.
    Florian Debackere, Céline Clavel, Alexandra Roren, Viet-Thi Tran, Galia Snoubra, Yosra Messai, François Rannou, Christelle Nguyen and Jean-Claude Martin
  4. Paper 7:
    Sensor-Based Emotion Recognition in Software Development: Facial Expressions as Gold Standard.
    Nicole Novielli, Daniela Grassi, Filippo Lanubile and Alexander Serebrenik

Long Talk Session 3: Machine Learning and Facial Expression Recognition (I)

[10/20 Day 2; 9:30am-10:50am]

Session Chair: Albert Ali Salah

 

  1. Paper 6:
    Analysis of Semi-Supervised Methods for Facial Expression Recognition.
    Shuvendu Roy and Ali Etemad
  2. Paper 18:
    Federated Learning for Affective Computing Tasks.
    Krishna Somandepalli, Hang Qi, Brian Eoff, Alan Cowen, Kartik Audhkhasi, Josh Belanich and Brendan Jou
  3. Paper 21:
    Domain Adaptation for Stance Detection towards Unseen Target on Social Media.
    Ruofan Deng, Li Pan and Chloé Clavel
  4. Paper 23:
    DeepFN: Towards Generalizable Facial Action Unit Recognition with Deep Face Normalization.
    Javier Hernandez, Daniel McDuff, Ognjen Rudovic, Alberto Fung and Mary Czerwinski

 

Long Talk Session 4: Machine Learning and Facial Expression Recognition (II)

[10/20 Day 2; 4:30pm-5:50pm]

Session Chair: Shaun Canavan

  1. Paper 83:
    CIAO! A Contrastive Adaptation Mechanism for Facial Expression Recognition.
    Pablo Barros and Alessandra Sciutti
  2. Paper 87:
    Interpretable Explainability in Facial Emotion Recognition and Gamification for Data Collection.
    Krist Shingjergji, Deniz Iren, Felix Böttger, Corrie Urlings and Roland Klemke
  3. Paper 75:
    A New Perspective on Smiling and Laughter Detection: Intensity Levels Matter.
    Hugo Bohy, Kevin El Haddad and Thierry Dutoit
  4. Paper 78:
    Using Positive Matching Contrastive Loss with Facial Action Units to mitigate bias in Facial Expression Recognition.
    Varsha Suresh and Desmond Ong

 

Long Talk Session 5: Applications (II): HRI/HCI, Assistive Technologies, Datasets

[10/21 Day 3; 12:30pm-1:50pm]

Session Chair: Gelareh Mohammadi

 

  1. Paper 14:
    EmoPain(at)Home: Dataset and Automatic Assessment within Functional Activity for Chronic Pain Rehabilitation.
    Temitayo Olugbade, Raffaele Buono, Amanda de C Williams, Santiago de Ossorno Garcia, Nicolas Gold, Catherine Holloway and Nadia Bianchi-Berthouze
  2. Paper 94:
    Pierre Lévy’s Kansei Philosophy As Understood Through Human-Computer Interaction Theories.
    Erik Campano
  3. Paper 33:
    The influence of emotional expressions of an industrial robot on human collaborative decision-making.
    Koki Usui, Kazunori Terada and Celso de Melo
  4. Paper 109:
    Online Detection of Attentiveness of Students with Special Needs.
    Khandker Aftarul Islam, Tanzima Hashem, Mohammed Eunus Ali, Tasin Ishmam, Aniruddha Ganguly, Madhusudan Basak, Nusrat Jahan and Sajida Rahman Danny

 

Flash Talk Session 1: Mental Health; Virtual Agents and UX

[10/19 Day 1; 11:45am-12:30pm]

Session Chair: Kristiina Jokinen

 

  1. Paper 19:
    Extracting Multimodal Embeddings via Supervised Contrastive Learning for Psychological Screening.
    Manasa Kalanadhabhatta, Adrelys Mateo Santana, Deepak Ganesan, Tauhidur Rahman and Adam Grabell
  2. Paper 51:
    Speech Behavioral Markers Align on Symptom Factors in Psychological Distress.
    Larry Zhang, Jacek Kolacz, Albert Rizzo, Stefan Scherer and Mohammad Soleymani
  3. Paper 86:
    Detecting Depression from Social Media Data as a Multiple-Instance Learning Task.
    Paulo Mann, Elton H. Matsushima and Aline Paes
  4. Paper 106:
    Affective Ratings of Nonverbal Vocalizations Produced by Minimally Verbal Individuals: What Do Naive Listeners Perceive?
    Kristina Johnson, Amanda O’Brien, Ayelet Kershenbaum, Jaya Narain, Simon Radhakrishnan and Rosalind Picard
  5. Paper 93:
    Computational Empathy Facilitates Human Creative Problem Solving.
    Matthew Groh, Craig Ferguson, Robert Lewis and Rosalind Picard
  6. Paper 30:
    Mental Health Indices and Structured Biomarker Reports for Assistive Mental Healthcare.
    Rahul Majethia, Vadlamudi Pratiksha Sharma and Rishika T D

 

Flash Talk Session 2: Applications; Datasets; Modelling; Mental Health

[10/19 Day 1; 7:00pm-7:45pm]

Session Chair: Abe Kazemzadeh

  1. Paper 1:
    Affective Video Database Online Study.
    Michal Gnacek, Ifigeneia Mavridou, John Broulidakis, Charles Nduka, Emili Balaguer-Ballester, Theodoros Kostoulas and Ellen Seiss
  2. Paper 12:
    The value of mood measurement for regulating negative influences of social media usage: A case study of TikTok.
    Niklas Cosmann, Jana Haberkern, Alexander Hahn, Patrick Harms, Jan Joosten, Katharina Klug and Tanja Kollischan
  3. Paper 66:
    Handling Missing Data For Sleep Monitoring Systems.
    Shkurta Gashi, Lidia Alecci, Martin Gjoreski, Elena Di Lascio, Abhinav Mehrotra, Mirco Musolesi, Maike E. Debus, Francesca Gasparini and Silvia Santini
  4. Paper 89:
    Language Use in Mother-Adolescent Dyadic Interaction: Preliminary Results.
    Laura Cariola, Saurabh Hinduja, Lisa Sheeber, Nick Allen and Jeffrey Cohn
  5. Paper 62:
    Documenting use cases in the affective computing domain using Unified Modeling Language.
    Isabelle Hupont and Emilia Gómez
  6. Paper 77:
    Play with Emotion: Affect-Driven RL.
    Matthew Barthet, Ahmed Khalifa, Antonios Liapis and Georgios N. Yannakakis

 

Flash Talk Session 3: Modelling; Physiology

[10/20 Day 2; 11:00am-11:45am]

Session Chair: Monica Perusquia Hernandez

 

  1. Paper 111:
    Choose or Fuse: Enriching Data Views with Multi-label Emotion Dynamics.
    Xi Laura Cang, Rubia Guerra, Paul Bucci, Laura Rodgers, Bereket Guta, Hailey Mah, Shinmin Hsu, Qianqian Feng, Chuxuan Zhang, Anushka Agrawal and Karon Maclean
  2. Paper 84:
    Modeling Emotion-Focused Coping as a Decision Process.
    Nutchanon Yongsatianchot and Stacy Marsella
  3. Paper 85:
    Advancing the Understanding and Measurement of Workplace Stress in Remote Information Workers from Passive Sensors and Behavioral Data.
    Mehrab Bin Morshed, Javier Hernandez, Daniel McDuff, Jina Suh, Esther Howe, Kael Rowan, Marah Abdin, Gonzalo Ramos, Tracy Tran and Mary Czerwinski
  4. Paper 95:
    Ballistic Timing of Smiles is Robust to Context, Gender, Ethnicity, and National Differences.
    Maneesh Bilalpur, Kenneth Goodrich, Saurabh Hinduja and Jeffrey Cohn
  5. Paper 110:
    Exploring Affective Dimension Perception from Bodily Expressions and Electrodermal Activity in Paramedic Simulation Training.
    Surely Akiri, Sanaz Taherzadeh, Vasundhara Misal and Andrea Kleinsmith
  6. Paper 64:
    Investigating the Interplay Between Self-Reported and Bio-Behavioral Measures of Stress: A Pilot Study of Civilian Job Interviews with Military Veterans.
    Ehsanul Haque Nirjhar, Md Nazmus Sakib, Ellen Hagen, Neha Rani, Sharon Lynn Chu, Winfred Arthur, Amir Behzadan and Theodora Chaspari

 

Flash Talk Session 4: Machine Learning

[10/20 Day 2; 1:45pm-2:30pm]

Session Chair: Fabien Ringeval

 

  1. Paper 36:
    Automatic Detection of Subjective, Annotated and Physiological Stress Responses from Video Data.
    Matthias Norden, Oliver T. Wolf, Lennart Lehmann, Katja Langer, Christoph Lippert and Hanna Drimalla
  2. Paper 24:
    Exploring Multimodal Fusion for Continuous Protective Behavior Detection.
    Guanting Cen, Chongyang Wang, Temitayo A. Olugbade, Amanda C. De C. Williams and Nadia Bianchi-Berthouze
  3. Paper 40:
    Label Uncertainty Modeling and Prediction for Speech Emotion Recognition using t-Distributions.
    Navin Raj Prabhu, Nale Lehmann-Willenbrock and Timo Gerkmann.
  4. Paper 65:
    Multi-corpus Affect Recognition with Emotion Embeddings and Self-Supervised Representations of Speech.
    Sina Alisamir, Fabien Ringeval and François Portet
  5. Paper 38:
    Emotion Recognition with Pre-Trained Transformers Using Multimodal Signals.
    Juan Vazquez-Rodriguez, Gregoire Lefebvre, Julien Cumin and James Crowley
  6. Paper 105:
    A Deep Ensemble Approach of Anger Detection from Audio-Textual Conversations.
    Mahjabin Nahar and Mohammed Eunus Ali

 

Flash Talk 5: Datasets and Machine Learning

[10/21 Day 3; 2:00pm-2:45pm]

Session Chair: Hanna Drimalla

  1. Paper 11:
    Cross-Linguistic Study on Affective Impression and Language for Visual Art Using Neural Speaker.
    Hiromi Narimatsu, Ryo Ueda and Shiro Kumano
  2. Paper 52:
    ALOE: Active Learning based Opportunistic Experience Sampling for Smartphone Keyboard driven Emotion Self-report Collection.
    Surjya Ghosh, Bivas Mitra and Pradipta De
  3. Paper 56:
    Romantic and Family Movie Database: Towards Understanding Human Emotion and Relationship via Genre-Dependent Movies.
    Po-Chien Hsu, Jeng-Lin Li and Chi-Chun Lee
  4. Paper 80:
    Classifying Laughter using Component Process Model.
    Earl Capistrano, Kristen Ann Raphaelle Espiritu, Marybelle Tandoc, Johanna Lim and Jocelynn Cu
  5. Paper 99:
    Estimating Personal Model Parameters from Utterances in Model-based Reminiscence.
    Shoki Sakai, Kazuki Itabashi and Junya Morita
  6. Paper 48:
    Consistent Smile Intensity Estimation From Wearable Optical Sensors.
    Katsutoshi Masai, Monica Perusquía-Hernández, Maki Sugimoto, Shiro Kumano and Toshitaka Kimura

 

 

10/17-18 Pre-conference

10/19 Day 1

10/20 Day 2

10/21 Day3

9

Registration

Registration

Registration

Registration

Welcome Remarks [9:45am-10:15am]

Long Talk Session 3: Machine Learning and Facial Expression Recognition (I)
[9:30am-10:50am]

TBD

10

Workshops, Challenge and Tutorials
[10:00am-6:00pm 10/18 for on site and hybrid]
[10/17 only for virtual]

 

 

Lunch box will be served.

Long Talk Session 1: Applications (I): Assistive Tech, Speech, Video
[10:15am-11:35am]

11

Flash Talk Session 3: Modeling Physiology
[11:00am-11:45am]

Flash Talk Session 1: Mental Health, Virtual Agents, UX
[11:45am-12:30pm]

Lunch Break
Lunch box will be served

12

Lunch Break – Lunch box will be served

Lunch Break
Lunch box will be served

Best of TAFFC
[12:45pm-1:45pm]

Long Talk Session 5: Applications (II): HRI/HCI, Assistive Technologies, Datasets
[12:30pm-1:50pm]

13

Doctoral Consortium (virtual) & DEMO (hybrid)
[1:30pm-3:30pm]

Flash Talk Session 4: Machine Learning
[1:45pm-2:30pm]

14

Flash Talk Session 5: Datasets and Machine Learning
[2:00pm-2:45pm]

Break

15

Keynote 2 [The Tianqiao and Chrissy Chen Talk]
Dr Jeffrey F. Cohn
Multimodal Measurement of Internalizing Disorders in Clinical and Family Contexts [3:00-4:00pm]

Keynote 3
Dr. Elizabeth Broadbent
Can intelligent agents effectively employ clinical empathy skills? [3:00-4:00pm]

Break

16

Keynote 1
Dr. Rafael A. Calvo
Affective computing: Value tensions in design engineering
[4:00-5:00pm]

Break

Break

Long Talk Session 4: Machine Learning and Facial Expression Recognition (II)
[4:30pm-5:50pm]

TAFFC Report & Town Hall Meeting
[4:30pm-6:30pm]

17

Break

Long Talk Session 2: Affect Detection from Speech and Physiology
[5:30pm-6:50pm]

18

Social Gathering
@Conference site Garden
[6:00pm-7:00pm]

20-min walk to the banquet venue

Closing

19

Flash Talk Session 2: Applications, Datasets, Modelling, Mental Health
[7:00pm-7:45pm]

Banquet  (“Reception”)
@Ashibi no Sato
[7:00pm-9:00pm]