CV

A full CV is available upon request.

Contact Information

Name Esam Ghaleb
Professional Title Research Scientist

Experience

  • 2024 - present

    Nijmegen, The Netherlands

    Research Scientist, Multimodal Language Department
    Max Planck Institute for Psycholinguistics
    Research on multimodal communication and behaviour, including representation learning, analysis, and generation.
    • Leads the Multimodal Modelling Cluster.
  • 2022 - 2024

    Amsterdam, The Netherlands

    Postdoctoral Researcher, Dialogue Modeling Group
    University of Amsterdam, Institute for Logic, Language and Computation (ILLC)
    Research on face-to-face dialogue modelling, co-speech gesture segmentation and representation, and multimodal speech-gesture alignment.
  • 2020 - 2022

    Maastricht, The Netherlands

    Postdoctoral Researcher, Cognitive Systems Group
    Maastricht University, Department of Advanced Computing Sciences
    Research on explainable AI for emotion recognition, behavioural analysis in healthcare, and self-supervised learning for sensor-based activity recognition.
    • Work package leader for the EU H2020 ProCare4Life project.
  • 2016 - 2020

    Maastricht, The Netherlands

    Doctoral Researcher, Cognitive Systems Group
    Maastricht University
    Research on affective computing and machine learning, with a focus on multimodal audio-visual emotion recognition.
    • Co-represented Maastricht University tasks in the EU H2020 MaTHiSiS project.
  • 2013 - 2016

    Istanbul, Turkey

    Research Assistant
    Istanbul Technical University, Smart Interaction and Machine Intelligence Technologies (SiMiT) Lab
    Research on computer vision and HCI, including face recognition, tracking, and retrieval of faces across age.
  • 2014 - 2014

    Karlsruhe, Germany

    Research Intern
    Karlsruhe Institute of Technology (KIT), CVHCI Lab
    Built and annotated the Accio dataset for face track retrieval in movies (Harry Potter).
    • Revisited the lab in Summer 2015 for thesis research.

General Information

Languages

Arabic : Native
English : Fluent
Turkish : Fluent
Dutch : Upper-intermediate (B2)

Education

  • 2016 - 2021

    The Netherlands

    Ph.D.
    Maastricht University
    Affective Computing and Machine Learning
  • 2013 - 2015

    Turkey

    M.Sc.
    Istanbul Technical University
    Computer Engineering
  • 2009 - 2013

    Turkey

    B.Sc.
    Istanbul Technical University
    Computer Engineering
    • Graduated with honors.
    • {“Bachelor thesis”=>”An Energy-Efficient Routing Technique and Implementation in Wireless Sensor Networks.”}

Funding

  • 2025
    NWO Open Competition Domain Science (XS)
    Netherlands Organisation for Scientific Research (NWO), The Netherlands
    Amount: To be added

    PI for the project titled: “Grounded Gesture Generation in Context: Object- and Interaction-Aware Generative AI Models of Language Use”.

  • 2025
    Donders Research Stimulation Fund
    Donders Institute, Nijmegen, The Netherlands
    Amount: To be added

    Co-applicant for a project with Sara Bögels (PI) and Iris Hendrickx on the temporal dynamics of communicative effort reduction and alignment.

  • 2007
    Scholarships (Yemen & Turkey Ministries of Higher Education)
    Yemen & Turkey Ministries of Higher Education
    Amount: Approx. USD 60,000 total

    Scholarships supporting B.Sc. and M.Sc. studies.

  • 2014
    Internship Grant, Istanbul Technical University (KIT Visit)
    Istanbul Technical University
    Amount: To be added

    Grant supporting a summer research internship at Karlsruhe Institute of Technology, Germany.

Awards

  • 2021
    Nomination for Best Paper Award (IJCB)
    International Joint Conference on Biometrics

    For the paper: “Contrastive self-supervised learning for sensor-based human activity recognition”.

  • 2016
    Ranked 1st, International Challenge on Biometric Recognition in the Wild (ICB-RW)
    International Conference on Biometrics
  • 2006
    Graduated in the Top 0.2% Nationwide (High School), Yemen
    National ranking, Yemen

Talks

  • 2025
    Speech and Gesture Interaction in Face-to-Face Dialogue (analysis and generation)
    Utrecht University (NLP@U)

    Invited talk.

  • 2024
    Learning Representations in Dialogue Through Contrastive Learning
    SignLab Amsterdam, University of Amsterdam

    Invited talk.

  • 2024
    Understanding and Modelling Multimodal Dialogue Coordination
    Tilburg University

    Invited talk.