Hi, I'm Pol

    I am a PhD candidate in computer science at the MPI and do some freelance stuff as a designer and a programmer. If you are interested in my work, just scroll down and have a look.

  • Picture of Pol
PLEASE SCROLL ↓

People can recognize emotions from speech extraordinarily well – even in absence of other cues like body posture or facial expressions.

During my PhD in computer science at the Max Planck Institute and HCM, I investigate the mapping between speech prosody and emotion.

In corpus work, I investigate the mapping in existing recordings of emotional speech.

During experimental work, I iteratively change speech to make it sound emotional which allows to uncover mental prototypes of emotions in speech.

Academic work

Publications

Published

  • van Rijn, P. & Larrouy-Maestri, P. (2023) Modeling individual and cross-cultural variation in the mapping of emotions to speech prosody, Nature Human Behaviour.

  • van Rijn, P.*, Lee, H.*, & Jacoby, N. (2022). Bridging the prosody GAP: Genetic Algorithm with People to efficiently sample emotional prosody, CogSci.

  • van Rijn, P., Mertes, S., Schiller, D., Dura, P., Siuzdak, H., Harrison, P., André, E., & Jacoby, N. (2022). VoiceMe: Personalized voice generation in TTS, INTERSPEECH.

  • Siuzdak, H., Dura, P., van Rijn, P., & Jacoby, N. (2022). WavThruVec: Latent speech representation as intermediate features for neural speech synthesis, INTERSPEECH.

  • Schiller, D.*, Mertes, S.*, van Rijn, P., & André, E. (2022). Bridging the Gap: End-to-End Domain Adaptation for Emotional Vocalization Classification using Adversarial Learning, Proceedings of the 3rd International on Multimodal Sentiment Analysis Workshop and Challenge.

  • van Rijn, P., Mertes, S., Schiller, D., Harrison, P., Larrouy-Maestri, P., André, E., & Jacoby, N. (2021). Exploring emotional prototypes in a high dimensional TTS latent space, INTERSPEECH.

  • Schiller, D.*, Mertes, S.*, van Rijn, P., & André, E. (2021). Analysis by Synthesis: Using an expressive TTS Model as Feature Extractor for Paralinguistic Speech Classification, INTERSPEECH.

  • Harrison, P., Marjieh, R., Adolfi, F., van Rijn, P., Anglada-Tort, M., Tchernichovski, O., Larrouy-Maestri, P., & Jacoby, N. (2020). Gibbs Sampling with people, NeurIPS.

Accepted

  • Marjieh, R.*, van Rijn, P.*, Sucholutsky, I.*, Sumers, I., Lee, H., Griffiths, T.**, & Jacoby, N.** (2023). Words are all you need? Capturing human sensory similarity with textual descriptors, ICLR.

  • Lewis*, G., van Rijn, P.*, Gwilliams, L., Larrouy-Maestri, P., Poeppel, D., & Ghitza, O. (accepted). NyU-BU contextually constrained sentences Corpus: NUBUC, Linguistic Data Consortium.

Submitted

  • van Rijn, P., Sun, Y., Lee, H., Marjieh, R., Sucholutsky, I., Lanzarini F., André, E., & Jacoby, N. (2023). Around the world in 60 words: A generative vocabulary test for online research, CogSci.

  • Marjieh, R., Sucholutsky, I., van Rijn, P., Jacoby, N., & Griffiths, T. (2023). What Language Reveals about Perception: Distilling Psychophysical Knowledge from Large Language Models, CogSci.

Presentations

Posters

  • van Rijn, P., Poeppel, D., & Larrouy-Maestri, P. (2019, December). Emotional prosody: the role of pitch over time. Poster presentation at the Rate and Rhythm in speech Recognition workshop. MPI for Psycholinguistics, Nijmegen, Netherlands.

  • van Rijn, P. & Vogelzang, M. (2019, May). Noun Capitalization: Can Dutch readers benefit from it? Poster presentation at TABU. University of Groningen, Groningen, Netherlands

Some background

  • Finished gymnasium, 2013

      VWO-diploma (Dutch Abitur examination)

  • Moved to Germany, 2013

      started studying German and Dutch language & literature studies

  • Picked up computer science, 2016

      inseparable from my computer ever since

  • DAAD-Prize, 2016

      for the outstanding achievement of a foreign student (€ 1,000)

  • Deutschlandstipendium, 2017

      Study grant € 3,600, one year

  • Started my PhD, 2019

      in computer science at the MPI

  • A cool collaboration with you

    Let's discuss some ideas