Hi, I'm Pol
I am a PhD candidate in computer science at the MPI and do some freelance stuff as a designer and a programmer. If you are interested in my work, just scroll down and have a look.
People can recognize emotions from speech extraordinarily well – even in absence of other cues like body posture or facial expressions.
During my PhD in computer science at the Max Planck Institute and HCM, I investigate the mapping between speech prosody and emotion.
In corpus work, I investigate the mapping in existing recordings of emotional speech.
During experimental work, I iteratively change speech to make it sound emotional which allows to uncover mental prototypes of emotions in speech.
Academic work
Publications
Published
van Rijn, P. & Larrouy-Maestri, P. (2023) Modeling individual and cross-cultural variation in the mapping of emotions to speech prosody, Nature Human Behaviour.
van Rijn, P.*, Lee, H.*, & Jacoby, N. (2022). Bridging the prosody GAP: Genetic Algorithm with People to efficiently sample emotional prosody, CogSci.
van Rijn, P., Mertes, S., Schiller, D., Dura, P., Siuzdak, H., Harrison, P., André, E., & Jacoby, N. (2022). VoiceMe: Personalized voice generation in TTS, INTERSPEECH.
Siuzdak, H., Dura, P., van Rijn, P., & Jacoby, N. (2022). WavThruVec: Latent speech representation as intermediate features for neural speech synthesis, INTERSPEECH.
Schiller, D.*, Mertes, S.*, van Rijn, P., & André, E. (2022). Bridging the Gap: End-to-End Domain Adaptation for Emotional Vocalization Classification using Adversarial Learning, Proceedings of the 3rd International on Multimodal Sentiment Analysis Workshop and Challenge.
van Rijn, P., Mertes, S., Schiller, D., Harrison, P., Larrouy-Maestri, P., André, E., & Jacoby, N. (2021). Exploring emotional prototypes in a high dimensional TTS latent space, INTERSPEECH.
Schiller, D.*, Mertes, S.*, van Rijn, P., & André, E. (2021). Analysis by Synthesis: Using an expressive TTS Model as Feature Extractor for Paralinguistic Speech Classification, INTERSPEECH.
Harrison, P., Marjieh, R., Adolfi, F., van Rijn, P., Anglada-Tort, M., Tchernichovski, O., Larrouy-Maestri, P., & Jacoby, N. (2020). Gibbs Sampling with people, NeurIPS.
Accepted
Marjieh, R.*, van Rijn, P.*, Sucholutsky, I.*, Sumers, I., Lee, H., Griffiths, T.**, & Jacoby, N.** (2023). Words are all you need? Capturing human sensory similarity with textual descriptors, ICLR.
Lewis*, G., van Rijn, P.*, Gwilliams, L., Larrouy-Maestri, P., Poeppel, D., & Ghitza, O. (accepted). NyU-BU contextually constrained sentences Corpus: NUBUC, Linguistic Data Consortium.
Submitted
van Rijn, P., Sun, Y., Lee, H., Marjieh, R., Sucholutsky, I., Lanzarini F., André, E., & Jacoby, N. (2023). Around the world in 60 words: A generative vocabulary test for online research, CogSci.
Marjieh, R., Sucholutsky, I., van Rijn, P., Jacoby, N., & Griffiths, T. (2023). What Language Reveals about Perception: Distilling Psychophysical Knowledge from Large Language Models, CogSci.
Presentations
Posters
van Rijn, P., Poeppel, D., & Larrouy-Maestri, P. (2019, December). Emotional prosody: the role of pitch over time. Poster presentation at the Rate and Rhythm in speech Recognition workshop. MPI for Psycholinguistics, Nijmegen, Netherlands.
van Rijn, P. & Vogelzang, M. (2019, May). Noun Capitalization: Can Dutch readers benefit from it? Poster presentation at TABU. University of Groningen, Groningen, Netherlands
Some background
-
Finished gymnasium, 2013
VWO-diploma (Dutch Abitur examination)
-
Moved to Germany, 2013
started studying German and Dutch language & literature studies
-
Picked up computer science, 2016
inseparable from my computer ever since
-
DAAD-Prize, 2016
for the outstanding achievement of a foreign student (€ 1,000)
-
Deutschlandstipendium, 2017
Study grant € 3,600, one year
-
Started my PhD, 2019
in computer science at the MPI
-
A cool collaboration with you
Let's discuss some ideas