Research

Speech is a crucial aspect of our everyday life and our primary form of communication. But while it appears simple on the surface is actually quite a complicated task. How do we take in a bunch of sound waves and interpret them as meaningful elements such as words and sentences? And how does non-verbal information such as gestures affect our perception of speech?

In my PhD research I investigated how visual cues such as up-and-down beat gestures of the hand can influence the perception of lexical stress (i.e., which syllable is emphasized), and thus change the word you perceive (e.g., OBject or obJECT). I found that speech is more than what we hear and that what we see also has impactful effects on our speech perception. Find out more about my research below.

Publications

Bujok, R., Meyer, A. S., & Bosker, H. R. (2024). Audiovisual Perception of Lexical Stress: Beat Gestures and Articulatory Cues. Language & Speech. https://doi.org/10.1177/00238309241258162

Rohrer, P. L., Bujok, R., Van Maastricht, L., & Bosker, H. R. (2024). Non-referential Beat Gesture Timing Influences Lexical Stress Perception in Spanish: Furthering the Scope of the Manual McGurk Effect. In Proceedings of Speech Prosody 2024, 702-706, doi:10.21437/SpeechProsody.2024-142

Cos, F., Bujok, R., & Bosker, H. R. (2024). Test-retest reliability of audiovisual lexical stress perception after >1.5 years. In Proceedings of Speech Prosody 2024, 871-875, doi:10.21437/SpeechProsody.2024-176

Bujok, R., Meyer, A. S., & Bosker, H. R. (2022). Visible lexical stress cues on the face do not influence audiovisual speech perception. In Proceedings of Speech Prosody 2022, 259-263, doi:10.21437/SpeechProsody.2022-53

Preprints of yet unpublished manuscripts

Bujok, R., Maran, M., Meyer, A. S., & Bosker, H. R. (2024). Beat gestures facilitate lexical access in constraining sentence contexts. PsyArXiv Preprints. https://doi.org/10.31234/osf.io/8ntjm

Bujok, R., Meyer, A. S., & Bosker, H. R. (2024). Beat gestures can influence on-line spoken word recognition. PsyArXiv Preprints. https://doi.org/10.31234/osf.io/6gn3d

Bujok, R., Peeters, D., Meyer, A. S., & Bosker, H. R. (2024). Beating stress: evidence for recalibration of word stress perception. PsyArXiv Preprints. https://doi.org/10.31234/osf.io/9sua6

Presentations

Talks

2024

Rohrer P. L., Bujok R., Van Maastricht L., & Bosker, H. R. (2024). The timing of beat gestures affects lexical stress perception in Spanish. Talk presented at Speech Prosody 2024. Leiden, The Netherlands. 2024-07-02 - 2024-07-05.

2024

Bujok R., Meyer, A. S., & Bosker, H. R. (2024). Beat gestures can affect audiovisual lexical stress perception immediately. Talk presented at Architectures and Mechanisms for Language Processing (AMLaP 2024). Edinburgh, Scotland. 2024-09-04 - 2024-09-07.

2023

Mok, I., Bujok R., & Bosker, H. R. (2023). Visual articulatory gestures guide audiovisual speech perception of lexical stress but only in noise. Talk presented at the 8th Gesture and Speech in Interaction (GESPIN 2023). Nijmegen, The Netherlands. 2023-09-13 - 2023-09-15.

2023

Bujok R., Peeters, D., Meyer, A. S., & Bosker, H. R. (2023). When the beat drops – beat gestures recalibrate lexical stress perception. Talk presented at the 1st International Multimodal Communication Symposium (MMSYM 2023). Barcelona, Spain. 2023-04-26 - 2023-04-28.

2022

Bosker, H. R., & Bujok R. (2022). Recalibrating lexical stress perception with lexical context and manual beat gestures. Talk presented at the 28th Architectures and Mechanisms for Language Processing Conference (AMLaP 2022). York, UK. 2022-09-07 - 2022-09-09.

2022

Bujok R., Peeters, D., Meyer, A. S., & Bosker, H. R. (2022). Recalibration of lexical stress perception can be driven by visual beat gestures. Talk presented at the Dag van de Fonetiek 2022. Utrecht, NL. 2022-12-16 - 2022-12-16.

2022

Bujok R., Peeters, D., Meyer, A. S., & Bosker, H. R. (2022). Do manual beat gestures recalibrate the perception of lexical stress?. Talk presented at the Psychonomic Society - 63rd Annual Meeting. Boston, USA. 2022-11-17 - 2022-11-20.

2022

Bujok R., Meyer, A. S., & Bosker, H. R. (2022). Visible lexical stress cues on the face do not influence audiovisual speech perception. Talk presented at Speech Prosody 2022. Lisbon, Portugal. 2022-05-23 - 2022-05-26.

2022

Bujok R., Meyer, A. S., & Bosker, H. R. (2022). The role of visual articulatory vs. gestural cues in audiovisual lexical stress perception. Talk presented at DGfS-Workshop: Visual Communication. New Theoretical and Empirical Developments (ViCom 2022). Virtual meeting. 2022-02-23 - 2022-02-25.

2022

Bujok R., Meyer, A. S., & Bosker, H. R. (2021). Lexical stress perception is influenced by seeing a talker’s gesture, but not face. Talk presented at the 19th Annual Auditory Perception, Cognition and Action Meeting (APCAM 2021). Virtual meeting. 2021-11-04.

2021

Bujok R., Bultena, S., McQueen, J. M., & Broersma, M. (2021). Accent adaptation through error-based learning. Talk presented at EDLL 2021 - International Conference on Error-Driven Learning in Language. Tübingen, Germany. 2021-03-10 - 2021-03-12.

Posters

2024

Cos F., Bujok R., & Bosker, H. R. (2024). Test-retest reliability of audiovisual stress perception after >1.5 years. Poster presented at Speech Prosody 2024, Leiden, NL.

2023

Bujok R., Peeters, D., Meyer, A. S., & Bosker, H. R. (2023). Beat gestures can drive recalibration of lexical stress perception. Poster presented at Phonetics and Phonology in Europe 2023 (PaPE 2023), Nijmegen, NL.

2023

Bujok R., Peeters, D., Meyer, A. S., & Bosker, H. R. (2023). Beat gestures can drive recalibration of lexical stress perception. Poster presented at Donders Poster Session 2023, Nijmegen, NL.

2022

Bujok R., Meyer, A. S., & Bosker, H. R. (2022). Not all visual cues to lexical stress affect audiovisual speech perception: beat gestures vs. articulatory cues. Poster presented at IMPRS Conference 2022, Virtual meeting.

2022

Bujok R., Meyer, A. S., & Bosker, H. R. (2022). Beat gestures influence audiovisual lexical stress perception, while visible facial cues do not. Poster presented at the 35th Annual Conference on Human Sentence Processing (HSP 2022), Virtual meeting.

Academic Contributions

Supervisor

Co-supervising Ivy Mok’s Master thesis titled “We see what we hear; sometimes we hear what we see.” (2022).

Co-organizer and Chair

GESPIN 2023 conference, technical support, organization and chair (2023); Lunch talk committee, MPI for Psycholinguistics (2021 - 2024)

Member Research Assessment Committee

Tilburg University: Language, Communication and Cognition (2024)

PhD Representative

Internal MPI PhD representative, providing support and mentoring to PhDs, and organizing academic and social events (2021 - 2023)

Public Outreach

Conducted and presented experiments at the DRONGO talenfestival (2019 - 2020)

Translator

Translator for the TalkLink Blog at the MPI for Psycholinguistics, Translating English blogposts to German (2021 - 2024)