Computational linguistics is the science of understanding and modeling human language using computers. Since human language has many forms – spoken, signed and written – and involves various organs such as the vocal tract, ears, face, hands, eyes, and the brain, our research covers the full range of these modalities and senses.
Fluency in spoken communication – the ability to speak with smooth, natural timing and appropriate speed – forms the foundation of successful spoken interaction, enabling efficient and effective exchange of information. It is one of the most salient hallmarks of spoken language proficiency. While fluency has been extensively studied in speech communication, its role in sign language, where language is conveyed entirely through the visual-spatial modality, remains largely unexplored.
In a newly funded SNSF project, “Fluency in Speech and Signing” (FluSS), we aim to understand how utterance production and cognitive mechanisms in sign language compare to those in speech. Specifically, we will investigate whether the mechanisms that underlie fluency in speech also play a critical role in sign language fluency. The project consists of three closely interconnected subprojects: (1) Fluency across modalities and proficiency levels (Prof. Dr. Tobias Haug, University of Teacher Education in Special Needs, HfH), (2) Automatic analysis of fluency in speech and signing (Prof. Dr. Sarah Ebling, University of Zurich), and (3) Common cognitive processes in speech and signing (Prof. Dr. Volker Dellwo, University of Zurich). The project is carried out in collaboration with Prof. Dr. Nivja de Jong (Leiden University).
For Subproject 2, we are seeking a PhD candidate (4 years) at the Department of Computational Linguistics, University of Zurich. The subproject deals with automatic analysis of fluency in speech and signing: We will leverage machine learning methods-more specifically, deep learning methods-to investigate the automation of fluency analysis in speech and signing. The PhD position will focus on the sign language side.
The Department of Computational Linguistics conducts research and teaching in artificial intelligence for language and speech. Subproject 2 will be based in the Language, Technology and Accessibility group (Prof. Dr. Sarah Ebling) but will involve close collaboration with all other subprojects. The experimental work will be carried out in the laboratory of the Linguistic Research Infrastructure (LiRI).