The Digital Literacy Instructor: Developing Automatic Speech Recognition and Selecting Learning Material for Opaque and Transparent Orthographies
نویسنده
چکیده
While learning a new language can now be a lot of fun because attractive interactive games and multimedia materials have become widely available, many of these products generally do not cater for non-literates and low-literates. In addition, their limited reading capabilities make it difficult for these learners to access language learning materials that are nowadays available for free on the web. More advanced course materials that can make learning to read and spell in a second language (L2) more enjoyable would therefore be very welcome. This article reports on such an initiative, the DigLin project, which aims at developing and testing online basic course material for non-literate L2 adult learners who learn to read and spell either in Finnish, Dutch, German or English, while interacting with the computer, which continuously provides feedback like the most determined instructor. The most innovative feature of DigLin is that in production exercises learners can read aloud and get feedback on their speech production. This is made possible through the use of Automatic Speech Recognition (ASR). In this article we focus on what ASR is and what is needed to employ ASR to develop learning materials for non-literates and low-literates L2 learners. Central issue is the selection of the content for the four languages, which differ in orthographic transparency and present their own specific problems in combination with the mother tongue of the learners.
منابع مشابه
The digital instructor for literacy learning
The DigLIn project aims at providing concrete solutions for adult literacy students by developing and testing L2 literacy acquisition material in four different languages and by employing Automatic Speech Recognition (ASR) to analyse the learner’s read speech output and provide feedback. We develop the technology, design sample exercises for different languages (Dutch, English, German and Finni...
متن کاملThe Effect of Auditory-visu Orthographic Backgroun
Visual information from the lips and face is an integral part of speech perception. In addition, orthography can play a role in disambiguating the speech signal in foreign/second language (L2) perception and production. The current study investigates the effect of auditory and visual speech information and orthographic depth, the degree to which a language is transparent (high phoneme-grapheme ...
متن کاملBilingualism yields language-specific plasticity in left hemisphere's circuitry for learning to read in young children
How does bilingual exposure impact children's neural circuitry for learning to read? Theories of bilingualism suggests that exposure to two languages may yield a functional and neuroanatomical adaptation to support the learning of two languages (Klein et al., 2014). To test the hypothesis that this neural adaptation may vary as a function of structural and orthographic characteristics of biling...
متن کاملA Database for Automatic Persian Speech Emotion Recognition: Collection, Processing and Evaluation
Abstract Recent developments in robotics automation have motivated researchers to improve the efficiency of interactive systems by making a natural man-machine interaction. Since speech is the most popular method of communication, recognizing human emotions from speech signal becomes a challenging research topic known as Speech Emotion Recognition (SER). In this study, we propose a Persian em...
متن کاملDesigning and implementing a system for Automatic recognition of Persian letters by Lip-reading using image processing methods
For many years, speech has been the most natural and efficient means of information exchange for human beings. With the advancement of technology and the prevalence of computer usage, the design and production of speech recognition systems have been considered by researchers. Among this, lip-reading techniques encountered with many challenges for speech recognition, that one of the challenges b...
متن کامل