Learning new languages can be a hectic and time-consuming process. It involves a lot of study and requires putting in an ample amount of time and effort. Often, the process can be boring as foreign words are unrelatable and need repeated practice to memorize. To make the learning process more intuitive, Rensselaer Polytechnic Institute (RPI) situated in Troy, New York has developed a classroom that uses AI and VR to teach Mandarin Chinese.
The classroom makes use of several sensors to adapt to the behavior of students to provide a better learning experience based on their grasping abilities. The image below shows a student interacting with the system using the mic for voice input and camera for tracking the body movements.