Massive digital braille is generated in real time, and AI helps visually impaired people read without barriers
2022-06-14
Braille AI real-time translation algorithm is one of the core technologies of the software, which can generate massive Braille digital resources in real time. Its operation logic is to first convert Chinese, English and other text coding formats into Unicode format, then select Braille type, and then call Braille AI real-time translation algorithm to output national general Braille, current Braille, full spelling Braille and double spelling Braille. —— Yangwenzhen, a research expert of the human like perception research center of Zhijiang Laboratory "The ten scenic spots of the West Lake are located in the West Lake District of Hangzhou City, Zhejiang Province..." recently, at the special opening activity of Zhijiang laboratory held in Hangzhou, Zhejiang Province, the visually impaired volunteer lulinsong accurately read out the Braille content he touched through the intelligent Braille reader displayed on the spot. The Braille reader he experienced was a Braille digital intelligent device developed by the scientific research team of Zhijiang laboratory in conjunction with a number of institutions, which integrates vision, touch, listening and other types of perception. Along with it were Braille teaching machines and English machines, covering three core application scenarios of blind learning, reading and public service. "These three Braille machines are equipped with the team's world's first dense dot matrix electromagnetic driven nano precision tactile reproduction technology, as well as China's leading AI real-time generation technology of Braille digital resources and audio-visual touch synchronous sensing technology." Yangwenzhen, a research expert at the anthropomorphic perception research center of Zhijiang laboratory, said that the team's Braille digital research work began in 2011. After four rounds of technical research and updating iteration, the product performance has been increasingly improved, and has been piloted and promoted in 21 provinces and regions across the country. Visually impaired people are trapped in the digital divide A set of Braille books is several times more expensive than ordinary books with the same content. The reporter saw at the scene that a Braille version of the primary school Chinese textbook is not only wide, but also as thick as a dictionary. "Braille books have complex production processes, long publishing cycles, small information carrying capacity, easy wear and tear, and are not durable." Taowentao, engineering specialist of Zhijiang laboratory human perception research center, said that paper Braille books are still the main tool for domestic blind people to learn knowledge and obtain information, and the popularity of Braille digital equipment is very low. Relevant statistics show that the number of visually impaired people in China has reached more than 17 million, of which more than 8 million are completely blind, accounting for 20% of the world's blind population. About 450000 new blind people will appear every year. Due to various reasons, it is common for visually impaired people in China not to know Braille, and there is also a shortage of Braille teachers. In 2017, the Ministry of finance, the China Disabled Persons' Federation and other departments jointly launched the "digital reading promotion project for the blind", which enabled 1000 Braille computers and Braille electronic displays to be configured in 100 blind education institutions across the country. However, it is still difficult to meet the huge needs of the majority of visually impaired groups in China. "In the information age of knowledge explosion and rapid iteration, there is a serious shortage of Braille digital resources, and the digital divide of visually impaired groups is becoming more and more prominent." Yangwenzhen said that at present, few people use artificial intelligence technology in braille information barrier free products. In combination with the national conditions of visually impaired groups in China, the team specially developed three products with different functions by applying the self-developed flexible interface tactile measurement test technology, visual touch fusion perception technology and Braille AI real-time translation algorithm. According to yangwenzhen, the team has proposed a digital Braille learning method with simultaneous visual, auditory and tactile stimulation, which can improve the efficiency of Braille learning for visually impaired people. It has designed a multi perception information matching AI algorithm, which can output information with the same content of text, sound and Braille points, so as to provide conditions for visually impaired people to learn Braille without barriers. Intelligent system improves translation accuracy "Braille AI real-time translation algorithm is one of the core technologies of this software, which can generate massive Braille digital resources in real time." Yangwenzhen said that the operation logic is to first convert the Chinese, English and other text coding formats into Unicode format, then select the Braille type, and then call the Braille AI real-time translation algorithm to output the national general Braille, current Braille, full spelling Braille and double spelling Braille. Chinese blind translation is to automatically convert the source text of Chinese characters into the corresponding Braille text. At present, there are some problems, such as the confusion of polysyllabic words, the inability to add unregistered words, and the non-compliance with the rules of Braille word segmentation and writing. The reporter learned that the team has built a Chinese blind translation system based on the reverse maximum matching word segmentation algorithm, which can better identify polyphonic words, add unregistered words independently, get more correct word segmentation and writing results, and effectively improve the accuracy of Chinese blind translation. For blind English translation, the team designed a conversion algorithm from Braille shape symbol Unicode code to Braille ASCII code and Braille dot order. "The system outputs the text into Braille dot order through intelligent word segmentation and translation program. Finally, according to the sequence of input strings, the Braille dot order is merged to realize Braille digitization." Yangwenzhen said that the team has also developed and designed a set of natural human-computer interaction programs suitable for the blind to touch and read. The functions of directory recognition, bookmark storage and text reading are realized on the braille machine, forming a complete file management system for the blind to operate independently. Connect the USB flash disk to the device, and the blind can use it quickly through simple key operation... Through the demonstration and operation of scientific researchers, the reporter noticed that the division of labor of each module of the intelligent Braille reader is clear: the visual display module displays ordinary text and Braille, the voice module broadcasts ordinary text, and the Braille display device presents Braille Braille. It is reported that the three products developed by the team have been applied to the national reading project, rural cultural auditorium, integrated education, library, urban bookstore and other occasions, and have received good feedback from units or individuals such as China Association for the blind, China Braille library, Beijing school for the blind and so on. "In the digital age, in addition to text information, image information is also difficult for the blind to understand and perceive." Yangwenzhen said that the team will next develop a digital image tactile two-dimensional graphic tactile intelligent sensing device, quickly and accurately generate dot matrix tactile images based on artificial intelligence technology, and transfer image information to the blind by tactile acquisition, in order to establish a tactile channel between the visually impaired and the digital space, and promote the solution of the digital divide. (Xinhua News Agency)
Edit:Li Jialang Responsible editor:Mu Mu
Source:stdaily.com
Special statement: if the pictures and texts reproduced or quoted on this site infringe your legitimate rights and interests, please contact this site, and this site will correct and delete them in time. For copyright issues and website cooperation, please contact through outlook new era email:lwxsd@liaowanghn.com