AI virtual anchor "Shangxin" character and role can be customized on demand
2022-05-18
"Hello, everyone. Welcome to iFLYTEK's official live studio. I'm your anchor Sisi." "I'm Sisi's sister Sisi. Don't forget to pay attention. There are a lot of benefits tonight." …… On May 15, live anchor Sisi, holding hands with her "twin sister", appeared in iFLYTEK Tiktok live studio. Although the "twin anchors" are "Sister Flowers" with the same appearance, with the help of iFLYTEK's new "Ai virtual human live broadcasting system", Sisi not only reproduces the appearance of the real-life anchor Sisi, but also gives it the ability to drive, so as to realize the real-time live broadcasting of the virtual anchor. AI virtual anchor character can be customized and multiple roles can be selected At present, more and more AI virtual anchors have entered the public's field of vision, making frequent "debut" in live broadcasting rooms and short video platforms. With multi-dimensional, full sensory and immersive interactive experience, they have become the "hot choice of anchors" and "loved by thousands". "Relying on independent key technologies such as voice recognition, face modeling, lip prediction and audio driving, iFLYTEK AI virtual anchor supports users to drive virtual people to broadcast live through text or voice input, so as to realize intelligent driving and fast and convenient virtual live broadcasting." Liu Cong, executive director of iFLYTEK Research Institute, told Science and technology daily. Liu Cong said that iFLYTEK based on big data multimodal pre training language and speaker independent lip driving framework can not only ensure the lip synthesis effect with high authenticity, but also realize the lip driving of different types of voice, including different languages, dialects and timbres, so that the virtual anchor is not afraid of time and space constraints. It can broadcast live even at the bedside of the bedroom, and can "seamlessly switch" with the real anchor at any time, The mode is more flexible and changeable. "The 'AI virtual human live broadcast system' also has a rich scene library, which can be freely customized according to the live broadcast content and virtual human 'character' to create an exclusive virtual human live broadcast room." Liu Cong said. It is reported that iFLYTEK's "Ai virtual human live broadcasting system" has a rich image library. It can not only select the facial features "pinch the face" according to the audience's preferences and needs to create a new virtual human, but also endow it with corresponding image temperament according to different scenes, or 2D or 3D, or half body or whole body Or "salt" or "sweet"... "IFLYTEK's advanced speech synthesis technology can also customize the personalized speech library for virtual people to restore the voice of real anchors or customize the characteristic voice. Multilingual technology enables AI virtual anchors to support both Chinese and English mixed broadcasting and multi-national languages such as Japan, South Korea, Thailand and Vietnam, which is full of international style." Liu Cong said. It can be used in many industries and can "walk into" ordinary people in the future The reporter learned in the interview that AI virtual anchor can also provide multi-terminal interfaces for different needs, and can provide vertical and perfect solutions for multiple scenes. It can be used in media, finance, culture and tourism, government and enterprises and other industries to provide AI products and services with automatic production and intelligent interaction of audio and video content, so as to help realize automatic and intelligent customer value. Among them, in the media news scene, the audio and video production automation of news content can be realized for a large amount of audio and video content. As long as you input text, you can "one-stop" produce finished videos, especially for the content broadcast with high update frequency such as major and sudden news, which can significantly improve the efficiency. At present, the AI virtual anchor jointly created by CCTV news, people's daily digital communication, Hefei TV and iFLYTEK has been "on duty" and performed well. "The new generation of human-computer interaction based on virtual human will evolve rapidly. We need to make continuous technological breakthroughs in the dimensions of perception, understanding and expression, so that the human-computer interaction experience can be improved by leaps and bounds. In short, we hope that virtual human will become more and more intelligent. They understand emotion and personality, and can help human beings assist us in our work and life." Liu Cong is full of confidence in the future development of virtual human. Liu Cong believes that from production and life to the Olympic Games, artificial intelligence is no longer a wordless and cold technology, but a scientific and technological force full of warmth and enabling all things. The "Ai virtual human live broadcasting system" developed based on the base of AI virtual human interaction platform will gradually open hundreds of virtual images and thousands of sound libraries in the future, and provide characteristic services of multi-mode perception, multi-dimensional expression, emotional penetration and self customization, so as to make the image of virtual anchor more realistic, emotional and interactive. AI, like water and electricity, has been integrated into people's lives. Liu Cong said that in the future, by deeply integrating technology with products and application scenarios, virtual people can also "walk into" ordinary families, bring more convenient services to people's work and life, and become close partners of mankind. (Xinhua News Agency)
Edit:Li Ling Responsible editor:Chen Jie
Source:Science and Technology Daily
Special statement: if the pictures and texts reproduced or quoted on this site infringe your legitimate rights and interests, please contact this site, and this site will correct and delete them in time. For copyright issues and website cooperation, please contact through outlook new era email:lwxsd@liaowanghn.com