The reporter learned from Tsinghua University that after the release of the world's first heterogeneous fusion brain chip "Tianjixin" in 2019, the precision instrument department's brain computing research team has made new breakthroughs in the field of brain like visual perception chips, developing the world's first brain like complementary vision chip "Tianmouxin". This chip can achieve high-speed, 10 bit high-precision, and 130dB high dynamic range visual information acquisition at an extremely low bandwidth and power consumption cost of 10000 frames per second. It not only provides strong technical support for the development of the intelligent revolution, but also opens up new paths for important applications such as autonomous driving and embodied intelligence. The paper "Visual Chips with Complementary Pathways for Open World Perception" based on the above research results was published as a cover article in the May 30th issue of Nature magazine. This is the second time that the team has appeared on the cover of Nature, following the heterogeneous fusion of brain like computing "Tianjixin", marking a fundamental breakthrough in both brain like computing and brain like perception in China. "In the open world, intelligent systems not only need to handle large amounts of data, but also need to deal with various extreme events, such as sudden dangers during driving, drastic changes in lighting at tunnel entrances, and strong flash interference at night." Shi Luping, the corresponding author of the paper and professor of precision instruments at Tsinghua University, introduced that traditional visual perception chips often face problems of distortion, failure, or high latency when dealing with these scenarios. To overcome these challenges, the research team focuses on brain like visual perception chip technology and proposes a new paradigm of complementary dual pathway brain like visual perception based on visual primitives. "This paradigm draws on the basic principles of the human visual system, decomposing open world visual information into information representations based on visual primitives, and by organically combining these primitives, imitating the characteristics of the human visual system, forming two complementary and information complete visual perception pathways." Shi Luping introduced that based on this new paradigm, the team has further developed the world's first brain like complementary visual chip, "Tianmou Xin". "It not only breaks through the performance bottleneck of traditional visual perception paradigms, but also can efficiently cope with various extreme scenarios, ensuring the stability and safety of the system." Based on "Tianmou Xin", the team has also independently developed high-performance software and algorithms, and conducted performance verification on open environment vehicle platforms. ". In various extreme scenarios, the system has achieved real-time perception and inference with low latency and high performance, demonstrating its enormous potential in the field of intelligent unmanned systems. Shi Luping stated that, based on the technology accumulation that the team has already applied in areas such as brain like computing chips "Tianjixin", brain like software toolchains, and brain like robots, the addition of "Tianmouxin" will further improve the brain like intelligence ecosystem and effectively promote the development of artificial general intelligence. (Lai Xin She)
Edit：GuoGuo Responsible editor：FangZhiYou
Source：People.cn
Special statement: if the pictures and texts reproduced or quoted on this site infringe your legitimate rights and interests, please contact this site, and this site will correct and delete them in time. For copyright issues and website cooperation, please contact through outlook new era email：lwxsd@liaowanghn.com
Recommended Reading Change it 
Home
