Every year, the China Pavilion is the highlight of the World Expo. Under normal circumstances, the Chinese Pavilion of the Dubai World Expo is expected to receive 2-3 million visitors. China's novel coronavirus pneumonia is affected by the outbreak of the new crown pneumonia, and the number of visitors to the China Pavilion will be greatly reduced. As one of the largest exhibition halls in Dubai World Expo, China Pavilion focuses on China's frontier exploration in the field of science and technology, including aerospace technology, smart city, future concept car, intelligent robot, etc. "what way can we break through the restrictions of the epidemic and let visitors around the world see China's cutting-edge technology?" Under the influence of the epidemic, this problem has become a problem repeatedly thought by the Organizing Committee of the China Pavilion of the World Expo. Finally, on the day of the opening of the China Pavilion of the Dubai World Expo, the Organizing Committee launched a "new gadget" full of science and technology - the China Pavilion on the cloud. As long as the audience clicks the link or scans the QR code, they can immediately "stay in front of" the China Pavilion of Dubai World Expo, click the screen to "change the scenery step by step" and "stroll and play" in the China Pavilion of Dubai World Expo from the first perspective. Whether it's cool scientific and technological products, the scientific and technological stories behind the exhibits, or even the part of strong on-site experience such as immersive space, you can directly feel it in the "China Pavilion on cloud". Not long after the "cloud China Pavilion" went online, among the exhibitors of the China Pavilion of the Dubai World Expo, including enterprises in hotel tourism, new retail, culture and Expo and other industries are asking, "which company did the cloud China Pavilion? How did it come out?" Such cutting-edge technology comes from a Chinese technology company - such as TV. As a leader in comprehensive solutions for spatial digitization, Jushi has a leading VR technology R & D team in China, independently created an internationally leading diversified VR acquisition equipment, and has launched VR house viewing, VR belt viewing, AI lecture room and other products, becoming the first service provider in the industry to realize the large-scale application of VR on the industrial side. From "room" to "Pavilion" in VR, and it is a large space exhibition hall with an area of nearly 5000 square meters and complex scenes in the Expo China Pavilion, which once again "amazes" everyone. Visit the Expo on "cloud" "I didn't expect that scenes like immersive space that require on-site experience can also be felt in the cloud China Pavilion. After entering the Beidou exhibition hall, I clicked the center point, and the holographic image on the screen suddenly flowed to me. For a moment, I felt I was on the scene. This experience was completely beyond my imagination." Shi Yuan, from a university in Beijing, usually likes to study fashionable technologies such as VR and ar. after experiencing the China Pavilion on the cloud, he sighed so much. The scene mentioned by Shi Yuan is in the Beidou exhibition hall of the China Pavilion on the cloud. The offline exhibition hall uses a 3D three-dimensional lighting matrix, combined with an arc screen, a large ground screen and nine Beidou navigation satellite solid models suspended above the space to form a three-dimensional multimedia interactive space display system. The audience will feel immersed in the vast universe together with Beidou navigation satellite. When building this scene offline, scientific and technological means such as 3D and holographic images are used. In order to feel the same immersion on the "cloud" end, it is generally necessary to reconstruct the online content, supplemented by external devices such as VR head display or glasses. However, in the cloud China Pavilion, as long as the audience turns on their mobile phone and selects the appropriate point, they can automatically trigger the "mechanism" to "live" the content on the screen, and the audience is like being in it. No wonder many people call "amazing" after experiencing it. Shi Yuan has experienced many space reproduction products, such as the cloud China Pavilion, which is so "amazing" that he wants to "like manually". Different from other three-dimensional space reconstruction products, cloud China Pavilion is also equipped with rich and colorful content ecology on the basis of 1:1 reproduction of offline space. For some key exhibits, users can easily trigger relevant voice, text, video and other tags to listen to / watch the relevant introduction of the exhibits, just like taking a portable guide when participating offline, let alone the cool experience of "re engraving" on-site immersion. "Although we didn't have a chance to visit the World Expo in Dubai, it's no worse than offline exhibitions. Hurry up." After experiencing the highlights of the China Pavilion on the cloud, Shi Yuan immediately became a "tap water" among VR lovers. Many people are curious about how such a cool product can complete the space reproduction of such a large venue, and what is the technical support behind it? The answer is the intelligent hardware product developed by Jushi itself - VR acquisition device Galois. An overseas "adventure" of intelligent hardware On August 27, 2021, at Dubai International Airport, border inspectors looked at each other around a black box machine and were very curious. Carriers call it a "camera", but its appearance is completely different from the camera they usually see. After careful explanation by the translation team, the frontier inspection personnel realized that this is a spatial "scanning camera" specially used for spatial three-dimensional reconstruction. Different from ordinary cameras, what this camera finally takes is not a static picture, but an online three-dimensional solid space reproduced in the same proportion of 1:1, which can be seen by users on mobile phones, pads and other terminal devices. This "camera" is exactly the Galois mentioned above. Galois is a professional VR acquisition equipment developed by Rushi. Based on laser acquisition technology, it can realize 360 ° automatic scanning, collect scene depth data, and automatically splice the pictures to generate VR materials. In terms of acquisition efficiency, the depth laser detection module carried by Galois not only expands the acquisition radius to 25m, greatly reduces the acquisition points and improves the acquisition efficiency, but also enables the depth acquisition accuracy to reach an absolute error of 20mm, and the measurement area error can be controlled within 0.4%. In addition, Galois's color sensitive components are also upgraded to 4 / 3-inch large target CMOS. Combined with the fish eye lens using multi-layer coating technology, it can effectively resist glare, purple edge and other problems, make the collected image quality reach the micro single level, and make every detail of the space clearly visible with more accurate color presentation. During the implementation of the "cloud China Pavilion" project, it was Jialuohua who went to Dubai to perform space photography and acquisition tasks. However, affected by the epidemic situation, if the staff could not go to the scene to collect and shoot in person, under the whole process remote guidance, galuohua was operated by a third-party staff and "completed the space acquisition task" alone ", which took only 10 hours in a space of nearly 5000 square meters. After the collected and photographed data are transmitted back, such as visual, the huge data collected by Galois is intelligently processed by using self-developed software and algorithms. In this super large space scene, if the scattered space is spliced as needed, it will be formed into a complete space through technology, and the user will have a consistent visual experience through post-processing. Then, according to the characteristics of each exhibition hall, carry different multimedia content, such as panoramic video, voice and text, and optimize browsing and scene switching experience, so as to have the "China Pavilion on cloud" that "amazes" everyone. Why can a product that used to "shoot a room" be "cross-border" to shoot large venues and create so many surprises? When this question was thrown to the R & D team of Galois, both the department head and the newly joined "recruits" led to the same answer - such as the rigid spirit of technological innovation. After all, from the day of birth, Ru Shi, as the first person to eat crabs, starts from scratch to solve a problem that has never been solved. Behind Galois's widely praised today is the way from team building, R & D, supply chain to mass production. The road of self-study from scratch Galois was first applied in the field of real estate brokerage. In this industry, real estate brokers have to face a problem every day: how to describe the house to customers? At the beginning, the solution was to establish a team of thousands of photographers across the country, taking plane photos of houses with SLR and collecting house type data with laser pen. However, this method is time-consuming and laborious, and still can not solve the problem of "photo fraud". Through 2D pictures, customers can only see the local information of the room, and can not feel the real spatial structure information of the room. In order to solve this problem, such as aiming at the emerging VR technology at that time, structured light VR with follow-up data value and strong sense of immersion has become the main direction of such vision. At that time, there was no mature structured light VR solution on the market. Choosing this direction means that if you want to invest huge human and material resources, start from scratch. Initially, the team wanted to solve the hardware problem by purchasing equipment from other companies. However, after contacting many VR hardware companies at home and abroad, it is found that the overall cost is too high, and the existing equipment and technology may not be suitable for spatial acquisition in the real estate field. After comprehensive weighing, the team decided to take the road of self-study. "The first version of the motherboard can't light up three cameras at the same time. Once three cameras are lit up at the same time, the motherboard will crash directly. It took us nearly a month to find out what the problem is. Because the debugging of the hardware is one step at a time, I want to find my supplier, and my supplier also needs to find his upstream, which is a very complex troubleshooting task Process. Finally, we rely on the deep industry experience of R & D personnel and solve the problem with some software methods. " Talking about the difficulties of R & D at that time, Shi Wenbo, the person in charge of visual intelligence, is still impressed. It was with the strength of struggling with difficulties that, after two failures, as in July 2018, it took one year to develop a large-scale mass production VR acquisition device Riemann. Based on structured light technology, Riemann has three sets of lenses: infrared transmitter, color lens and infrared receiver. By projecting structured light into space, Riemann collects the structured light characteristics of space while taking panoramic photos, and automatically generates a three-dimensional point cloud in the cloud. With a space of 100 square meters, the collection can be completed in only 20 minutes. On July 31, 2018, the first Riemann machine was assembled in a professional assembly plant, marking the equipment guarantee for the large-scale implementation of VR acquisition technology based on structured light in the field of real estate. However, Riemann is not without defects. After promotion for a period of time, the team quickly found the problem: Riemann obtains spatial three-dimensional point cloud data through infrared reflection and reception. It is difficult to collect spatial information in outdoor spaces with strong sunshine such as the south balcony. Immersed in the emotion of successful R & D, the team immediately invested in the R & D of new equipment. How to use one equipment to deal with the space scenes under different lighting environments such as balcony and bathroom? How to achieve lower acquisition accuracy error rate and higher acquisition and shooting efficiency? These have become the core problems to be solved by the team in the research and development of new equipment. In April 2020, Rushi carried out a self "revolution" on the basis of structured light VR and launched a new generation prototype based on laser acquisition technology - Galois. Compared with Riemann, Galois based on laser acquisition does not have to worry about light problems. In any lighting environment, it can collect spatial point cloud data through laser technology. The acquisition radius is also expanded from 5 meters to 25 meters, and the accuracy error is reduced from 1% to 0.4%. In addition, Galois maintained