Shanghai Museum AI Sign Language Service Station
This is the nation's first purely AI-driven museum sign language service station. Hearing-impaired visitors only need to use sign language to ask questions freely, and the AI digital human can answer in real-time with natural and fluent sign language regarding exhibition hall locations, facilities, reservations, and other information. This service aims to break communication barriers with technology and enhance the exhibition-viewing experience for the hearing-impaired community.
Year of Completion:
2025
Awards and Exhibitions
Put into use at the Shanghai Museum
Responsible for:
Interaction design, user testing
Video
Cooperate with Shanghai Museum
The Shanghai Museum is a comprehensive museum dedicated to ancient Chinese art. Located in People's Square in Shanghai, it is one of China's most important museums. The design of the museum building is inspired by the "ding", a traditional Chinese bronze vessel, symbolizing the cultural concept of "round heaven and square earth".
The museum's collection covers multiple categories, including bronzes, ceramics, calligraphy, paintings, jades, coins, seals, and minority ethnic crafts. It has a complete collection system and is particularly famous for its collection of bronzes and ancient calligraphy and paintings. The museum has long been open to the public free of charge, serving as an important window for understanding traditional Chinese art and one of Shanghai's key cultural landmarks.
In December 2025, the Shanghai Museum, in cooperation with ShanghaiTech University, launched the nation's first purely AI-driven museum sign language service station and AI sign language tour guide, using technology to break the barrier of "sound" and target services for the hearing-impaired community, so that cultural relics can not only be "seen" but also "understood," allowing all people to better feel the charm of ancient Chinese art and enjoy the museum's high-quality cultural resources.
Accessible Interaction
When hearing-impaired visitors stand in front of the AI sign language service station, they only need to simply stretch out their hands, and within 3 seconds, they can establish a "dialogue" with the digital human on the screen — without complex operations or learning fixed question templates.
"Which floor is the sculpture gallery on?" "Where is the restroom?" "Does the museum have a restaurant?"... Whether visitors ask about tour routes, service facilities, or reservation information, the digital human always "hears" the questions and "speaks" the answers with natural and fluent sign language. The end-to-end response speed is under 1 second, and the question matching success rate exceeds 90%. Even if the sign language expression is non-standard or contains regional characteristics, the system can accurately "guess" the intention based on the context and provide precise guidance.
AI Sign Language Guide
Full-Scenario Coverage, Zero-Latency Interaction
Supports real-time translation of voice explanations throughout the exhibition, covering exhibit introductions, event guidance, and interactive Q&A scenarios. The response time is under 0.3 seconds, ensuring "zero-lag" information transmission.
Multimodal interaction design: Visitors can interact with the digital human via gestures, voice, or touch screens, with the system automatically adapting to the best communication method.
High-Precision Sign Language Recognition and Generation
Relying on DGene's self-developed 3D gesture capture algorithms and multilingual fusion models, the system can accurately recognize over 5,000 sign language vocabulary words and generate fluent expressions that conform to Chinese Sign Language grammar based on context.
Pioneering "Emotional Expression" feature: The digital human can convey emotions through micro-expressions and body language, making communication warmer.
Cultural Empowerment, Tech for Good
The service station simultaneously launches an AI sign language teaching module, allowing visitors to learn basic sign language vocabulary and experience the joy of barrier-free communication. Future plans include integration with AR navigation to achieve deep interaction through "gesture-to-click exhibits + 3D animation analysis."
Test
Test and communicate with at least 2 hearing-impaired friends every week to understand their daily usage habits, and customize interactive experiences that meet their needs.
Related Reports
AI sign language exhibition-viewing "buddy" is in place! Come to the Shanghai Museum East to experience the brand-new barrier-free services
https://mp.weixin.qq.com/s/7tYniP9Jp7Rn9zdaeY7lwg
Other Projects
Shanghai Museum AI Sign Language Service Station
This is the nation's first purely AI-driven museum sign language service station. Hearing-impaired visitors only need to use sign language to ask questions freely, and the AI digital human can answer in real-time with natural and fluent sign language regarding exhibition hall locations, facilities, reservations, and other information. This service aims to break communication barriers with technology and enhance the exhibition-viewing experience for the hearing-impaired community.
Year of Completion:
2025
Awards and Exhibitions
Put into use at the Shanghai Museum
Responsible for:
Interaction design, user testing
Video
Cooperate with Shanghai Museum
The Shanghai Museum is a comprehensive museum dedicated to ancient Chinese art. Located in People's Square in Shanghai, it is one of China's most important museums. The design of the museum building is inspired by the "ding", a traditional Chinese bronze vessel, symbolizing the cultural concept of "round heaven and square earth".
The museum's collection covers multiple categories, including bronzes, ceramics, calligraphy, paintings, jades, coins, seals, and minority ethnic crafts. It has a complete collection system and is particularly famous for its collection of bronzes and ancient calligraphy and paintings. The museum has long been open to the public free of charge, serving as an important window for understanding traditional Chinese art and one of Shanghai's key cultural landmarks.
In December 2025, the Shanghai Museum, in cooperation with ShanghaiTech University, launched the nation's first purely AI-driven museum sign language service station and AI sign language tour guide, using technology to break the barrier of "sound" and target services for the hearing-impaired community, so that cultural relics can not only be "seen" but also "understood," allowing all people to better feel the charm of ancient Chinese art and enjoy the museum's high-quality cultural resources.
Accessible Interaction
When hearing-impaired visitors stand in front of the AI sign language service station, they only need to simply stretch out their hands, and within 3 seconds, they can establish a "dialogue" with the digital human on the screen — without complex operations or learning fixed question templates.
"Which floor is the sculpture gallery on?" "Where is the restroom?" "Does the museum have a restaurant?"... Whether visitors ask about tour routes, service facilities, or reservation information, the digital human always "hears" the questions and "speaks" the answers with natural and fluent sign language. The end-to-end response speed is under 1 second, and the question matching success rate exceeds 90%. Even if the sign language expression is non-standard or contains regional characteristics, the system can accurately "guess" the intention based on the context and provide precise guidance.
AI Sign Language Guide
Full-Scenario Coverage, Zero-Latency Interaction
Supports real-time translation of voice explanations throughout the exhibition, covering exhibit introductions, event guidance, and interactive Q&A scenarios. The response time is under 0.3 seconds, ensuring "zero-lag" information transmission.
Multimodal interaction design: Visitors can interact with the digital human via gestures, voice, or touch screens, with the system automatically adapting to the best communication method.
High-Precision Sign Language Recognition and Generation
Relying on DGene's self-developed 3D gesture capture algorithms and multilingual fusion models, the system can accurately recognize over 5,000 sign language vocabulary words and generate fluent expressions that conform to Chinese Sign Language grammar based on context.
Pioneering "Emotional Expression" feature: The digital human can convey emotions through micro-expressions and body language, making communication warmer.
Cultural Empowerment, Tech for Good
The service station simultaneously launches an AI sign language teaching module, allowing visitors to learn basic sign language vocabulary and experience the joy of barrier-free communication. Future plans include integration with AR navigation to achieve deep interaction through "gesture-to-click exhibits + 3D animation analysis."
Test
Test and communicate with at least 2 hearing-impaired friends every week to understand their daily usage habits, and customize interactive experiences that meet their needs.
Related Reports
AI sign language exhibition-viewing "buddy" is in place! Come to the Shanghai Museum East to experience the brand-new barrier-free services
https://mp.weixin.qq.com/s/7tYniP9Jp7Rn9zdaeY7lwg
Other Projects
Shanghai Museum AI Sign Language Service Station
This is the nation's first purely AI-driven museum sign language service station. Hearing-impaired visitors only need to use sign language to ask questions freely, and the AI digital human can answer in real-time with natural and fluent sign language regarding exhibition hall locations, facilities, reservations, and other information. This service aims to break communication barriers with technology and enhance the exhibition-viewing experience for the hearing-impaired community.
Year of Completion:
2025
Awards and Exhibitions
Put into use at the Shanghai Museum
Responsible for:
Interaction design, user testing
Video
Cooperate with Shanghai Museum
The Shanghai Museum is a comprehensive museum dedicated to ancient Chinese art. Located in People's Square in Shanghai, it is one of China's most important museums. The design of the museum building is inspired by the "ding", a traditional Chinese bronze vessel, symbolizing the cultural concept of "round heaven and square earth".
The museum's collection covers multiple categories, including bronzes, ceramics, calligraphy, paintings, jades, coins, seals, and minority ethnic crafts. It has a complete collection system and is particularly famous for its collection of bronzes and ancient calligraphy and paintings. The museum has long been open to the public free of charge, serving as an important window for understanding traditional Chinese art and one of Shanghai's key cultural landmarks.
In December 2025, the Shanghai Museum, in cooperation with ShanghaiTech University, launched the nation's first purely AI-driven museum sign language service station and AI sign language tour guide, using technology to break the barrier of "sound" and target services for the hearing-impaired community, so that cultural relics can not only be "seen" but also "understood," allowing all people to better feel the charm of ancient Chinese art and enjoy the museum's high-quality cultural resources.
Accessible Interaction
When hearing-impaired visitors stand in front of the AI sign language service station, they only need to simply stretch out their hands, and within 3 seconds, they can establish a "dialogue" with the digital human on the screen — without complex operations or learning fixed question templates.
"Which floor is the sculpture gallery on?" "Where is the restroom?" "Does the museum have a restaurant?"... Whether visitors ask about tour routes, service facilities, or reservation information, the digital human always "hears" the questions and "speaks" the answers with natural and fluent sign language. The end-to-end response speed is under 1 second, and the question matching success rate exceeds 90%. Even if the sign language expression is non-standard or contains regional characteristics, the system can accurately "guess" the intention based on the context and provide precise guidance.
AI Sign Language Guide
Full-Scenario Coverage, Zero-Latency Interaction
Supports real-time translation of voice explanations throughout the exhibition, covering exhibit introductions, event guidance, and interactive Q&A scenarios. The response time is under 0.3 seconds, ensuring "zero-lag" information transmission.
Multimodal interaction design: Visitors can interact with the digital human via gestures, voice, or touch screens, with the system automatically adapting to the best communication method.
High-Precision Sign Language Recognition and Generation
Relying on DGene's self-developed 3D gesture capture algorithms and multilingual fusion models, the system can accurately recognize over 5,000 sign language vocabulary words and generate fluent expressions that conform to Chinese Sign Language grammar based on context.
Pioneering "Emotional Expression" feature: The digital human can convey emotions through micro-expressions and body language, making communication warmer.
Cultural Empowerment, Tech for Good
The service station simultaneously launches an AI sign language teaching module, allowing visitors to learn basic sign language vocabulary and experience the joy of barrier-free communication. Future plans include integration with AR navigation to achieve deep interaction through "gesture-to-click exhibits + 3D animation analysis."
Test
Test and communicate with at least 2 hearing-impaired friends every week to understand their daily usage habits, and customize interactive experiences that meet their needs.
Related Reports
AI sign language exhibition-viewing "buddy" is in place! Come to the Shanghai Museum East to experience the brand-new barrier-free services
https://mp.weixin.qq.com/s/7tYniP9Jp7Rn9zdaeY7lwg