Video link: https://youtu.be/UkOsPaxf5mw


Text: The Smart Media XR Pilot used the Next Generation Meta Operating System  (Nemo Meta OS) framework to enhance the boundaries of user involvement in XR systems and applications for the public in the context of Historical and Educational applications.

During the pilots two XR experiences were enhanced using cloud computing resources and AI/ML processing. The whole IoT-Edged-Far Edge-Cloud pipeline available from NEMO was used in order to integrate it into two VR systems and presentations.
The pilots took place on the 24/6/2025 at the Hellenic Cosmos Cultural Center.

The firt VR application that was enhanced was the Head Mounted Display VR experience of a visit at the Ancient Workshop of the Sculpturer Phidias. For this the biodata of the user was captured using an Smart Watch IoT device in order to have the application and the museum staff respond to any discomfort and nausea of the user. As it is widely known the usage of head Mounted Display can cause nausea and discomfort , which are very difficult to spot by external observation. Therefore the cloud computations, ML models and resource components of NEMO were used to analyze in realtime the biodata of the user and understand his status.

The second VR application that was enhanced, was a large scale VR Theatre Dome show. The Hellenic Cosmos is one of the few Museums worldwide that features realtime Dome shows with real navigation and presentation form a person. During the trial Nemo resources and ML models were used to capture onsite images of the Museumeducator that drive the experience and understand his gestures and need in navigation and external communication. During the pilot the museumeducator could pilot the VR show just using gestures and signal information to the museum reception about the status of the show all while he was presenting live in from of the audience.

The completion of these trials complete the use case analysis of Trial 5.5 as part of the NEMO project. The NEMO project has the priviledge to be the only project to host use cases targeting Culture and Media among all the EU funded projects.