Sony has announced the development of a new spatial content creation system. This system includes an XR head-mounted display, featuring 4K OLED Microdisplays, and a pair of controllers designed for interacting with 3D objects and precise pointing. The system is aimed at aiding creators in the production of sophisticated 3D content.
In collaboration with various developers of 3D production software, Sony aims to support a range of applications in entertainment and industrial design. Initially, Sony is partnering with Siemens, an industrial technology company, to introduce solutions for immersive design and collaborative product engineering. This partnership will utilize software from Siemens’ Xcelerator open digital business platform.
The new system is scheduled to be available later in 2024, with further details on specifications, launch date, regions, pricing, sales channels, and software compatibility to be announced by Sony and its partners.
The system’s XR head-mounted display is equipped with 4K OLED Microdisplays and Sony’s proprietary rendering technology, allowing for real-time, high-definition, and realistic rendering of 3D object textures and human facial expressions. It includes video see-through functionality and spatial recognition, utilizing six cameras and sensors. The system also features a ring controller for intuitive object manipulation in virtual space and a pointing controller for precise pointing.
Creators can use the system to see and modify real-scale 3D models in an Extended Reality (XR) environment. The system supports remote, real-time review between locations and integrates with third-party 3D creation applications.
The device is powered by Qualcomm Technologies, Inc.’s Snapdragon XR2+ Gen 2 Platform, which enhances the image quality and user and space tracking capabilities for XR experiences.
Sony has also developed other technologies to support spatial content creation, including the “mocopi™” mobile motion capture system and Spatial Reality Displays. These technologies are intended to facilitate the use of 3D computer graphics in various creative fields.
Cedrik Neike, a member of the Managing Board of Siemens AG and CEO of Siemens Digital Industries, commented on the partnership with Sony, highlighting the potential for immersive engineering and its significance for the industrial metaverse.
Said Bakadir, Senior Director of Product Management at Qualcomm Technologies, Inc., spoke about the Snapdragon XR2+ Gen 2’s capabilities in enabling innovative spatial content creation.
The head-mounted display of the system features 4K resolution, a wide color gamut, and supports split rendering, distributing the rendering load for stable and high-definition rendering of large-size 3D models.
The system’s controllers are designed for intuitive and precise operation in spatial content creation. The head-mounted display has a comfort-focused design, with a flip-up mechanism allowing easy transition between physical and virtual spaces.
Sony’s partnership with Siemens at launch will focus on integrating the system with NX Immersive Designer software from the Siemens Xcelerator portfolio, aimed at enhancing design, review, and collaboration tools in the industrial design and product engineering field. A video demonstrating the spatial content creation experience enabled by this partnership is available online.
