MPC Digital teamed up with The One Club via JWT New York to create Fracture.io, an installation experience for The One Show’s after-party at New York's Bowery Hotel.
The installation allowed guests to enter the digital space, taking 3D scans of pose-striking partygoers to generate abstracted, full-body 3D renderings, with technical production and management by Senovva.
The team at MPC Digital created a realtime 3D scanning and visualization system using little more than the off-the-shelf hardware in the Kinect from Microsoft. The installation comprised a 12'x16' room, built with SenovvA, with four Microsoft Kinects aimed at the center, where guests were invited to pose for the cameras. Using the OpenFrameworks application, MPC Digital was able to instantly capture full image and depth data. A custom modified version of PCL then stitched this data into a smooth mesh and calculated the normal, a scanning solution that allowed the team to dial exposure time up or down, more effectively balancing accuracy and speed.
Once the mesh was created, it could be used as the basis for generative 3D visualizations of guests’ forms. The mesh could then be imported into Unity, which wrapped the form in splines bearing custom 3D objects. All of this occurred nearly instantaneously, displayed on massive screens both within and outside of the booth. On these screens the camera panned over the guest’s form and surrounding environment, utilizing a custom dynamic rack focus system driven by the same sort of 3×3 matrix found in high-end autofocus cameras.
Animations and meshes were also exported and automatically assigned unique URLs on the Fracture.io website gallery, allowing guests to view and share their portraits.