Matterport AR mashups: Microsoft Hololens, Google ARCore, and more

2

Since buying their first Matterport device in 2015, Tosolini Productions has used them to explore the possibilities of virtual tours beyond residential real estate. That means taking the Matterport OBJ and combining them with new technologies–what Tosolini calls “mashups”–to see how far those OBJ files can stretch, and what creative ends they can be used for.

Founder Paolo Tosolini sent me a handful of these experiments (complete with videos) about a year ago, all of which you can view here. He’s starting the year another bunch that sees Tosolini Productions mashing up Matterport files with Unity and marquee AR and VR tech from giants like Microsoft and Google. Check out the videos below to see what’s possible when you’re willing to get creative:

ARCore + Matterport augmented reality illusion

This is an augmented reality illusion leveraging ARCore and a Matterport model. ARCore is Google’s mobile platform for augmented reality content, focused on attaching virtual objects to real world spaces. Here, we utilize ARCore’s newly released Augmented Images capability and Unity 3D to track a portal setup to an image on a laptop screen. The image on the screen (planet Earth, in this case) is used to activate and keep the model aligned as the phone moves freely within the space. The portal’s selective rendering helps create a sense of depth, forming the illusion of a box that recedes into the computer screen. This experiment runs on an Android device.

Matterport and Hololens

  • Client: Microsoft
  • Challenge: Using Hololens, visualize 3D views of meeting spaces at several Microsoft locations
  • Solution: A mixed-reality app that loads inidividual dollhouse views on top of the floor plans of each location

Slicing a Matterport 3D model in VR

Come explore this award winning Matterport scan of the Schooner Zodiac Sailing Vessel in VR. It can be challenging to provide users with both inside and outside views of a 3D scan, so we have envisioned a few slicer effects to help. Whether it’s by splitting into chunks or creating a cross-section with shaders, come see how VR can transform a static model into a dynamic experience.

Original 3D virtual tour: https://my.matterport.com/show/?m=ffvGojLDiyv This model has won the 2018 Matty Award as the best transportation space 3D scanned using Matterport technology.

MatterPortal: a journey through Matterport models and VR portals

What if the screens around you were portals into another space? Follow us in this exploration of ten real-world spaces in VR. Each location, from Miramare Castle in Italy to the historic 1924 Schooner Zodiac vessel, has been scanned using Matterport technology and connected with portals in Unity 3D.

The augmented reality business cube

In this exploration, we re-imagine the classic card as an augmented reality cube. Envision a new way to communicate your business with impact and memorability. The Unity 3D prototype runs on modern Android phones, with augmented elements tracking to a physical Merge Cube object (https://shop.mergevr.com/).

Matterport + Augmented Reality portal effect using Torch AR app

This AR portal effect has been created entirely on an iPad device without writing any code. We used the Torch AR app to position the original Matterport 3D model previously uploaded onto SketchFab. We then resized it close to real scale and walked inside.

Matterport + Vuforia Augmented Reality Tutorial

Learn how to create an Augmented Reality experience using a Matterport 3D dollhouse model attached to a tracker (e.g. your business card). This tutorial will walk you through the steps of importing a Matterport OBJ model into Unity 3D and configuring Vuforia to create a simple AR app for Android.

Share.

About Author

Sean Higgins is the former Managing Editor of SPAR3D.com and the SPAR 3D weekly newsletter, which continues to highlight relevant news and information for 3D-scanning professionals. Sean continues to work in the industry, and may sometimes be spotted in attendance at SPAR 3D Expo & Conference. Follow @spar_editor to connect with and learn more about the current voice of SPAR3D.com

2 Comments

    • Bravo Paolo! Incredible work! But why did you choose Matterport for your models? From direct interviews with their unfriendly and unhelpful leadership it seemed clear early last year that no investment was going on moving forward in their platform and all of us who have worked with it know it is at a hard edge right now… Do you know something we don’t? Is there chance some of last years investment will go towards something that can truly be integrated at scale? Please share!

Leave A Reply

© Diversified Communications. All rights reserved.