Super-realistic 3D scans for AR/VR using a smartphone camera with flash

0

Since the introduction of 3D capture technology, a scan’s fidelity to the real world has been judged primarily the metric of accuracy. With the rise of AR/VR applications, however, other metrics are becoming increasingly important. Is the scan’s texture photorealistic? Does it react to light sources like a real object would in its place?

A recent conference paper presented at SIGGRAPH Asia demonstrates a method that captures accurate geometry, photorealistic detail, and even reflectance, using nothing more than a single camera with a flash—like the one you have in your smartphone.

Min H. Kim, lead author of a conference paper presented at SIGGRAPH Asia earlier this month explains that ”traditionally, this has been either done manually by 3D artists, which is a labor-intensive task, or by using specialized, expensive hardware. Our method is straightforward, cheaper and efficient, and reproduces realistic 3D objects by just taking photos from a single camera with a built-in flash.”

Many existing methods for mobile 3D capture of this type run into familiar problems. Some require existing geometry data as a basis, complicating the process of capture significantly, and others are only capable of capturing reflectance for planar objects. Multi-view stereo approaches tend to assume diffuse reflectance, which leads to smoothed out models. Often the only reliable approach is to use a professional capture system, which often costs $200,000 or more.

If you’re into optical engineering, I recommend digging into the paper here. If you’re not, the results below—captured with a single smartphone—speak for themselves.

Share.

About Author

Avatar

Sean Higgins is the former Managing Editor of SPAR3D.com and the SPAR 3D weekly newsletter, which continues to highlight relevant news and information for 3D-scanning professionals. Sean continues to work in the industry, and may sometimes be spotted in attendance at SPAR 3D Expo & Conference. Follow @spar_editor to connect with and learn more about the current voice of SPAR3D.com

Leave A Reply

© Diversified Communications. All rights reserved.