Creating 3D models from videos: is it worth your time?
Videogrammetry is a measurement technology that gathers 3D information from video footage to create a 3D mesh. Like photogrammetry, 3D models from video may seem enticing, so we’ll discuss two major differences between using still images verse video.
Overcoming the challenge of generating 3D models from videos.
1. Resolution.
Resolution is crucial to getting the best results while 3D scanning. Resolution is all about how much detail is contained within a space and will influence how well your 3D scan turns out in the end. Lower resolution and any artifacts that can occur in an image is going to be a major hindrance during the capture process. Remember, if your image has more details, your 3D object will, too.
While there are 8k cameras on the market, they are extremely expensive. In the end, it makes little sense to use an expensive, high-end video camera to increase resolution, when still images could be used instead. In every category, photographs are going to produce cleaner, higher resolution images for cheaper, too.
2. Motion blur.
The next major challenge you’ll face using video to create 3D models is motion blur. Blur only occurs in still images that were shot with a low shutter speed from a moving or hand-held camera. When it comes to 3D capture, this shouldn’t be an issue. By using a tripod, clean images without blur can be taken from every angle of the object you need.
For video, on the other hand, the trouble of motion blur isn’t solved as easily. The best way to combat motion blur in video is to shoot with faster shutter speeds. Shooting higher frames per second is doable enough, however, keep in mind that a faster shutter speed also means less light can reach the camera’s sensors. To compensate for this, you’ll want to be in a controlled lighting environment for best results. Adding too much light can introduce shadows and highlights that will also negatively affect your final scanned object.
Image by Andrew Palmer.
The benefit of videogrammetry: ease of use.
We’ve discussed two major reasons why you should use still images over video, so let’s talk about where video fits in this space and why you might consider using it.
It can be time consuming to take the dozens of individual images needed for a successful 3D scan. There are several solutions, usually smartphone apps, which offer video to 3D options because of the ease of use of video. Recording an object is much faster than taking picture after picture.
If you’re looking for a quick answer and have access to a smartphone, then creating 3D models from video with an app might be the simplest solution for you. That said, you’ll always find better results using still images with high resolutions. It’s important to remember that these apps are using individual frames from your video, which are still images anyway. Every artist making models from video should ask themselves if the time saved outweighs the improvement in quality you’ll get by just taking still images yourself with a tripod and camera.
Images by Andrew Palmer.
Hardware requirements.
If you’re using a phone, for the best results, you’ll want to use a smartphone with LiDAR sensors such as the iPhone 12 and 13 Pro.
As a part of Adobe Substance 3D, we offer Substance 3D Sampler, a powerful and easy to use 3D capture software for creating 3D objects from photos. It takes a lot of processing power to accurately photo or video scan an object. For Sampler in 2023, we recommend an Intel i7 or AMD Ryzen 7 CPU or equivalent. Users will also want a powerful GPU such as one at the 30-level series or higher. For RAM 32GB is good, though for many projects, 64 is optimal.
For a full guide on Sampler’s hardware requirements and recommendations, review our documentation.
Capture captivating 3D assets with Adobe.
Substance 3D Sampler is a great way to get started with photogrammetry. While we don’t support video to 3D object solutions, our AI-powered technology makes the process simple. If you can take clean pictures with good lighting, Sampler will manage the rest.
Using the same masking technology in Photoshop, Sampler will automatically mask your images so only the main subject is recreated. After you’re satisfied with the masking, Sampler will process the images, create a point cloud, and produce a 3D mesh with textures.
Sampler allows you to mix and blend materials to quickly make amazing adjustments to the model’s appearances.
Explore 3D capture with Substance 3D Sampler.
Frequently Asked Questions
WHAT IS THE DIFFERENCE BETWEEN PHOTO AND VIDEOGRAMMETRY?
DOES SUBSTANCE 3D SAMPLER USE VIDEO TO MAKE 3D MODELS?
WHEN IS 3D CAPTURE A GOOD IDEA IN 3D?
