A system and method for generating 3D objects from 2D images of the object taken from multiple viewpoints, which is purely image based and avoids the complex calculations and camera calibrations required by other 3D reconstruction methods.
The ability to construct realistic 3D objects is an important aspect of rendering realistic scenes in computer vision research and applications. Thus, developing efficient algorithms for constructing 3D objects is an active area in computer vision research. Most 3D modeling algorithms use visual hull methods that estimate the silhouette or boundary of the object in 3D space and then intersect or fuse these views. While these algorithms are viable, they tend to be cumbersome since they involve the use of complex computations on 3D constructs and require challenging camera calibrations. They are therefore considered computationally expensive, requiring longer times and larger amounts of computing power during the rendering process. In addition, many of these estimation algorithms are sensitive to very small errors that may be introduced during calibration. In an attempt to reduce the possibility for error, other methods are used which bypass the estimation phase, such as photometric algorithms. However, since these methods still use 3D constructs, they too are computationally costly.
Technical Details
UCF scientists have developed a more computationally efficient algorithm that does not use 3D constructs. Instead, their algorithm constructs 3D objects from multiple views of 2D images in 3D space while still using the visual hull approach. By utilizing this technology a 3D rendering software or hardware provider could greatly reduce the computational requirements and sensitivity to error of their products, while eliminating the need for specially calibrated cameras.
Benefits
- Uses only minimal geometric information
- Does not require fully calibrated cameras
- Algorithm uses only 2D information, thus it is quick and can be implemented on Graphics Processing Units (GPU’s)
Applications
- This technology can be integrated into 3D rendering hardware and software to decrease their computational requirements. It can be used for the 3D reconstruction of objects in a scene, or for creating models of real objects or actors which can then be placed in a virtual world. This method can also be utilized to facilitate the automation of detecting and locating objects in multi-camera situations such as surveillance systems or sporting events. Another possible application of the technology is in marker less motion capturing, used in special effects for movies. Finally it can be used as an initialization step in more elaborate methods of 3D reconstruction like photometrics.
Brochure
