基于纹理和轮廓信息的图像序列三维重建算法研究-控制科学与工程专业论文.docx

Classified Index: TP391.41 U.D.C: 004.92 Dissertation for the Master Degree of Engineering VOLUMETRIC STEREO AND SILHOUETTE FUSION FOR IMAGE-BASED MODELING Candidate: Peng Song Supervisor: Associate Prof. Xiaojun Wu Academic Degree Applied for: Master of Engineering Specialty: Control Science and Engineering Affiliation: Shenzhen Graduate School Date of Defence: December, 2009 Degree-Conferring-Institution: Harbin Institute of Technology I I 摘 要 高质量的三维物体模型在计算机图形学、医疗图像、三维动画和电子游戏等 领域有着广泛的应用。而根据标定的图像序列重建三维物体模型是一种有效且方便 的获取现实物体三维模型的方法。本文提出了一种基于图像序列中的纹理和轮廓信 息重建高质量三维物体模型的方法。 该算法首先根据图像轮廓计算被测物体的可见外壳，在这个过程中提出一种 有效的投影测试的方法来建立可见外壳的八叉树结构。然后，使用一种基于扩展的 方法根据图像中的纹理信息来计算每幅图像的深度图并将这些深度图融合得到一个 带有噪声和冗余信息的三维点云。通过对根据纹理匹配计算出的三维点云去除噪 声、减小点云大小以及估算法向量计算出一个位于物体表面的带有法向量的三维点 云。为了通过轮廓信息来重建物体上缺乏纹理或被遮挡的区域，使用根据纹理计算 出的点云来雕刻可见外壳的八叉树结构得到一个根据轮廓计算出的三维点云。最 后，将前面计算出的两个点云融合得到一个新的点云，使用泊松曲面重建的算法将 这个点云转化成一个封闭而精确的三角网格模型。实验结果表明文中算法可以快速 的计算出高质量的三维物体模型。使用本文的算法计算 Middlebury Benchmark 提 供的三组标准数据的结果表明文中算法在精度和速度上和目前最好的算法都很接 近。 关键字：图像序列；三维重建；三维点云；可见外壳 I II ABSTRACT At present the art of computing complex and high quality 3D models has large and wide applications in computer graphics, medical imaging, 3D animation, electronic games, etc. In practice, image-based modeling technique is an efficient and convenient method to acquire models of real word object. This dissertation presents a novel algorithm for acquiring high quality models from multiple calibrated photographs by stereo and silhouette fusion. The proposed algorithm starts by computing visual hull using a volumetric method in which a novel projection test method is proposed for visual hull octree construction. Then, the depth map of each image is estimated by an expansion-based approach that returns a 3D point cloud with noisy and redundant information. After generating an oriented point cloud from stereo by filtering to reject outlier and reduce scale, and estimating the surface normal for the depth maps, another oriented point cloud from silhouette is add