3D Image Reconstruction and Analysis for Micro-manipulation Systems

 

- 指導教授 黃漢邦 博士 研究生 蕭富仁

- Advisor :Dr.Han-Pang Huang Student :蕭富仁

Lab. of Robotics., Department of Mechanical Engineering National Taiwan University Taiwan

Abstract:  

In this thesis, a binocular stereo vision system is constructed for 3D image reconstruction. We propose a new method called support value to solve correspondence problems. Geometric constraints are added to reduce the ambiguities in stereo matching. Left/right consistency check is used to increase the confidence for matching results. Post-processing helps remove the outliers and make original dense disparity map smooth and reliable. The three-dimensional characteristics can be reconstructed by perspective projection.  

        The 3D image reconstruction algorithm is successfully applied to a micro manipulation system for cell image reconstruction. Cell images need to be segmented first to do stereo matching tasks. An automatic threshold selection and boundary extraction algorithm are used to detect positions and contours of cells. By combining image segmentation techniques and stereo matching procedure, 3D reconstruction of microscopic cell images can be performed. The 3D fine structures of cells can also be recovered. The 3D-display monitoring system will provide multi-functionalities visual effect to facilitate the manipulation process.




中文摘要:   

本文的主要目的為發展適用於雙目立體視覺系統的三維影像重建理論,並將其應用到微操作系統。我們提出一個新的方法來解決立體比對中最困難的對應點問題,並加入一些幾何的限制來減少模稜兩可的對應。經過雙向驗證的對應點匹配更能確保在估測視差時的正確性。將稠密的視差圖經過後處理使其更為平滑可靠,再利用透視投射法使之回復三維景物的特徵。

        此三維影像重建的理論已成功地應用到操控生物細胞的微操作系統上。所提出的影像切割方法可有效分離細胞本體和背景。結合自動選取閥值的二值化方法和邊界追蹤的方法可以偵測出細胞的位置和輪廓。結合影像切割和立體比對的技巧,我們可以重建出顯微細胞的三維影像。最後,利用虛擬實境技術建構的監視系統將會提供使用者在操作過程中不同的視覺效果並用來顯示重建後的結果。