Dense versus Sparse Approaches for Estimating the Fundamental Matrix

Springer Science and Business Media LLC - Tập 96 Số 2 - Trang 212-234 - 2012
Valgaerts, Levi1, Bruhn, Andrés1, Mainberger, Markus2, Weickert, Joachim2
1Vision and Image Processing Group, MMCI Cluster of Excellence, Campus E1.1, Saarland University, Saarbrücken, Germany
2Mathematical Image Analysis Group, Faculty of Mathematics and Computer Science, Campus E1.1, Saarland University, Saarbrücken, Germany

Tóm tắt

There are two main strategies for solving correspondence problems in computer vision: sparse local feature based approaches and dense global energy based methods. While sparse feature based methods are often used for estimating the fundamental matrix by matching a small set of sophistically optimised interest points, dense energy based methods mark the state of the art in optical flow computation. The goal of our paper is to show that this separation into different application domains is unnecessary and can be bridged in a natural way. As a first contribution we present a new application of dense optical flow for estimating the fundamental matrix. Comparing our results with those obtained by feature based techniques we identify cases in which dense methods have advantages over sparse approaches. Motivated by these promising results we propose, as a second contribution, a new variational model that recovers the fundamental matrix and the optical flow simultaneously as the minimisers of a single energy functional. In experiments we show that our coupled approach is able to further improve the estimates of both the fundamental matrix and the optical flow. Our results prove that dense variational methods can be a serious alternative even in classical application domains of sparse feature based approaches.

Tài liệu tham khảo

citation_title=A PDE model for computing the optical flow; citation_inbook_title=Proc. XVI congreso de ecuaciones diferenciales y aplicaciones; citation_publication_date=1999; citation_pages=1349-1356; citation_id=CR1; citation_author=L. Alvarez; citation_author=J. Esclarín; citation_author=M. Lefébure; citation_author=J. Sánchez citation_title=Symmetrical dense optical flow estimation with occlusions detection; citation_inbook_title=Computer vision—ECCV 2002; citation_publication_date=2002; citation_pages=721-736; citation_id=CR2; citation_author=L. Alvarez; citation_author=R. Deriche; citation_author=T. Papadopoulo; citation_author=J. Sánchez; citation_publisher=Springer citation_journal_title=Journal of Visual Communication and Image Representation; citation_title=Dense disparity map estimation respecting image derivatives: a PDE and scale-space based approach; citation_author=L. Alvarez, R. Deriche, J. Sánchez, J. Weickert; citation_volume=13; citation_issue=1/2; citation_publication_date=2002; citation_pages=3-21; citation_doi=10.1006/jvci.2001.0482; citation_id=CR3 citation_journal_title=Pattern Recognition; citation_title=Coarse to over-fine optical flow estimation; citation_author=T. Amiaz, E. Lubetzky, N. Kiryati; citation_volume=40; citation_issue=9; citation_publication_date=2007; citation_pages=2496-2503; citation_doi=10.1016/j.patcog.2006.09.011; citation_id=CR4 citation_title=A database and evaluation methodology for optical flow; citation_inbook_title=Proc. 2007 IEEE international conference on computer vision; citation_publication_date=2007; citation_id=CR5; citation_author=S. Baker; citation_author=S. Roth; citation_author=D. Scharstein; citation_author=M. J. Black; citation_author=J. P. Lewis; citation_author=R. Szeliski; citation_publisher=IEEE Computer Society Press Baker, S., Scharstein, D., Lewis, J. P., Roth, S., Black, M. J., & Szeliski, R. (2009). A database and evaluation methodology for optical flow (Tech. Rep. MSR-TR-2009-179). Redmond: Microsoft Research, WA. citation_journal_title=International Journal of Computer Vision; citation_title=Performance of optical flow techniques; citation_author=J. L. Barron, D. J. Fleet, S. S. Beauchemin; citation_volume=12; citation_issue=1; citation_publication_date=1994; citation_pages=43-77; citation_doi=10.1007/BF01420984; citation_id=CR7 citation_journal_title=Computer Vision and Image Understanding; citation_title=Speeded-up robust features (SURF); citation_author=H. Bay, A. Ess, T. Tuytelaars, L. J. Gool; citation_volume=110; citation_issue=3; citation_publication_date=2008; citation_pages=346-359; citation_doi=10.1016/j.cviu.2007.09.014; citation_id=CR8 citation_title=Variational stereo vision with sharp discontinuities and occlusion handling; citation_inbook_title=Proc. eleventh international conference on computer vision; citation_publication_date=2007; citation_id=CR9; citation_author=R. Ben-Ari; citation_author=N. Sochen; citation_publisher=IEEE Computer Society Press Bitton, D., Rosman, G., Nir, T., Bruckstein, A. M., Feuer, A., & Kimmel, R. (2009). Over-parameterized optical flow using a stereoscopic constraint (Tech. Rep. CIS-2009-18). Computer Science Department, Technion–Israel Institute of Technology, Israel. citation_title=Robust dynamic motion estimation over time; citation_inbook_title=Proc. 1991 IEEE conference on computer vision and pattern recognition; citation_publication_date=1991; citation_pages=292-302; citation_id=CR11; citation_author=M. J. Black; citation_author=P. Anandan; citation_publisher=IEEE Computer Society Press citation_journal_title=Journal of the Optical Society of America A; citation_title=Determining the ego-motion of an uncalibrated camera from instantaneous optical flow; citation_author=M. J. Brooks, W. Chojnacki, L. Baumela; citation_volume=14; citation_publication_date=1997; citation_pages=2670-2677; citation_doi=10.1364/JOSAA.14.002670; citation_id=CR12 citation_title=High accuracy optic flow estimation based on a theory for warping; citation_inbook_title=Computer Vision—ECCV 2004; citation_publication_date=2004; citation_pages=25-36; citation_id=CR13; citation_author=T. Brox; citation_author=A. Bruhn; citation_author=N. Papenberg; citation_author=J. Weickert; citation_publisher=Springer citation_title=Large displacement optical flow; citation_inbook_title=Proc. 2009 IEEE computer society conference on computer vision and pattern recognition; citation_publication_date=2009; citation_pages=41-48; citation_id=CR14; citation_author=T. Brox; citation_author=C. Bregler; citation_author=J. Malik; citation_publisher=IEEE Computer Society Press citation_journal_title=International Journal of Computer Vision; citation_title=Lucas/Kanade meets Horn/Schunck: Combining local and global optic flow methods; citation_author=A. Bruhn, J. Weickert, C. Schnörr; citation_volume=61; citation_issue=3; citation_publication_date=2005; citation_pages=211-231; citation_doi=10.1023/B:VISI.0000045324.43199.43; citation_id=CR15 citation_journal_title=International Journal of Computer Vision; citation_title=A multigrid platform for real-time motion computation with discontinuity-preserving variational methods; citation_author=A. Bruhn, J. Weickert, T. Kohlberger, C. Schnörr; citation_volume=70; citation_issue=3; citation_publication_date=2006; citation_pages=257-277; citation_doi=10.1007/s11263-006-6616-7; citation_id=CR16 citation_journal_title=IEEE Transactions on Pattern Analysis and Machine Intelligence; citation_title=A computational approach to edge detection; citation_author=J. Canny; citation_volume=8; citation_publication_date=1986; citation_pages=679-698; citation_doi=10.1109/TPAMI.1986.4767851; citation_id=CR17 citation_journal_title=IEEE Transactions on Image Processing; citation_title=Active contours without edges; citation_author=T. F. Chan, L. A. Vese; citation_volume=10; citation_issue=2; citation_publication_date=2001; citation_pages=266-277; citation_doi=10.1109/83.902291; citation_id=CR18 citation_title=Enhancing RANSAC by generalized model optimization; citation_inbook_title=Proc. sixth Asian conference on computer vision; citation_publication_date=2004; citation_pages=812-817; citation_id=CR19; citation_author=O. Chum; citation_author=J. Matas; citation_author=S. Obdrzalek citation_title=Two-view geometry estimation unaffected by a dominant plane; citation_inbook_title=Proc. 2005 IEEE computer society conference on computer vision and pattern recognition; citation_publication_date=2005; citation_pages=772-779; citation_id=CR20; citation_author=O. Chum; citation_author=T. Werner; citation_author=J. Matas; citation_publisher=IEEE Computer Society Press citation_title=What can be seen in three dimensions with an uncalibrated stereo rig; citation_inbook_title=Computer vision—ECCV 1992; citation_publication_date=1992; citation_pages=563-578; citation_id=CR21; citation_author=O. Faugeras; citation_publisher=Springer citation_title=The geometry of multiple images; citation_publication_date=2001; citation_id=CR22; citation_author=O. Faugeras; citation_author=Q. T. Luong; citation_author=T. Papadopoulo; citation_publisher=MIT Press citation_journal_title=Communications of the ACM; citation_title=Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography; citation_author=M. Fischler, R. Bolles; citation_volume=24; citation_publication_date=1981; citation_pages=381-385; citation_doi=10.1145/358669.358692; citation_id=CR23 citation_title=Simultaneous linear estimation of multiple view geometry and lens distortion; citation_inbook_title=Proc. 2001 IEEE computer society conference on computer vision and pattern recognition; citation_publication_date=2001; citation_pages=125-132; citation_id=CR24; citation_author=A. W. Fitzgibbon; citation_publisher=IEEE Computer Society Press citation_title=A fast operator for detection and precise location of distinct points, corners and centres of circular features; citation_inbook_title=Proc. ISPRS intercommission conference on fast processing of photogrammetric data; citation_publication_date=1987; citation_pages=281-305; citation_id=CR25; citation_author=W. Förstner; citation_author=E. Gülch citation_title=RANSAC for (quasi-) degenerate data (QDEGSAC); citation_inbook_title=Proc. 2006 IEEE computer society conference on computer vision and pattern recognition; citation_publication_date=2006; citation_pages=453-460; citation_id=CR26; citation_author=J. M. Frahm; citation_author=M. Pollefeys; citation_publisher=IEEE Computer Society Press citation_title=Matrix computations; citation_publication_date=1989; citation_id=CR27; citation_author=G. H. Golub; citation_author=C. M. Loan; citation_publisher=The John Hopkins University Press citation_title=A highly efficient GPU implementation for variational optic flow based on the Euler-Lagrange framework; citation_inbook_title=Proc. 2010 ECCV workshop on computer vision with GPUs; citation_publication_date=2010; citation_id=CR28; citation_author=P. Gwosdek; citation_author=H. Zimmer; citation_author=S. Grewenig; citation_author=A. Bruhn; citation_author=J. Weickert citation_title=Direct multi-resolution estimation of ego-motion and structure from motion; citation_inbook_title=Proc. workshop on visual motion; citation_publication_date=1991; citation_pages=156-162; citation_id=CR29; citation_author=K. J. Hanna; citation_publisher=IEEE Computer Society Press citation_title=A combined corner and edge detector; citation_inbook_title=Proc. fourth alvey vision conference; citation_publication_date=1988; citation_pages=147-152; citation_id=CR30; citation_author=C. G. Harris; citation_author=M. Stephens citation_journal_title=IEEE Transactions on Pattern Analysis and Machine Intelligence; citation_title=In defense of the eight-point algorithm; citation_author=R. Hartley; citation_volume=19; citation_issue=6; citation_publication_date=1997; citation_pages=580-593; citation_doi=10.1109/34.601246; citation_id=CR31 citation_title=Multiple view geometry in computer vision; citation_publication_date=2000; citation_id=CR32; citation_author=R. Hartley; citation_author=A. Zisserman; citation_publisher=Cambridge University Press citation_title=Stereo from uncalibrated cameras; citation_inbook_title=Proc. 1992 IEEE international conference on image processing; citation_publication_date=1992; citation_pages=761-764; citation_id=CR33; citation_author=R. Hartley; citation_author=R. Gupta; citation_author=T. Chang; citation_publisher=IEEE Computer Society Press citation_journal_title=Artificial Intelligence; citation_title=Determining optical flow; citation_author=B. Horn, B. Schunck; citation_volume=17; citation_publication_date=1981; citation_pages=185-203; citation_doi=10.1016/0004-3702(81)90024-2; citation_id=CR34 citation_title=Robust statistics; citation_publication_date=1981; citation_id=CR35; citation_author=P. J. Huber; citation_publisher=Wiley citation_journal_title=Journal of Electronic Imaging; citation_title=Fundamental matrix from optical flow: optimal computation and reliability evaluation; citation_author=K. Kanatani, Y. Shimizu, N. Ohta, M. J. Brooks, W. Chojnacki, A. Hengel; citation_volume=9; citation_publication_date=2000; citation_pages=194-202; citation_doi=10.1117/1.482739; citation_id=CR36 citation_journal_title=Image and Vision Computing; citation_title=Robust motion estimation under varying illumination; citation_author=Y. H. Kim, A. M. Martinez, A. C. Kak; citation_volume=23; citation_issue=4; citation_publication_date=2005; citation_pages=365-375; citation_doi=10.1016/j.imavis.2004.05.010; citation_id=CR37 citation_title=Segment-based stereo matching using belief propagation and a self-adapting dissimilarity measure; citation_inbook_title=Proc. 18th international conference on pattern recognition, Part III; citation_publication_date=2006; citation_pages=15-18; citation_id=CR38; citation_author=A. Klaus; citation_author=M. Sormann; citation_author=K. Karner citation_title=Multi-camera scene reconstruction via graph cuts; citation_inbook_title=Computer vision—ECCV 2002, Part III; citation_publication_date=2002; citation_pages=82-96; citation_id=CR39; citation_author=V. Kolmogorov; citation_author=R. Zabih; citation_publisher=Springer citation_title=Region-tree based stereo using dynamic programming optimization; citation_inbook_title=Proc. 2006 IEEE computer society conference on computer vision and pattern recognition; citation_publication_date=2006; citation_pages=2378-2385; citation_id=CR40; citation_author=C. Lei; citation_author=J. Selzer; citation_author=Y. H. Yang; citation_publisher=IEEE Computer Society Press citation_journal_title=Quarterly of Applied Mathematics; citation_title=A method for the solution of certain non-linear problems in least squares; citation_author=K. Levenberg; citation_volume=2; citation_publication_date=1944; citation_pages=164-168; citation_id=CR41 citation_journal_title=Nature; citation_title=A computer algorithm for reconstructing a scene from two projections; citation_author=H. C. Longuet-Higgins; citation_volume=293; citation_publication_date=1981; citation_pages=133-135; citation_doi=10.1038/293133a0; citation_id=CR42 citation_journal_title=International Journal of Computer Vision; citation_title=Distinctive image features from scale-invariant keypoints; citation_author=D. G. Lowe; citation_volume=60; citation_issue=2; citation_publication_date=2004; citation_pages=91-110; citation_doi=10.1023/B:VISI.0000029664.99615.94; citation_id=CR43 citation_title=An iterative image registration technique with an application to stereo vision; citation_inbook_title=Proc. seventh international joint conference on artificial intelligence; citation_publication_date=1981; citation_pages=674-679; citation_id=CR44; citation_author=B. Lucas; citation_author=T. Kanade citation_journal_title=International Journal of Computer Vision; citation_title=The fundamental matrix: theory, algorithms, and stability analysis; citation_author=Q. T. Luong, O. D. Faugeras; citation_volume=17; citation_issue=1; citation_publication_date=1996; citation_pages=43-75; citation_doi=10.1007/BF00127818; citation_id=CR45 citation_title=Is dense optical flow useful to compute the fundamental matrix; citation_inbook_title=Image analysis and recognition; citation_publication_date=2008; citation_pages=630-639; citation_id=CR46; citation_author=M. Mainberger; citation_author=A. Bruhn; citation_author=J. Weickert; citation_publisher=Springer citation_journal_title=SIAM Journal on Applied Mathematics; citation_title=An algorithm for least-squares estimation of nonlinear parameters; citation_author=D. Marquardt; citation_volume=11; citation_publication_date=1963; citation_pages=431-441; citation_doi=10.1137/0111030; citation_id=CR47 citation_journal_title=Proceedings of the Royal Society of London, Series B; citation_title=Theory of edge detection; citation_author=D. Marr, E. Hildreth; citation_volume=207; citation_publication_date=1980; citation_pages=187-217; citation_doi=10.1098/rspb.1980.0020; citation_id=CR48 citation_journal_title=IEEE Transactions on Image Processing; citation_title=Dense estimation and object-based segmentation of the optical flow with robust techniques; citation_author=E. Mémin, P. Pérez; citation_volume=7; citation_issue=5; citation_publication_date=1998; citation_pages=703-719; citation_doi=10.1109/83.668027; citation_id=CR49 citation_journal_title=International Journal of Computer Vision; citation_title=Hierarchical estimation and segmentation of dense motion fields; citation_author=E. Mémin, P. Pérez; citation_volume=46; citation_issue=2; citation_publication_date=2002; citation_pages=129-155; citation_doi=10.1023/A:1013539930159; citation_id=CR50 citation_journal_title=IEEE Transactions on Pattern Analysis and Machine Intelligence; citation_title=A performance evaluation of local descriptors; citation_author=K. Mikolajczyk, C. Schmid; citation_volume=27; citation_issue=10; citation_publication_date=2005; citation_pages=1615-1630; citation_doi=10.1109/TPAMI.2005.188; citation_id=CR51 citation_title=Illumination-robust variational optical flow with photometric invariants; citation_inbook_title=Pattern recognition; citation_publication_date=2007; citation_pages=152-162; citation_id=CR52; citation_author=Y. Mileva; citation_author=A. Bruhn; citation_author=J. Weickert; citation_publisher=Springer citation_journal_title=IEEE Transactions on Pattern Analysis and Machine Intelligence; citation_title=An investigation of smoothness constraints for the estimation of displacement vector fields from image sequences; citation_author=H. H. Nagel, W. Enkelmann; citation_volume=8; citation_publication_date=1986; citation_pages=565-593; citation_doi=10.1109/TPAMI.1986.4767833; citation_id=CR53 citation_journal_title=International Journal of Computer Vision; citation_title=Over-parameterized variational optical flow; citation_author=T. Nir, A. M. Bruckstein, R. Kimmel; citation_volume=76; citation_issue=2; citation_publication_date=2008; citation_pages=205-216; citation_doi=10.1007/s11263-007-0051-2; citation_id=CR54 citation_journal_title=IEICE Transactions on Information and Systems; citation_title=Optimal structure from motion algorithm for optical flow; citation_author=N. Ohta, K. Kanatani; citation_volume=E78-D; citation_issue=12; citation_publication_date=1995; citation_pages=1559-1566; citation_id=CR55 citation_title=Determination of optical flow and its discontinuities using non-linear diffusion; citation_inbook_title=Computer vision—ECCV ’94; citation_publication_date=1994; citation_pages=295-304; citation_id=CR56; citation_author=M. Proesmans; citation_author=L. Gool; citation_author=E. Pauwels; citation_author=A. Oosterlinck; citation_publisher=Springer citation_title=A comparative analysis of RANSAC techniques leading to adaptive real-time random sample consensus; citation_inbook_title=Computer vision—ECCV 2008, Part II; citation_publication_date=2008; citation_pages=500-513; citation_id=CR57; citation_author=R. Raguram; citation_author=J. M. Frahm; citation_author=M. Pollefeys; citation_publisher=Springer citation_title=On the spatial statistices of optical flow; citation_inbook_title=Proc. tenth international conference on computer vision; citation_publication_date=2005; citation_pages=42-49; citation_id=CR58; citation_author=S. Roth; citation_author=M. Black; citation_publisher=IEEE Computer Society Press citation_title=Robust regression and outlier detection; citation_publication_date=1987; citation_id=CR59; citation_author=P. J. Rousseeuw; citation_author=A. M. Leroy; citation_publisher=Wiley citation_title=Monocular and stereo methods for AAM learning from video; citation_inbook_title=Proc. 2007 IEEE computer society conference on computer vision and pattern recognition; citation_publication_date=2007; citation_id=CR60; citation_author=J. Saragih; citation_author=R. Goecke; citation_publisher=IEEE Computer Society Press citation_journal_title=International Journal of Computer Vision; citation_title=A taxonomy and evaluation of dense two-frame stereo correspondence algorithms; citation_author=D. Scharstein, R. Szeliski; citation_volume=47; citation_issue=1–3; citation_publication_date=2002; citation_pages=7-42; citation_doi=10.1023/A:1014573219977; citation_id=CR61 citation_title=A higher order MRF-model for stereo-reconstruction; citation_inbook_title=Pattern recognition; citation_publication_date=2004; citation_pages=440-446; citation_id=CR62; citation_author=D. Schlesinger; citation_author=B. Flach; citation_author=A. Shekhovtsov; citation_publisher=Springer citation_title=Segmentation of visual motion by minimizing convex non-quadratic functionals; citation_inbook_title=Proc. twelfth international conference on pattern recognition; citation_publication_date=1994; citation_pages=661-663; citation_id=CR63; citation_author=C. Schnörr; citation_publisher=IEEE Computer Society Press citation_title=A comparison and evaluation of multi-view stereo reconstruction algorithms; citation_inbook_title=Proc. 2006 IEEE conference on computer vision and pattern recognition; citation_publication_date=2006; citation_pages=519-528; citation_id=CR64; citation_author=S. Seitz; citation_author=B. Curless; citation_author=J. Diebel; citation_author=D. Scharstein; citation_author=R. Szeliski; citation_publisher=IEEE Computer Society Press citation_title=On the direct estimation of the fundamental matrix; citation_inbook_title=Proc. 2007 IEEE computer society conference on computer vision and pattern recognition; citation_publication_date=2007; citation_id=CR65; citation_author=Y. Sheikh; citation_author=A. Hakeem; citation_author=M. Shah; citation_publisher=IEEE Computer Society Press citation_title=Good features to track; citation_inbook_title=Proc. 1994 IEEE computer society conference on computer vision and pattern recognition; citation_publication_date=1994; citation_pages=593-600; citation_id=CR66; citation_author=J. Shi; citation_author=C. Tomasi; citation_publisher=IEEE Computer Society Press citation_title=Optic flow goes stereo: a variational approach for estimating discontinuity-preserving dense disparity maps; citation_inbook_title=Pattern recognition; citation_publication_date=2005; citation_pages=33-40; citation_id=CR67; citation_author=N. Slesareva; citation_author=A. Bruhn; citation_author=J. Weickert; citation_publisher=Springer citation_title=Advanced data terms for variational optic flow estimation; citation_inbook_title=Proceedings of the vision, modeling, and visualization workshop (VMV), DNB; citation_publication_date=2009; citation_pages=155-164; citation_id=CR68; citation_author=F. Steinbrücker; citation_author=T. Pock; citation_author=D. Cremers citation_title=Large displacement optical flow computation without warping; citation_inbook_title=Proc. twelfth international conference on computer vision; citation_publication_date=2009; citation_id=CR69; citation_author=F. Steinbrücker; citation_author=T. Pock; citation_author=D. Cremers; citation_publisher=IEEE Computer Society Press citation_journal_title=SIAM Review; citation_title=Robust parameter estimation in computer vision; citation_author=C. V. Stewart; citation_volume=41; citation_issue=3; citation_publication_date=1999; citation_pages=513-537; citation_doi=10.1137/S0036144598345802; citation_id=CR70 citation_title=Dense matching of multiple wide-baseline views; citation_inbook_title=Proc. ninth international conference on computer vision; citation_publication_date=2003; citation_pages=1194-1201; citation_id=CR71; citation_author=C. Strecha; citation_author=T. Tuytelaars; citation_author=L. Van Gool; citation_publisher=IEEE Computer Society Press citation_title=A probabilistic approach to large displacement optical flow and occlusion detection; citation_inbook_title=Statistical methods in video processing; citation_publication_date=2004; citation_pages=71-82; citation_id=CR72; citation_author=C. Strecha; citation_author=R. Fransens; citation_author=L. Gool; citation_publisher=Springer citation_title=On benchmarking camera calibration and multi-view stereo for high resolution imagery; citation_inbook_title=Proc. 2008 IEEE computer society conference on computer vision and pattern recognition; citation_publication_date=2008; citation_id=CR73; citation_author=C. Strecha; citation_author=W. Hansen; citation_author=L. J. Gool; citation_author=P. Fua; citation_author=U. Thoennessen; citation_publisher=IEEE Computer Society Press citation_title=Learning optical flow; citation_inbook_title=Computer vision—ECCV 2008, Part III; citation_publication_date=2008; citation_pages=83-97; citation_id=CR74; citation_author=D. Sun; citation_author=S. Roth; citation_author=J. P. Lewis; citation_author=M. J. Black; citation_publisher=Springer Tomasi, C., & Kanade, T. (1991). Detection and tracking of point features (Tech. Rep. CMU-CS-91-132). School of Computer Science, Carnegie Mellon University, Pittsburgh, PA. citation_journal_title=International Journal of Computer Vision; citation_title=The development and comparison of robust methods for estimating the fundamental matrix; citation_author=P. H. S. Torr, D. W. Murray; citation_volume=24; citation_issue=3; citation_publication_date=1997; citation_pages=271-300; citation_doi=10.1023/A:1007927408552; citation_id=CR76 citation_journal_title=IEEE Transactions on Pattern Analysis and Machine Intelligence; citation_title=Uniqueness and estimation of thee-dimensional motion parameters of rigid objects with curved surfaces; citation_author=R. Tsai, T. Huang; citation_volume=6; citation_issue=1; citation_publication_date=1984; citation_pages=13-26; citation_doi=10.1109/TPAMI.1984.4767471; citation_id=CR77 citation_title=A variational model for the joint recovery of the fundamental matrix and the optical flow; citation_inbook_title=Pattern recognition; citation_publication_date=2008; citation_pages=314-324; citation_id=CR78; citation_author=L. Valgaerts; citation_author=A. Bruhn; citation_author=J. Weickert; citation_publisher=Springer citation_title=Joint estimation of motion, structure and geometry from stereo sequences; citation_inbook_title=Computer vision—ECCV 2010; citation_publication_date=2010; citation_pages=568-581; citation_id=CR79; citation_author=L. Valgaerts; citation_author=A. Bruhn; citation_author=H. Zimmer; citation_author=J. Weickert; citation_author=C. Stoll; citation_author=C. Theobalt; citation_publisher=Springer citation_title=Motion analysis with a camera with unknown, and possibly varying intrinsic parameters; citation_inbook_title=Proc. fifth international conference on computer vision; citation_publication_date=1995; citation_pages=750-756; citation_id=CR80; citation_author=T. Viéville; citation_author=O. Faugeras; citation_publisher=IEEE Computer Society Press citation_title=A practical solution to corner detection; citation_inbook_title=Proc. 1994 IEEE international conference on image processing; citation_publication_date=1994; citation_pages=919-923; citation_id=CR81; citation_author=H. Wang; citation_author=M. Brady; citation_publisher=IEEE Computer Society Press citation_title=Duality TV-1 flow with fundamental matrix prior; citation_inbook_title=Proc. image and vision computing New Zealand; citation_publication_date=2008; citation_id=CR82; citation_author=A. Wedel; citation_author=T. Pock; citation_author=J. Braun; citation_author=U. Franke; citation_author=D. Cremers; citation_publisher=IEEE Computer Society Press citation_title=Structure- and motion-adaptive regularization for high accuracy optic flow; citation_inbook_title=Proc. twelfth international conference on computer vision; citation_publication_date=2009; citation_id=CR83; citation_author=A. Wedel; citation_author=D. Cremers; citation_author=T. Pock; citation_author=H. Bischof; citation_publisher=IEEE Computer Society Press citation_journal_title=International Journal of Computer Vision; citation_title=A theoretical framework for convex regularizers in PDE-based computation of image motion; citation_author=J. Weickert, C. Schnörr; citation_volume=45; citation_issue=3; citation_publication_date=2001; citation_pages=245-264; citation_doi=10.1023/A:1013614317973; citation_id=CR84 citation_journal_title=IEEE Transactions on Pattern Analysis and Machine Intelligence; citation_title=Motion and structure from two perspective views: algorithms, error analysis and error estimation; citation_author=J. Weng, T. Huang, N. Ahuja; citation_volume=11; citation_issue=5; citation_publication_date=1989; citation_pages=451-476; citation_doi=10.1109/34.24779; citation_id=CR85 citation_journal_title=IEEE Transactions on Pattern Analysis and Machine Intelligence; citation_title=Optimal motion and structure estimation; citation_author=J. Weng, N. Ahuja, T. Huang; citation_volume=15; citation_issue=9; citation_publication_date=1993; citation_pages=864-884; citation_doi=10.1109/34.232074; citation_id=CR86 citation_title=Motion estimation with non-local total variation regularization; citation_inbook_title=Proc. 2010 IEEE computer society conference on computer vision and pattern recognition; citation_publication_date=2010; citation_pages=2464-2471; citation_id=CR87; citation_author=M. Werlberger; citation_author=T. Pock; citation_author=H. Bischof; citation_publisher=IEEE Computer Society Press citation_title=A duality based approach for realtime TV- optical flow; citation_inbook_title=Pattern recognition; citation_publication_date=2007; citation_pages=214-223; citation_id=CR88; citation_author=C. Zach; citation_author=T. Pock; citation_author=H. Bischof; citation_publisher=Springer citation_title=A globally optimal algorithm for robust TV- range image integration; citation_inbook_title=Proc. ninth international conference on computer vision; citation_publication_date=2007; citation_id=CR89; citation_author=C. Zach; citation_author=T. Pock; citation_author=H. Bischof; citation_publisher=IEEE Computer Society Press citation_title=Estimation of location uncertainty for scale invariant feature points; citation_inbook_title=Proc. 2009 British machine vision conference; citation_publication_date=2009; citation_id=CR90; citation_author=B. Zeisl; citation_author=P. F. Georgel; citation_author=F. Schweiger; citation_author=E. Steinbach; citation_author=N. Navab citation_journal_title=International Journal of Computer Vision; citation_title=Determining the epipolar geometry and its uncertainty: a review; citation_author=Z. Zhang; citation_volume=27; citation_issue=2; citation_publication_date=1998; citation_pages=161-195; citation_doi=10.1023/A:1007941100561; citation_id=CR91 citation_title=Complementary optic flow; citation_inbook_title=Energy minimization methods in computer vision and pattern recognition—EMMCVPR; citation_publication_date=2009; citation_pages=207-220; citation_id=CR92; citation_author=H. Zimmer; citation_author=A. Bruhn; citation_author=J. Weickert; citation_author=L. Valgaerts; citation_author=A. Salgado; citation_author=B. Rosenhahn; citation_author=H. P. Seidel; citation_publisher=Springer citation_journal_title=International Journal of Computer Vision; citation_title=Optic flow in harmony; citation_author=H. Zimmer, A. Bruhn, J. Weickert; citation_volume=93; citation_issue=3; citation_publication_date=2011; citation_pages=638-388; citation_doi=10.1007/s11263-011-0422-6; citation_id=CR93