View Item 

Show simple item record

Automatic Extrinsic Calibration of Vision and Lidar by Maximizing Mutual Information

dc.contributor.authorPandey, Gauraven_US
dc.contributor.authorMcBride, James R.en_US
dc.contributor.authorSavarese, Silvioen_US
dc.contributor.authorEustice, Ryan M.en_US
dc.date.accessioned2015-08-05T16:47:00Z
dc.date.available2016-09-06T15:43:59Zen
dc.date.issued2015-08en_US
dc.identifier.citationPandey, Gaurav; McBride, James R.; Savarese, Silvio; Eustice, Ryan M. (2015). "Automatic Extrinsic Calibration of Vision and Lidar by Maximizing Mutual Information." Journal of Field Robotics 32(5): 696-722.en_US
dc.identifier.issn1556-4959en_US
dc.identifier.issn1556-4967en_US
dc.identifier.urihttps://hdl.handle.net/2027.42/112212
dc.publisherWiley Periodicals, Inc.en_US
dc.publisherPrinceton University Pressen_US
dc.titleAutomatic Extrinsic Calibration of Vision and Lidar by Maximizing Mutual Informationen_US
dc.typeArticleen_US
dc.rights.robotsIndexNoFollowen_US
dc.subject.hlbsecondlevelComputer Scienceen_US
dc.subject.hlbsecondlevelMechanical Engineeringen_US
dc.subject.hlbtoplevelEngineeringen_US
dc.description.peerreviewedPeer Revieweden_US
dc.description.bitstreamurlhttp://deepblue.lib.umich.edu/bitstream/2027.42/112212/1/rob21542.pdf
dc.identifier.doi10.1002/rob.21542en_US
dc.identifier.sourceJournal of Field Roboticsen_US
dc.identifier.citedreferenceSmith, R., Self, M., & Cheeseman, P. ( 1988 ). A stochastic map for uncertain spatial relationships. In Proceedings of International Symposium on Robotics Research (pp. 467 – 474 ), Santa Clara, CA.en_US
dc.identifier.citedreferenceRodriguez, F., Fremont, V., & Bonnifait, P., et al. ( 2008 ). Extrinsic calibration between a multi‐layer lidar and a camera. In IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (pp. 214 – 219 ).en_US
dc.identifier.citedreferenceScaramuzza, D., Harati, A., & Siegwart, R. ( 2007 ). Extrinsic self calibration of a camera and a 3D laser range finder from natural scenes. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 4164 – 4169 ), San Diego, CA.en_US
dc.identifier.citedreferenceScott, D. W. ( 1992 ). Multivariate density estimation: Theory, practice, and visualization. New York: John Wiley.en_US
dc.identifier.citedreferenceSilverman, B. W. ( 1986 ). Density estimation for statistics and data analysis. Monographs on Statistics and Applied Probability.en_US
dc.identifier.citedreferenceTamjidi, A., & Ye, C. ( 2012 ). 6‐DOF pose estimation of an autonomous car by visual feature correspondence and tracking. International Journal of Intelligent Control and Systems, 17 ( 3 ), 94 – 101.en_US
dc.identifier.citedreferenceTaylor, Z., & Nieto, J. ( 2012 ). A mutual information approach to automatic calibration of camera and lidar in antural environments. In Proceedings of Australian Conference on Robotics and Automation, Wellington, New Zealand.en_US
dc.identifier.citedreferenceUnnikrishnan, R., & Hebert, M. ( 2005 ). Fast extrinsic calibration of a laser rangefinder to a camera. Technical Report CMU‐RI‐TR‐05‐09, Robotics Institute Carnegie Mellon University.en_US
dc.identifier.citedreferenceVelodyne ( 2007 ). Velodyne HDL‐64E: A high definition LIDAR sensor for 3D applications. Technical report, Velodyne. Available at www.velodyne.com/lidar/products/white_paper.en_US
dc.identifier.citedreferenceViola, P., & Wells, W. ( 1997 ). Alignment by maximization of mutual information. International Journal of Computer Vision, 24, 137 – 154.en_US
dc.identifier.citedreferenceWang, R., Ferrie, F., & Macfarlane, J. ( 2012 ). Automatic registration of mobile lidar and spherical panoramas. In Computer Vision and Pattern Recognition Workshops (CVPRW), IEEE Computer Society Conference (pp. 33 – 40 ), Providence, RI.en_US
dc.identifier.citedreferenceWenzel, W., & Hamacher, K. ( 1999 ). A stochastic tunneling approach for global minimization. Physical Review Letters, 82 ( 15 ), 3003 – 3007.en_US
dc.identifier.citedreferenceWhittaker, E. T., & Robinson, G. ( 1967 ). The Newton‐Raphson method. The calculus of observations: A Treatise on Numerical Mathematics, 44 ( 4 ), 84 – 87.en_US
dc.identifier.citedreferenceWilliams, N., Low, K. L., Hantak, C., Pollefeys, M., & Lastra, A. ( 2004 ). Automatic image alignment for 3d environment modeling. In Proceedings of IEEE Brazilian Symposium on Computer Graphics and Image Processing (pp. 388 – 395 ).en_US
dc.identifier.citedreferenceXu, Z., Schwarte, R., Heinol, H., Buxbaum, B., & Ringbeck, T. ( 2005 ). Smart pixel—Photonic mixer device (PMD) new system concept of a 3D‐imaging camera‐on‐a‐chip. Technical report, PMD Technologies.en_US
dc.identifier.citedreferenceZhang, Q. ( 2004 ). Extrinsic calibration of a camera and laser range finder. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 2301 – 2306 ), Sendai, Japan.en_US
dc.identifier.citedreferenceZhang, Z. ( 2000 ). A flexible new technique for camera calibration. IEEE Transaction on Pattern Analysis and Machine Intelligence, 22 ( 11 ), 1330 – 1334.en_US
dc.identifier.citedreferenceZhou, L., & Deng, Z. ( 2012 ). Extrinsic calibration of a camera and a lidar based on decoupling the rotation from the translation. In Proceedings of IEEE Intelligent Vehicles Symposium (IV) (pp. 642 – 648 ).en_US
dc.identifier.citedreferenceAlempijevic, A., Kodagoda, S., Underwood, J. P., Kumar, S., & Dissanayake, G. ( 2006 ). Mutual information based sensor registration and calibration. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 25 – 30 ), Orlando, FL.en_US
dc.identifier.citedreferenceBao, S. Y., & Savarese, S. ( 2011 ). Semantic structure from motion. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 2025 – 2032 ), Providence, RI.en_US
dc.identifier.citedreferenceBarzilai, J., & Borwein, J. M. ( 1988 ). Two‐point step size gradient methods. IMA Journal of Numerical Analysis, 8, 141 – 148.en_US
dc.identifier.citedreferenceBoughorbal, F., Page, D. L., Dumont, C., & Abidi, M. A. ( 2000 ). Registration and integration of multisensor data for photorealistic scene reconstruction. In Proceedings of 28th AIPR Workshop on 3D Visualization for Data Exploration and Decision Making (vol. 3905, pp. 74 – 84 ).en_US
dc.identifier.citedreferenceCarlevaris‐Bianco, N., Mohan, A., McBride, J. R., & Eustice, R. M. ( 2011 ). Visual localization in fused image and laser range data. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 4378 – 4385 ), San Francisco.en_US
dc.identifier.citedreferenceChao, A., & Shen, T. J. ( 2003 ). Nonparametric estimation of Shannons index of diversity when there are unseen species in sample. Environmental and Ecological Statistics, 10 ( 4 ), 429 – 443.en_US
dc.identifier.citedreferenceCramer, H. ( 1946 ). Mathematical methods of statistics. Princeton landmarks in mathematics and physics. Princeton University Press.en_US
dc.identifier.citedreferenceForrest, S. ( 1993 ). Genetic algorithms: Principles of natural selection applied to computation. Science, 261 ( 5123 ), 872 – 878.en_US
dc.identifier.citedreferenceGong, X., Lin, Y., & Liu, J. ( 2013 ). 3D lidar‐camera extrinsic calibration using an arbitrary trihedron. Sensors, 13 ( 2 ), 1902 – 1918.en_US
dc.identifier.citedreferenceHartley, R., & Zisserman, A. ( 2000 ). Multiple view geometry in computer vision. Cambridge University Press.en_US
dc.identifier.citedreferenceHausser, J., & Strimmer, K. ( 2009 ). Entropy inference and the James‐Stein estimator, with application to nonlinear gene association networks. Journal of Machine Learning Research, 10, 1469 – 1484.en_US
dc.identifier.citedreferenceHill, D., Hawkes, D., Harrison, N., & Ruff, C. ( 1993 ). A strategy for automated multimodality image registration incorporating anatomical knowledge and imager characteristics. Information Processing in Medical Imaging, 687, 182 – 196.en_US
dc.identifier.citedreferenceHokuyo ( 2009 ). Scanning range finder: UTM‐30LX. Technical report, Hokuyo. Specification sheet and documentations available at www.hokuyo‐aut.jp/02sensor/07scanner/utm_30lx.html.en_US
dc.identifier.citedreferenceKirkpatrick, S., Gelatt, C. D., & Vecchi, M. P. ( 1983 ). Optimization by simulated annealing. Science, 220 ( 4598 ), 671 – 680.en_US
dc.identifier.citedreferenceLehmann, E. L., & Casella, G. ( 2011 ). Theory of point estimation. Springer Texts in Statistics Series. Springer.en_US
dc.identifier.citedreferenceLevenberg, K. ( 1944 ). A method for the solution of certain problems in least squares. The Quarterly of Applied Mathematics 2, 164 – 168.en_US
dc.identifier.citedreferenceLevinson, J., & Thrun, S. ( 2010 ). Unsupervised calibration for multi‐beam lasers. In Proceedings of International Symposium on Experimental Robotics, Delhi, India.en_US
dc.identifier.citedreferenceLevinson, J., & Thrun, S. ( 2012 ). Automatic calibration of cameras and lasers in arbitrary scenes. In Proceedings of International Symposium on Experimental Robotics, Quebec City, Canada.en_US
dc.identifier.citedreferenceLi, G., Liu, Y., Dong, L., Cai, X., & Zhou, D. ( 2007 ). An algorithm for extrinsic parameters calibration of a camera and a laser range finder using line features. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 3854 – 3859 ), San Diego, CA.en_US
dc.identifier.citedreferenceLi, Y., Ruichek, Y., & Cappelle, C. ( 2013 ). Optimal extrinsic calibration between a stereoscopic system and a lidar. IEEE Transactions on Instrumentation and Measurement, 62 ( 8 ), 2258 – 2269.en_US
dc.identifier.citedreferenceLin, Y., & Medioni, G. ( 2008 ). Mutual information computation and maximization using GPU. In Computer Vision and Pattern Recognition Workshop (pp. 1 – 6 ), Anchorage, AK.en_US
dc.identifier.citedreferenceMaes, F., Collignon, A., Vandermeulen, D., Marchal, G., & Suetens, P. ( 1997 ). Multimodality image registration by maximization of mutual information. IEEE Transactions on Medical Imaging, 16, 187 – 198.en_US
dc.identifier.citedreferenceMaes, F., Vandermeulen, D., & Suetens, P. ( 1999 ). Comparative evaluation of multiresolution optimisation strategies for multi modality image registration by maximisation of mutual information. Medical Image Analysis, 3 ( 4 ), 373 – 386.en_US
dc.identifier.citedreferenceMarquadrt, D. ( 1963 ). An algorithm for least‐squares estimation of nonlinear parameters. SIAM Journal on Applied Mathematics 11, 431 – 441.en_US
dc.identifier.citedreferenceMcDonald, J. H. ( 2009 ). Handbook of biological statistics, 2nd ed. Baltimore, MD: Sparky House Publishing.en_US
dc.identifier.citedreferenceMei, C., & Rives, P. ( 2006 ). Calibration between a central catadioptric camera and a laser range finder for robotic applications. In Proceedings of IEEE International Conference on Robotics and Automation (pp. 532 – 537 ), Orlando, FL.en_US
dc.identifier.citedreferenceMirzaei, F. M., Kottas, D. G., & Roumeliotis, S. I. ( 2012 ). 3D lidar‐camera intrinsic and extrinsic calibration: Observability analysis and analytical least squares‐based initialization. International Journal of Robotics Research, 31 ( 4 ), 452 – 467.en_US
dc.identifier.citedreferenceMoghadam, P., Bosse, M., & Zlot, R. ( 2013 ). Line‐based extrinsic calibration of range and image sensors. In Proceedings of IEEE International Conference on Robotics and Automation (vol. 2, pp. 4 – 11 ), Karlsruhe, Germany.en_US
dc.identifier.citedreferenceWoods, R. P., Mazziotta, J. C., & Cherry, S. R. ( 1993 ). MRI‐PET registration with automated algorithm. Journal of Computer Assisted Tomography, 17 ( 4 ), 536 – 546.en_US
dc.identifier.citedreferenceNapier, A., Corke, P., & Newman, P. ( 2013 ). Cross‐calibration of push‐broom 2D lidars and cameras in natural scenes. In Proceedings of IEEE International Conference on Robotics and Automation (pp. 3664 – 3669 ), Karlsruhe, Germany.en_US
dc.identifier.citedreferenceNelder, J. A., & Mead, R. ( 1965 ). A simplex method for function minimization. The Computer Journal, 7 ( 4 ), 308 – 313.en_US
dc.identifier.citedreferenceNewman, P., Cole, D., & Ho, K. ( 2006 ). Outdoor SLAM using visual appearance and laser ranging. In Proceedings of IEEE International Conference on Robotics and Automation (pp. 1180 – 1187 ), Orlando, FL.en_US
dc.identifier.citedreferenceNunnez, P., Jr, P. D., Rocha, R., & Dias, J. ( 2009 ). Data fusion calibration for a 3D laser range finder and a camera using inertial data. In Proceedings of the 4th European Conference on Mobile Robots (pp. 31 – 36 ), Mlini/Dubrovnik, Croatia.en_US
dc.identifier.citedreferencePandey, G., McBride, J., Savarese, S., & Eustice, R. M. ( 2011a ). Visually bootstrapped generalized ICP. In Proceedings of IEEE International Conference on Robotics and Automation (pp. 2660 – 2667 ), Shanghai, China.en_US
dc.identifier.citedreferencePandey, G., McBride, J. R., & Eustice, R. M. ( 2011b ). Ford campus vision and lidar data set. International Journal of Robotics Research, 30 ( 13 ), 1543 – 1552.en_US
dc.identifier.citedreferencePandey, G., McBride, J. R., Savarese, S., & Eustice, R. M. ( 2010 ). Extrinsic calibration of a 3d laser scanner and an omnidirectional camera. In IFAC Symposium on Intelligent Autonomous Vehicles (vol. 7, pp. 336 – 341 ), Leece, Italy.en_US
dc.identifier.citedreferencePandey, G., McBride, J. R., Savarese, S., & Eustice, R. M. ( 2012a ). Automatic targetless extrinsic calibration of a 3D lidar and camera by maximizing mutual information. In Proceedings of AAAI National Conference of Artificial Intelligence (pp. 2053 – 2059 ), Toronto, Canada.en_US
dc.identifier.citedreferencePandey, G., McBride, J. R., Savarese, S., & Eustice, R. M. ( 2012b ). Toward mutual information based automatic registration of 3D point clouds. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (pp. 2698 – 2704 ), Algarve, Portugal.en_US
dc.identifier.citedreferencePanin, G., & Knoll, A. ( 2008 ). Mutual information‐based 3D object tracking. International Journal of Computer Vision, 78 ( 1 ), 107 – 118.en_US
dc.identifier.citedreferencePoint Grey Research Inc. ( 2009 ). Spherical vision products: Ladybug3. Technical report, Point Grey Research. Specification sheet and documentations available at www.ptgrey.com/products/ladybug3/index.asp.en_US
dc.identifier.citedreferencePoint Grey Research Inc. ( 2010 ). Imaging products: Firefly IEEE 1394a. Technical report, Point Grey Research. Specification sheet and documentations available at www.ptgrey.com/products/fireflymv/fireflymv_usb_firewire_cmos_camera.asp.en_US
dc.owningcollnameInterdisciplinary and Peer-Reviewed


Files in this item

Name:
rob21542.pdf
Size:
2.884MB
Format:
PDF
View/Open

Show simple item record

Remediation of Harmful Language

The University of Michigan Library aims to describe library materials in a way that respects the people and communities who create, use, and are represented in our collections. Report harmful or offensive language in catalog records, finding aids, or elsewhere in our collections anonymously through our metadata feedback form. More information at Remediation of Harmful Language.

Accessibility

If you are unable to use this file in its current format, please select the Contact Us link and we can modify it to make it more accessible to you.