用户名: 密码: 验证码:
激光和视觉融合SLAM方法研究综述
详细信息    查看全文 | 推荐本文 |
  • 英文篇名:Survey of SLAM with Laser-Camera Fusion Sensor
  • 作者:马争光 ; 赵永国 ; 刘成业 ; 刘广亮 ; 朱琳
  • 英文作者:Ma Zhengguang;Zhao Yongguo;Liu Chengye;Liu Guangliang;Zhu Lin;Institute of Automation,Shandong Academy of Sciences;Provincial Key Laboratory of Robot and Manufacturing Automation Technology,Shandong;Qilu University of Technology (Shandong Academy of Sciences);
  • 关键词:激光和视觉融合 ; 同步定位与建图 ; 外部标定 ; 数据融合
  • 英文关键词:laser-camera sensor fusion;;SLAM;;extrinsic calibration;;data fusion
  • 中文刊名:JZCK
  • 英文刊名:Computer Measurement & Control
  • 机构:山东省科学院自动化研究所;山东省机器人与制造自动化技术重点实验室;齐鲁工业大学(山东省科学院);
  • 出版日期:2019-03-25
  • 出版单位:计算机测量与控制
  • 年:2019
  • 期:v.27;No.246
  • 基金:山东省科学院青年基金项目(2019QN0015);; 山东省重点研发计划(2017CXGC0916)
  • 语种:中文;
  • 页:JZCK201903001
  • 页数:6
  • CN:03
  • ISSN:11-4762/TP
  • 分类号:7-12
摘要
激光和视觉传感器在SLAM应用中都有其局限性,基于激光和视觉传感器融合的SLAM方法能够有效的利用各个传感器的优势,弥补传感器在某些特殊环境下的劣势,成为当前研究的热点之一;在分析激光SLAM和视觉SLAM优缺点的基础上,对激光和视觉融合的SLAM方法的研究现状进行概括和总结;介绍了激光和视觉融合SLAM的主要标志性成果,总结了激光和视觉传感器融合SLAM的关键性问题,包括激光和视觉传感器数据的外部标定、激光和视觉传感器数据融合方法,对激光和视觉融合SLAM方法的优缺点和主要的应用领域进行了总结;最后,对激光和视觉融合SLAM的主要发展趋势及研究热点进行了讨论。
        Both the laser-based simultaneous localization and mapping(SLAM)and vision-based SLAM have limitation in specific environment,the SLAM with laser-camera fusion sensor can take advantage of outstanding features and make up the disadvantages of each sensors in these environment.Therefore,the SLAM with laser-camera fusion sensor has got much attention.The research of SLAM with laser-camera fusion sensor are reviewed and some outstanding achievements are presented to get a better understanding.Then the extrinsic calibration of camera and laser and laser-camera data fusion are analyzed in detail.And the advantages and disadvantages of the SLAM with laser-camera fusion sensor and its main application fields are summarized.In the end,the main trends and research hotspots of SLAM with laser-camera fusion sensor are discussed.
引文
[1]Bailey Tim,Durrant-Whyte Hugh.Simultaneous localization and mapping(slam):Part ii[J].IEEE Robotics&Automation Magazine,2006,13(3):108-117.
    [2]Durrant-Whyte Hugh,Bailey Tim.Simultaneous localization and mapping:Part i[J].IEEE Robotics&Automation Magazine,2006,13(2):99-110.
    [3]Aulinas Josep,Petillot Yvan,Salvi Joaquim,et al.The slam problem:A survey[C].in Artificial Intelligence Research and Development,Proceedings of the International Conference of the Catalan Association for Artificial Intelligence,Sant MartíD'empúries,2008:363-371.
    [4]Dissanayake Gamini,Huang Shoudong,Wang Zhan,et al.Areview of recent developments in simultaneous localization and mapping[A].in IEEE International Conference on Industrial and Information Systems[C].Kandy,2011:477-482.
    [5]Cadena Cesar,Carlone Luca,Carrillo Henry,et al.Past,present,and future of simultaneous localization and mapping:Toward the robust-perception age[J].IEEE Transactions on Robotics,2016,32(6):1309-1332.
    [6]Hess Wolfgang,Kohler Damon,Rapp Holger,et al.Realtime loop closure in 2dlidar slam[C].in IEEE International Conference on Robotics and Automation,2016:1271-1278.
    [7]Kohlbrecher Stefan,Stryk Oskar Von,Meyer Johannes,et al.A flexible and scalable slam system with full 3dmotion estimation[A].in IEEE International Symposium on Safety,Security,and Rescue Robotics[C].Kyoto,2011:155-160.
    [8]Grisetti Giorgio,Stachniss Cyrill,Burgard Wolfram.Improved techniques for grid mapping with rao-blackwellized particle filters[J].IEEE Transactions on Robotics,2007,23(1):34-46.
    [9]Konolige Kurt,Grisetti Giorgio,Kümmerle Rainer,et al.Efficient sparse pose adjustment for 2d mapping[A].in Ieee/rsj International Conference on Intelligent Robots and Systems[C].2010:22-29.
    [10]Davison J Andrew,Reid D Ian,Molton D Nicholas,et al.Monoslam:Real-time single camera slam[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2007,29(6):1052-1067.
    [11]Mur-artal Raúl,Montiel JoséMaría Martínez,TARDóS Juan Domingo.Orbslam:A versatile and accurate monocular slam system[J].IEEE Transactions on Robotics,2017,31(5):1147-1163.
    [12]Engel Jakob,Sch9ps Thomas and CREMERS Daniel.Lsdslam:Large-scale direct monocular slam[A].in European Conference on Computer Vision[C].Zurich,Springer International Publishing,2014:834-849.
    [13]Endres Felix,Hess Jürgen,Engelhard Nikolas,et al.An evaluation of the rgb-d slam system[A].in IEEE International Conference on Robotics and Automation[C].Saint Paul,2012:1691-1696.
    [14]Engel Jakob,Koltun Vladlen,Cremers Daniel.Direct sparse odometry[J].IEEE Transactions on Pattern Analysis&Machine Intelligence,2016,PP(99):1-1.
    [15]Vázquez-martín Ricardo,Nu1ez Trujillo Pedro Miguel,Del Toro Lasanta JoséCarlos,et al.Adaptive observation covariance for ekf-slam in indoor environments using laser data[A].in 13th IEEE Mediterranean Electrotechnical Conference[C].Benalmádena,2006.
    [16]Bailey Tim.Mobile robot localisation and mapping in extensive outdoor environments[D].University of Sydney,2002.
    [17]Williams S B,Newman P,Dissanayake G,et al.Autonomous underwater simultaneous localisation and map building[A].in IEEE International Conference on Robotics and Automation[C].San Francisco,2000:1793-1798.
    [18]Kim Jong Hyuk,Sukkarieh S.Airborne simultaneous localisation and map building[A].in IEEE International Conference on Robotics and Automation[C].Taipei,2003:406-411.
    [19]Cadena Cesar,Carlone Luca,Carrillo Henry,et al.Simultaneous localization and mapping:Present,future,and the robust-perception age[J].IEEE Transactions on Robotics,2016,32(6).
    [20]Taketomi Takafumi,Uchiyama Hideaki,Ikeda Sei.Visual slam algorithms:A survey from 2010to 2016[J].Ipsj Transactions on Computer Vision&Applications,2017,9(1):16.
    [21]Gallegos Gabriela,Rives Patrick.Indoor slam based on composite sensor mixing laser scans and omnidirectional images[A].in IEEE International Conference on Robotics and Automation[C].Anchorage,2010:3519-3524.
    [22]Tessier Cedric,Cariou Christophe,Debain Christophe,et al.A real-time,multi-sensor architecture for fusion of delayed observations:Application to vehicle localization[A].in IEEEIntelligent Transportation Systems Conference[C].Toronto,2008:1316-1321.
    [23]Zhang Zhengyou.Flexible camera calibration by viewing a plane from unknown orientation[J].Proc Iccv,1999,1:666-673.
    [24]Zhang Qilong,Pless Robert.Extrinsic calibration of a camera and laser range finder(improves camera calibration)[A].in Ieee/rsj International Conference on Intelligent Robots and Systems[C].Sendai,2005:2301-2306.
    [25]Castorena Juan,Kamilov Ulugbek S,Boufounos Petros T.Autocalibration of lidar and optical cameras via edge alignment[A].in IEEE International Conference on Acoustics[C].Speech and Signal Processing,2016.
    [26]Vasconcelos Francisco,Barreto Jo2o P.Nunes Urbano,Aminimal solution for the extrinsic calibration of a camera and a laser-rangefinder[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2012,34(11):2097-2107.
    [27]Li Ganhua,Liu Yunhui,Dong Li,et al.An algorithm for extrinsic parameters calibration of a camera and a laser range finder using line features[J].2007:3854-3859.
    [28]Hu Zhaozheng,Li Yicheng,Li Na,et al.,Extrinsic calibration of 2-d laser rangefinder and camera from single shot based on minimal solution[J].IEEE Transactions on Instrumentation&Measurement,2016,65(4):915-929.
    [29]Sim Sungdae,Sock Juil,Kwak Kiho,Indirect correspondence-based robust extrinsic calibration of lidar and camera[J].Sensors,2016,16(6):933.
    [30]Pandey Gaurav,Mcbride James R,Savarese Silvio,et al.Automatic extrinsic calibration of vision and lidar by maximizing mutual information[J].Journal of Field Robotics,2015,32(5):696-722.
    [31]Levinson Jesse,Thrun Sebastian.Automatic online calibration of cameras and lasers[C].in Robotics:Science and Systems,Berlin,2013.
    [32]Napier Ashley,Corke Peter,Newman Paul.Cross-calibration of push-broom 2dlidars and cameras in natural scenes[A].in IEEE International Conference on Robotics and Automation[C].Karlsruhe,2013:3679-3684.
    [33]Gong Xiaojin,Lin Ying,Liu Jilin,3dlidar-camera extrinsic calibration using an arbitrary trihedron[J].Sensors,2013,13(2):1902-1918.
    [34]Geiger Andreas,Moosmann Frank,Carmer,et al.Automatic camera and range sensor calibration using a single shot[A].in IEEE International Conference on Robotics and Automation[C].Saint Paul,2012:3936-3943.
    [35]Khosravian Alireza,Chin Tat Jun,Reid Ian.A branch-andbound algorithm for checkerboard extraction in camera-laser calibration[A].in 2017IEEE International Conference on Robotics and Automation(ICRA)[C].Singapore,2017:6495-6502.
    [36]Mei Christopher,Rives Patrick.Calibration between a central catadioptric camera and a laser range finder for robotic applications[A].in IEEE International Conference on Robotics and Automation[C].Orlando,2006:532-537.
    [37]Wasielewski S,Strauss Olivier.Calibration of a multi-sensor system laser rangefinder/camera[C].in Proceedings of the Intelligent Vehicles'95Symposium,Detroit,1995:472-477.
    [38]Ha Jong Eun,Extrinsic calibration of a camera and laser range finder using a new calibration structure of a plane with a triangular hole[J].International Journal of Control Automation&Systems,2012,10(6):1240-1244.
    [39]Krause Stefan,Evert Robert.Remission based improvement of extrinsic parameter calibration of camera and laser scanner[A].in International Conference on Control Automation Robotics&Vision,Remission based improvement of extrinsic parameter calibration of camera and laser scanner[C].2012:829-834.
    [40]Hillemann M,Jutzi B.Ucalmicel-unified intrinsic and extrinsic calibration of a multi-camera and a laserscanner[J].Isprs Annals of Photogrammetry Remote Sensing&Spatial Information Sciences,2017,IV-2/W3:17-24.
    [41]Shi Kunfeng,Dong Qiulei,Wu Fuchao,Weighted similarityinvariant linear algorithm for camera calibration with rotating 1-d objects[J].2012:3806-3812.
    [42]Underwood James,Hill Andrew,Scheding Steve.Calibration of range sensor pose on mobile platforms[A].in Ieee/rsj International Conference on Intelligent Robots and Systems[C].San Diego,2007:3866-3871.
    [43]Bok Yunsu,Choi Dong Geol,Kweon in so.Extrinsic calibration of a camera and a 2dlaser without overlap[J].Robotics&Autonomous Systems,2016,78(18):17-28.
    [44]Ahmad Yousef Khalil M,MOHD Bassam J,AL-WIDYANKhalid,et al.Extrinsic calibration of camera and 2dlaser sensors without overlap[J].Sensors,2017,17(10):1-24.
    [45]Bouguet Jean-yves.Camera calibration toolbox for matlab[EB/OL].http://www.vision.caltech.edu/bouguetj.2013.
    [46]Guindel Carlos,Beltrán Jorge,Martín David,et al.Automatic extrinsic calibration for lidar-stereo vehicle sensor setups[A].in IEEE International Conference on Intelligent Transportation Systems[C].Mielparque Yokohama,2017.
    [47]Wen Shuhuan,Othman Kamal Mohammed,Rad Ahmad B,et al.Indoor slam using laser and camera with closed-loop controller for nao humanoid robot[J].Abstract and Applied A-nalysis,2014,2014(1):1-8.
    [48]Amarasinghe Dilan,Mann George K I,Gosine Raymond G.Integrated laser-camera sensor for the detection and localization of landmarks for robotic applications[A].in IEEE International Conference on Robotics and Automation[C].Pasadena,2008:4012-4017.
    [49]Zhang Xinzheng,Rad A B,Wong Y K.Sensor fusion of monocular cameras and laser rangefinders for line-based simultaneous localization and mapping(slam)tasks in autonomous mobile robots[J].2012,12(1):429-452.
    [50]Sun Fengchi,Zhou Yuan,Li Chao,et al.Research on active slam with fusion of monocular vision and laser range data[A].in the 8th world congress on intelligent control and automation[C].2010:6550-6554.
    [51]Shen Jiali,Hu Huosheng.Svm based slam algorithm for autonomous mobile robots[A].in International Conference on Mechatronics and Automation[C].2007:337-342.
    [52]Waske B,Benediktsson J A,Fusion of support vector machines for classification of multisensor data[J].IEEE Transactions on Geoscience&Remote Sensing,2007,45(12):3858-3866.
    [53]Chang H J,Lee C S G,Lu Y H,et al.P-slam:Simultaneous localization and mapping with environmental-structure prediction[J].IEEE Transactions on Robotics,2007,23(2):281-293.
    [54]Gning A,Abdallah F,Bonnifait P.A new estimation method for multisensor fusion by using interval analysis and particle filtering[A].in IEEE International Conference on Robotics and Automation[C].2007:3844-3849.
    [55]Das T,Kar I N,Design and implementation of an adaptive fuzzy logic-based controller for wheeled mobile robots[J].IEEE Transactions on Control Systems Technology,2006,14(3):501-510.
    [56]Stover J A,Hall D L,Gibson R E.A fuzzy-logic architecture for autonomous multisensor data fusion[J].IEEE Transactions on Industrial Electronics,1996,43(3):403-410.
    [57]Choi Dong Geol,Shim Inwook,Bok Yunsu,et al.Autonomous homing based on laser-camera fusion system[A].in Ieee/rsj International Conference on Intelligent Robots and Systems[C].Vilamoura,2012:2512-2518.
    [58]Lin Kuenhan,Chang Chunhua,Dopfer Andreas,et al.Mapping and localization in 3denvironments using a 2dlaser scanner and a stereo camera[J].Journal of Information Science&Engineering,2012,28(1):131-144.
    [59]Ding Xiaqing,Wang Yue,Li Dongxuan,et al.Laser map aided visual inertial localization in changing environment[EB/OL].http://arxiv.org/abs/1803.01104,2018.
    [60]Pascoe Geoffrey,Maddern Will,Newman Paul.Direct visual localisation and calibration for road vehicles in changing city environments[A].in IEEE International Conference on Computer Vision Workshop[C].Santiago,2015:98-105.
    [61]Huh Sungsik,Shim David Hyunchul,Kim Jonghyuk.Integrated navigation system using camera and gimbaled laser scanner for indoor and outdoor autonomous flight of uavs[A].in Ieee/rsj International Conference on Intelligent Robots and Systems[C].Tokyo,2013:3158-3163.
    [62]Jutzi Boris,Weinmann Martin,Meidow Jochen.Weighted data fusion for uav-borne 3dmapping with camera and line laser scanner[J].International Journal of Image&Data Fusion,2014,5(3):226-243.
    [63]Zeng Qinghua,Wang Yushu,Liu Jianye,et al.Integrating monocular vision and laser point for indoor uav slam[C].in Ubiquitous Positioning Indoor Navigation and Location Based Service(UPINLBS),Corpus Christ,2015:170-179.
    [64]Milella A,Reina G,Underwood J,et al.Combining radar and vision for self-supervised ground segmentation in outdoor environments[A].in Ieee/rsj International Conference on Intelligent Robots and Systems[C].San Francisco,2011:255-260.
    [65]Chen Mengxiao,Yang Shaowu,Yi Xiaodong,et al.Realtime 3dmapping using a 2dlaser scanner and imu-aided visual slam[A].in IEEE International Conference on Real-Time Computing and Robotics[C].Okinawa,2018:297-302.
    [66]Bok Yunsu,Jeong Yekeun,Choi Dong Geol,et al.Capturing village-level heritages with a hand-held camera-laser fusion sensor[J].International Journal of Computer Vision,2011,94(1):36-53.
    [67]Fischer Philipp,Dosovitskiy Alexey,Brox Thomas.Descriptor matching with convolutional neural networks:A comparison to sift[J].Computer Science,2014.
    [68]Hou Yi,Zhang Hong,Zhou Shilin.Convolutional neural network-based image representation for visual loop closure detection[A].in 2015IEEE International Conference on Information and Automation[C].2015:2238-2245.
    [69]Suenderhauf N,Shirazi S,Jacobson A,et al.Place recognition with convnet landmarks:Viewpoint-robust,condition-robust,training-free[C].Springer International Publishing,2015:296-296.
    [70]Bai Dongdong,Wang Chaoqun,Bo Zhang,et al.,Matchingrange-constrained real-time loop closure detection with cnns features[J].Robotics&Biomimetics,2016,3(1):15.
    [71]Lazaro M T,Paz L M,Pinies P,et al.Multi-robot slam using condensed measurements[A].in Ieee/rsj International Conference on Intelligent Robots and Systems[C].Chicago,2014:1069-1076.
    [72]Deutsch I,Liu Ming,Siegwart R.A framework for multi-robot pose graph slam[C].in IEEE International Conference on Real-Time Computing and Robotics,2016:567-572.
    [73]Bresson G,Aufrere R,Chapuis R.Consistent multi-robot decentralized slam with unknown initial positions[A].in International Conference on Information Fusion[C].2016:372-379.
    [74]Choudhary S,Carlone L,Nieto C,et al.Multi robot objectbased slam[J].2016.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700