Partners

Abstract:
This paper concentrates on the topic of gathering, processing and presenting 3D data for use in Search and Rescue operations. The data are gathered by unmanned ground platforms, in form of 3D point clouds. The clouds are matched and transformed into a consistent, highly accurate 3D model. The paper describes the pipeline for such matching based on Iterative Closest Point algorithm supported by loop closing done with LUM method. The pipeline was implemented for parallel computation with Nvidia CUDA, which leads to higher matching accuracy and lower computation time. An analysis of performance for multiple GPUs is presented. The second problem discussed in the paper is immersive visualization of 3d data for search and rescue personnel. Five strategies are discussed: plain 3D point cloud, hypsometry, normal vectors, space descriptors and an approach based on light simulation through the use of NVIDIA OptiX Ray Tracing Engine. The results from each strategy were shown to end users for validation. The paper discusses the feedback given. The results of the research are used in the development of a support module for ICARUS project.

Keywords:
Three-dimensional displays, Data visualization, Graphics processing units, Image color analysis, Computational modeling, Solid modeling, Pipelines

Abstract:
We propose an open source robotic 3D mapping framework based on Robot Operating System, Point Cloud Library and Cloud Compare software extended by functionality of importing and exporting datasets. The added value is an integrated solution for robotic 3D mapping and new publicly available datasets (accurate 3D maps with geodetic precision) for evaluation purpose Datasets were gathered by mobile robot in stop scan fashion. Presented results are a variety of tools for working with such datasets, for task such as: preprocessing (filtering, down sampling), data registration (ICP, NDT), graph optimization (ELCH, LUM), tools for validation (comparison of 3D maps and trajectories), performance evaluation (plots of various outputs of algorithms). The tools form a complete pipeline for 3D data processing. We use this framework as a reference methodology in recent work on SLAM algorithms.

Keywords:
Three-dimensional displays, Robot kinematics, Cameras, Mobile communication, Robot sensing systems, XML

Abstract:
Affordable technological solutions are always welcome, thus we decided to test the backpack based 3D mapping system for digitizing USAR scenes. The system is composed of Intel RealSense Tracking Camera T265, three Velodynes VLP16, custom electronics for multi-lidar synchronization and VR Zotac GO backpack computer equipped with GeForce GTX1070. This configuration allows the operator to collect and process 3D point clouds to obtain a consistent 3D map. To reach satisfactory accuracy we use RealSense as initial guess of trajectory from Visual Odometry (VO). Lidar odometry corrects trajectory and reduces scale error from VO. The academic 6DSLAM is used for loop closure and finally classical ICP algorithm refines the final 3D point cloud. All steps can be done in the field in reasonable time. The VR backpack can be used for virtual travel over digital content afterwords. Additionally deep neural network is used to perform online object detection using Relsense camera input.