Have a personal or library account? Click to login
3D Reconstruction System Based on Multi Sensor Cover
By: Fan Yu and  Xue Fan  
Open Access
|May 2023

Figures & Tables

Figure 1.

Key threads for ORB-SLAM
Key threads for ORB-SLAM

Figure 2.

STRUCTURE diagram of 3D reconstruction
STRUCTURE diagram of 3D reconstruction

Figure 3.

ORB-SLAM algorithm flow
ORB-SLAM algorithm flow

Figure 4.

Dense reconstruction results of data set FR1_room
Dense reconstruction results of data set FR1_room

Figure 5.

Dense reconstruction results of data set FR3_office
Dense reconstruction results of data set FR3_office

Figure 6.

Reconstruction results of dataset RGBD_DATASet_freiburg3_TEDDY
Reconstruction results of dataset RGBD_DATASet_freiburg3_TEDDY

Figure 7.

Depth camera schematic diagram
Depth camera schematic diagram

Figure 8.

Schematic diagram of checkerboard calibration board
Schematic diagram of checkerboard calibration board

Figure 9.

Schematic diagram of multi-angle calibration plate
Schematic diagram of multi-angle calibration plate

Figure 10.

Corner extraction of the calibration board
Corner extraction of the calibration board

Figure 11.

Reprojection error diagram
Reprojection error diagram

Figure 12.

Displacement curve in XY direction
Displacement curve in XY direction

Figure 13.

Trajectory diagram of the robot
Trajectory diagram of the robot

Figure 14.

Top view of adding an IMU
Top view of adding an IMU

Figure 15.

Top view of adding an IMU without an IMU
Top view of adding an IMU without an IMU

Experimental results of 3D reconstruction for different sensors

SensorTrack the percentage of partial breaks caused by loss
Without IMU35%
With IMU10%

Calibration results of the realsense D435 camera

The camera parametersThe calibration results
Internal605.8940317.887
0606.856256.416
001
Distortion parameter 10.15689
Distortion parameter 2−0.3425
Mean reprojection difference0.28213

Software system configuration

The name of the softwareModel and Version
The operating systemUbuntu18.04
Robot operating systemROS-Melodic
Development programming languagec/c++
opencv
Visual library to use Point cloud libraryPCL

Calibration results of multiple sensors

The camera parametersThe calibration results
Rotation matrix of camera and IMU0.99995240.00422360.0012432
−0.00542680.99952360.00158425
−0.0014262380.00170520.9999842
Translation matrix of camera and IMU0.012388470.00842635−0.02145263

Hardware configuration parameters of the robot

HardwareModel
Upper-computer workstationLenovo Air15
IMU sensorMPU9250
Depth sensorRealsense D435
Language: English
Page range: 58 - 66
Published on: May 26, 2023
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year

© 2023 Fan Yu, Xue Fan, published by Xi’an Technological University
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.