Bi-objective Framework for Sensor Fusion in RGB-D Multi-View Systems: Applications in Calibration

Abstract : Complete and textured 3D reconstruction of dynamic scenes has been facilitated by mapped RGB and depth information acquired by RGB-D cameras based multi-view systems. One of the most critical steps in such multi-view systems is to determine the relative poses of all cameras via a process known as extrinsic calibration. In this work, we propose a sensor fusion framework based on a weighted bi-objective optimization for refinement of extrinsic calibration tailored for RGB-D multi-view systems. The weighted bi-objective cost function, which makes use of 2D information from RGB images and 3D information from depth images, is analytically derived via the Maximum Likelihood (ML) method. The weighting factor appears as a function of noise in 2D and 3D measurements and takes into account the affect of residual errors on the optimization. We propose an iterative scheme to estimate noise variances in 2D and 3D measurements, for simultaneously computing the weighting factor together with the camera poses. An extensive quantitative and qualitative evaluation of the proposed approach shows improved calibration performance as compared to refinement schemes which use only 2D or 3D measurement information.
Document type :
Preprints, Working Papers, ...
Complete list of metadatas

Cited literature [42 references]  Display  Hide  Download

https://hal-auf.archives-ouvertes.fr/hal-02157633
Contributor : David Fofi <>
Submitted on : Monday, June 17, 2019 - 10:59:15 AM
Last modification on : Friday, June 21, 2019 - 1:48:54 AM

File

1905.09939.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02157633, version 1

Collections

Citation

Hassan Afzal, Djamila Aouada, Michel Antunes, David Fofi, Bruno Mirbach, et al.. Bi-objective Framework for Sensor Fusion in RGB-D Multi-View Systems: Applications in Calibration. 2019. ⟨hal-02157633⟩

Share

Metrics

Record views

40

Files downloads

20