Camera simulation for robot simulation: how important are various camera model components?
Asher Elmquist, Radu Serban, Dan Negrut

TL;DR
This paper investigates how various components of camera models influence the realism of synthetic images in robotic simulation, highlighting the relative importance of scene effects versus local artifacts.
Contribution
It provides a quantitative analysis of the impact of different camera model components on the sim-to-real gap in robotics simulations.
Findings
Scene effects like lighting and reflection have greater impact than local artifacts.
Lens distortion and signal processing significantly affect scene-level realism.
Large-scale changes in scene parameters outweigh local feature artifacts.
Abstract
Modeling cameras for the simulation of autonomous robotics is critical for generating synthetic images with appropriate realism to effectively evaluate a perception algorithm in simulation. In many cases though, simulated images are produced by traditional rendering techniques that exclude or superficially handle processing steps and aspects encountered in the actual camera pipeline. The purpose of this contribution is to quantify the degree to which the exclusion from the camera model of various image generation steps or aspects affect the sim-to-real gap in robotics. We investigate what happens if one ignores aspects tied to processes from within the physical camera, e.g., lens distortion, noise, and signal processing; scene effects, e.g., lighting and reflection; and rendering quality. The results of the study demonstrate, quantitatively, that large-scale changes to color, scene, and…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Vision and Imaging · Computer Graphics and Visualization Techniques · Remote Sensing and LiDAR Applications
