The world is facing a great technological transformation towards full autonomous vehicles, where optimists predict that by 2030, autonomous vehicles will be sufficiently reliable, affordable and common to displace most human driving. To cope with these trends, reliable perception systems must enable vehicles to hear and see all the surroundings, being light detection and ranging (LiDAR) sensors a key instrument for recreating a 3D visualization of the world in real time. However, perception systems must rely in accurate measurements of the environment. Thus, sensors must be calibrated and benchmarked before being placed on the market or assembled in a car. This article presents an Evaluation and Testing Platform for Automotive LiDAR sensors with the main goal of testing not only commercially available sensors, but also sensor prototypes currently under development in Bosch Automotive Electronics division. The testing system can benchmark any LiDAR sensor under different conditions, recreating the expected driving environment to which such devices are normally subjected. To characterize and validate the sensor under test, the platform evaluates several parameters such as the field of view (FoV), angular resolution, sensor’s range, etc. This project results from a partnership between the University of Minho and Bosch Car Multimedia Portugal, S.A.

The rapid development of Deep Learning brought novel methodologies for 3D Object Detection using LiDAR sensing technology. These improvements in precision and inference speed performances lead to notable high performance and real-time inference, which is especially important for self-driving purposes. However, the developments carried by these approaches overwhelm the research process in this area since new methods, new technologies, and software versions lead to different project necessities, specifications and requirements. Moreover, the improvements brought by the new methods may be due to improvements in newer versions of deep learning frameworks and not just the novelty and innovation of the model architecture. Thus, it became crucial to create a framework with the same software versions, specifications and requirements that accommodate all these methodologies and allow the easy introduction of new methods and models. A framework is proposed that abstracts the implementation, reusing and building of novel methods and models. The main idea is to facilitate the representation of state-of-the-art (SoA) approaches and simultaneously encourage the implementation of new approaches by reusing, improving and innovating modules in the proposed framework, which has the same software specifications to allow a fair comparison. This makes it possible to determine if the key innovation approach outperforms the current SoA by comparing models in a framework with the same software specifications and requirements.