Road Surface Preview Estimation Using a Monocular Camera

• Main Author: Ekström, Marcus
• Format: Others
• Language: English
• Published: Linköpings universitet, Datorseende 2018
• Subjects: Road Surface Preview; Computer Vision; Depth Estimation; Convolutional Neural Network; CNN; traffic safety; monocular camera; mono vision system; mono camera; Structure from motion; sfm; 3D Reconstruction; Autonomous Driving; Datorseende; trafiksäkerhet; djupuppskattning; mono kamera; 3D rekonstruktion; autonoma fordon; Signal Processing; Signalbehandling
• Online Access: http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-151873

Recently, sensors such as radars and cameras have been widely used in automotives, especially in Advanced Driver-Assistance Systems (ADAS), to collect information about the vehicle's surroundings. Stereo cameras are very popular as they could be used passively to construct a 3D representation of the scene in front of the car. This allowed the development of several ADAS algorithms that need 3D information to perform their tasks. One interesting application is Road Surface Preview (RSP) where the task is to estimate the road height along the future path of the vehicle. An active suspension control unit can then use this information to regulate the suspension, improving driving comfort, extending the durabilitiy of the vehicle and warning the driver about potential risks on the road surface. Stereo cameras have been successfully used in RSP and have demonstrated very good performance. However, the main disadvantages of stereo cameras are their high production cost and high power consumption. This limits installing several ADAS features in economy-class vehicles. A less expensive alternative are monocular cameras which have a significantly lower cost and power consumption. Therefore, this thesis investigates the possibility of solving the Road Surface Preview task using a monocular camera. We try two different approaches: structure-from-motion and Convolutional Neural Networks.The proposed methods are evaluated against the stereo-based system. Experiments show that both structure-from-motion and CNNs have a good potential for solving the problem, but they are not yet reliable enough to be a complete solution to the RSP task and be used in an active suspension control unit.