How the sensors in Scania AXL replace the human eye

How the sensors in Scania AXL replace the human eye

With cameras, radar and lidar sensors, Scania’s engineers have taken powerful steps towards fully autonomous vehicles. The challenge has been to replace the human eye and the ability of the human brain to process decisions based on what the eye sees.

Autonomous vehicles have often relied on data from cameras and radar. Radar sensors are reliable, but the resolution is insufficient to identify the likes of pedestrians and small objects at a distance. The camera offers a sufficient level of detail and a good overview in two dimensions but requires massive software to convert 2D images of the surrounding environment to 3D. Generally, for autonomous vehicles, software is more important than hardware.

For safe autonomous driving, an additional sensor is therefore needed. It’s called lidar, which stands for light detection and ranging. “We need there to be overlap between the sensors, so that one can be a backup to take over from the other if needs be,” says Fredrich Claezon, System Architect for Autonomous Vehicles. “What happens if the camera and radar suggest conflicting information? Which of these sensors should we trust? With lidar, we can obtain a better basis for decisions.”

Cameras, radar, lidar and GPS

Scania’s first fully autonomous self-driving concept truck, Scania AXL, is equipped with cameras, radar, lidar and GPS receivers. The system is designed for a level that meets the operational needs of mines. “The system isn’t yet street smart but it’s certainly smart enough for being used in mines,” says Development Engineer Magnus Granström, Autonomous Systems Development.

The human eye is not easily replaced but a relatively good overview of surroundings can be obtained through sensors. “In this case, we see what we need to see,” Granström explains. “Driving in a mine is fairly simple and predictable. If you’re driving in a more dynamic and less predictable environment, more work is needed.”

It’s been difficult to decide just how complex the system should be. This involves balancing an opportunity to develop a more general system for many applications with ensuring there is a robust and reliable system for the mining industry. “Scania AXL would most probably not be fit for city driving but considering the envisioned environment and planned assignments, it’s sufficiently smart,” says Granström.