Sensing technology suite brings greater intelligence to automatic safety systems in the automotive industry.

❱ ❱ Forward facing cameras

❱ ❱ Camera technology from Harman is fusing image processing, LiDAR and other sensing technology for machine vision in the quest for safer motoring

and LiDAR help to create 360 vision for enabling autonomy

Sensor Fusion Enhances ADAS

Las Vegas to demonstrate its newly enhanced suite of sensing technologies designed to help car manufacturers to equip vehicles with advanced driver assist systems (ADAS), enabling drivers to keep an eye on the big picture at all times. From Augmented Surround View featuring multiple cameras to the driver monitoring system and control units that manage data, Harman is working with key technology suppliers to create an all-encompassing suite of sensing systems to bring in a new era of connected safety.


SURROUND VIEW SENSOR INTELLIGENCE One of the foundations of autonomous mobility that Harman is involved in is creating the ability for vehicles to have a 360-degree view of their surroundings enabling a rich set of ADAS applications and features. This sensor intelligence suite provides the ability to monitor, record and assess the vehicle surroundings, merging data across sensors and the cloud, thus creating a safer driving experience. The Harman Augmented Reality platform is used to visualise ADAS related information to the users in a new way, helping to create the necessary trust in ADAS technology. Some of the featured technologies include:

6 /// DAQ, Sensors & Instrumentation Vol 2 No. 1

utomotive connectivity specialist, Harman has been at this year’s Consumer Electronics Show (CES 2019) in

• Camera Monitoring System: Capable of augmenting, or even replacing physical mirrors, Harman’s Camera Monitoring System features a fusion of three rear-facing cameras and corner radar. The right and left sensors, coupled with a long-range rear camera (typically located right above a vehicle’s licence plate) look behind the vehicle to facilitate safety technologies, including blind spot monitoring, lane change assist and rear collision warning. Short-range corner radar sensors round out the complete 360-degree view package.

• Forward Facing Camera: The Forward Facing Camera, which would typically be placed near the top centre of a vehicle’s windscreen, is a key element for environmental sensing and enabling advanced perception algorithms for features such as lane, object and sign detection. Sensor fusion managed within Harman’s own module allows for integration with long-range radar to also detect vehicles ahead and maintain a safe distance while in traffic.

CABIN MONITORING SYSTEM Creating conditional autonomous cars, often referred to as Level 3 autonomous cars, is the next logical step in future mobility progression. These have the ability to manage most aspects of driving by themselves, but only if certain conditions are met and

if not, they would require the human to take over. The biggest challenge with these vehicles is managing the hand- over: the situation where the car must transfer control back to the driver once limitations are met. In order to ensure this happens seamlessly, Harman has developed an advanced Cabin Monitoring System which uses monitoring sensors to capture the most important first- order biometric features of a driver, such as eye gaze, head position and pupil diameter among others. The system can also analyse the auditory content and heart or breathing rates of occupants using proprietary and patented algorithms to provide second-order biometric signals such as emotional activity and cognitive load. While capable of working in lower levels of autonomy, this system will be critical to the success of semi- autonomous vehicles in the future.

LIDAR In preparation for higher levels of autonomy, Harman has partnered with Innoviz Technologies to bring LiDAR technology to more manufacturers. These long-range, solid state systems are compact and capable of helping cars “see” where they’re going as well as objects ahead much more accurately. The sensor fusion technology will also allow LiDAR to work with Forward Facing Cameras to enable more vehicle safety use cases.

Page 1  |  Page 2  |  Page 3  |  Page 4  |  Page 5  |  Page 6  |  Page 7  |  Page 8  |  Page 9  |  Page 10  |  Page 11  |  Page 12  |  Page 13  |  Page 14  |  Page 15  |  Page 16  |  Page 17  |  Page 18  |  Page 19  |  Page 20  |  Page 21  |  Page 22  |  Page 23  |  Page 24