So how are these capabilities leveraged in Aptiv’s revolutionary interior sensing technology? They are leveraged in a powerful combination of advanced deep learning algorithms and predictive analytics – all running on our scalable, high-speed computing platform.
Driver Sensing
Aptiv’s highly scalable in-cabin sensing and high performance compute solutions support features for applications in level 1 – 5 vehicles across all markets from passenger to commercial vehicles.
Aptiv’s in-cabin sensing technologies leverage both in-house and partner algorithms, however its benchmark accuracy and performance is achieved through deep convolutional networks. Aptiv has years of experience integrating these systems in various cabin configurations for both passenger cars and commercial vehicles.
A testament to Aptiv’s machine learning capabilities is its gesture recognition and driver state sensing systems. This technology is a game changer and partnering with both global OEMs and universities brings solutions for a safer and differentiated in-cabin user-experience.
Aptiv’s user experience data analytics suite tracks system parameters such as CPU load and memory usage to help find issues during development. Data analytics are also scalable, offering to proactively identify and root cause issues in a production fleet, extending the lifespan of software driven systems. System usage data can also be analysed to provide direct feedback for a better system design.
Sensing systems in today’s vehicles are focused on the driver’s eyes, using the angle and position to determine whether the driver is looking at the road ahead. You might think of this as “distraction management.” No question this data is important. However, have you ever driven home, put the car in park, and not remembered any part of the commute? Your eyes were on the road, but your mind was not engaged.
That’s why the systems Aptiv is developing go beyond “distraction management” to “attention management.” Using the same sensors – augmented by scalable software – the technology not only verifies if your eyes are on the road, but also understands if you are physically and cognitively available. Going back to that distracted drive home, even if your eyes were focused ahead, would you have been able to see a pedestrian suddenly stepping into the road and take action to avoid a collision?
Aptiv’s sensing technology can measure subtle changes in eye movement and facial expression, which indicate alertness. In an inattentive, zoned out state, your eyes may be aimed forward, but there’s very little movement other than the occasional blink.
Aptiv has also partnered with MIT to integrate their world-class scientific research and human factors into our software models. Enhanced driver availability data is a critical fused input for improved performance of the vehicle safety systems. Aptiv’s technology moves beyond classification and manages overall driver availability within safe operating boundaries by taking preventive actions - reducing HMI content, minimizing distractions and adjusting air controls.
The sensors can also determine whether a driver is cognitively available by classifying if the driver is in position, has their hands on the wheel or is holding a phone. Utilizing this data Aptiv is able to understand driver readiness enabling a safe driver hand-off when a system like Highway Assist is disengaged.
Aptiv is collaborating with global OEMs to scale our system to support a range of applications including personalization and authentication from Face ID, gesture and gaze control and supporting airbag deployment by measuring distance from the torso to the steering wheel. In-Cabin Sensing
Beyond individual drivers, Aptiv’s sensing technology is scalable across the vehicle cabin and expands to fleet management and commercial vehicles. When you get on a ride hailing or sharing transport, our system can determine if you’ve boarded the vehicle, confirmed safe seating and verified seat belt engagement.
Our sensing technology can detect, classify and send an alert that something has been left behind, whether it is a phone or something far more important and fragile, like your child in the back seat.
Now, imagine you’re in a fleet vehicle going from the office to a client meeting. You’re cold, but the driver is warm and has the A/C on full blast. With our thermal and biometric sensors, we can sense your need for heat, and adjust the temperature accordingly in the back seat.
Safety is our primary focus, and cabin sensing has major implications for safety. Say you get in that vehicle, and your biometrics show your blood pressure and pulse are significantly above normal ranges, and suddenly your position goes from upright and alert to slouched and nonresponsive. At that point, the vehicle could automatically take you to a hospital.
Aptiv is able to do all of this and more with a scalable software set leveraging deep learning networks. You will not need to continually upgrade or swap out hardware. Thanks to Aptiv’s software expertise and world-class partners, such as MIT and Affectiva, new features can continuously be brought to our customers through advanced software, the most extensive data libraries, robust algorithms and predictive analytics.
High Performance Compute
With all of the data being exchanged and analyzed by all these sensors, the vehicle must have a lot of high-speed computing power. Central compute is the backbone enabling these technologies.
Our UX server – which scales from base to premium in-vehicle content – enables safer mobility and an improved user experience.
Aptiv’s UX Server supports different levels of user interfaces including reconfigurable AMoD HMI with personalized in-seat entertainment – including independent Navigation MAPs, media and personal assistant apps. This unique scalability creates a seamless in-cabin user experience both today and the future.
In addition, Aptiv’s Connected Secure Gateway provides the computing power necessary to enable all this high-speed data networking. It interfaces with both wired and wireless connections and is responsible for security and data collection, as well as, edge computing and analytics used by its end-to-end data services platform.
As an independent node on the architecture, the gateway enables the isolation of the hardware and software, thereby meeting the most stringent functional safety and cybersecurity standards in the industry.
High Speed Compute: UX Server, Connected Secure Gateway
With its high-speed computing platforms, advanced software algorithms and predictive analytics, Aptiv is unlocking new functionality and revolutionizing interior sensing with its scalable solutions that deliver a safer and differentiated in-cabin experience.
