Amsterdam-based Here Technologies, a developer of intelligent mapping and location technologies, today announced the release of a software development kit that uses machine learning and artificial intelligence to transform any front-facing camera or dashcam into a driver safety tool.

Currently in beta, the Here Live Sense SDK uses AI and ML to provide real-time insights into road safety helping them make potentially split-second informed decisions about upcoming obstacles, road infrastructure or driving conditions without the need for cloud processing or network connectivity.

“Driver safety is paramount in everything we do,” said Angel Mendez, chief operating officer of Here. “Today there are still millions of commercial and passenger cars on the roads without the necessary technology to keep drivers informed about potential hazards. The Here Live Sense SDK will help to change that.”

Using the power of AI and machine learning, Here Live Sense can turn any front-facing cameras, including smartphones, dashcams or vehicle cameras, into highly intelligent vehicle sensors.

Similar systems, such as those developed for self-driving cars or by companies such as Bosch GmbH, use specialized camera systems coupled with external sensors such as ultrasound and radar for road safety. Here’s solution is designed to transform any camera, including consumer dashcams, into safety equipment.

The software continuously scans the driver’s environment using the camera to detect objects on the road, such as other vehicles, pedestrians or cyclists, road infrastructure such as traffic lights and road signs and other potential hazards such as potholes, road closures and construction zones.

Based on what the system detects, the system can inform the driver through a number of visual, audio and other cues designed to allow the driver ample time to act on that information and make an informed decision. All of this happens in real time within the device itself, without the need for data processing in the cloud or network connectivity.

The Here Live Sense SDK will also have the ability to connect to an on-board map and detect changes from previous trips. For example, it could inform a driver of speed limit changes or lane closures.

“It detects objects, behavioral changes and road conditions that can lead to such situations and notifies drivers in time to take action,” said Mendez.

The Here Live Sense SDK includes a number of detection models accessible to developers who can then develop user interface systems to talk to drivers through numerous media, such as car dashboard systems, speakers, projectors and other in-vehicle information systems.

Models include the detection and classification of objects on the road; recognition and notification of braking vehicles, pedestrians and bicycles; detection of unexpected road hazards along the way, including changing conditions, road closures, not yet known to the map, construction zones and road work; and reading road signs such as speed limits, which can be compared to known maps to warn drivers if speed signs have changed even if the map has not been updated.

Using the SDK, developers can implement these models into application software and hardware devices, providing customers will the full suite of AI capabilities. The SDK has been created to benefit all drivers from everyday customers to fleet operators for taxi services and enterprise shipping. It’s available for all automotive hardware makers, fleet and ride hail operators and app developers.

Further information is available at the Here Developer Portal. The company also plans to release an iOS version soon.

Image: Pixabay