Autonomous Vehicle Safety

Robotaxi and Autonomous Vehicle Safety

A full-stack, comprehensive safety system for robotaxis and AVs.

Overview

Safety, From the Cloud to the Car

NVIDIA Halos is a full-stack, comprehensive safety system that unifies safety elements across vehicle architecture, AI models, chips, software, tools, and services to ensure the safe development and deployment of robotaxis and autonomous vehicles (AVs), from cloud to car.

The system covers the full development lifecycle with design-time, deployment-time, and validation-time guardrails that collectively build safety and explainability into AI-based AV stacks. These guardrails are implemented using three powerful computers—NVIDIA DGX™ for model training, NVIDIA Omniverse™ and Cosmos™ for simulation, and NVIDIA DRIVE AGX™ for deployment. At the heart of the vehicle, NVIDIA Halos OS provides the unified software foundation necessary to bridge these AI capabilities with production-ready safety.

NVIDIA Halos complements existing industry-standard safety practices, while introducing unique elements for autonomous vehicles. This ensures regulatory compliance and advances safe and reliable AV stacks, together with NVIDIA’s  Halos AI Systems Inspection Lab.

Halos is also extending its comprehensive safety framework beyond AVs to robotics, further enhancing the reliability and safety of intelligent systems.

For Robotaxis, Safety Must Be Built In, Not Bolted On

NVIDIA Halos OS delivers a certified OS, standardized interfaces, AI guardrails, and pre-deployment validation for L4 robotaxi deployments at scale.

NVIDIA Launches Halos, a Full-Stack, Comprehensive Safety System for Autonomous Vehicles

NVIDIA unifies vehicle architecture to AI models; chips, software, and tools to services for safely developing AVs from cloud to car.

Highlights

Autonomous Vehicle Safety Leadership

NVIDIA Halos is the result of continuous investment in autonomous vehicle safety—from research to engineering to active engagement with international safety standards—validated by independent third-party assessments.

18,600+

Engineering years invested in vehicle safety to date

21 Billion+

Safety transistors safety assessed

7,000,000

Lines of safety-assessed code

2,000,000

Daily end-to-end integration tests for validation

22,000+

Platform safety monitors

20,000+

Hours of safety test data

1,000+

Patents filed

330+

Research papers published on AV safety

30+

Certificates and assessment reports issued

Technology

Engineered for Safety, Designed for Trust

As AV companies transition to AI-based, end-to-end architectures, NVIDIA Halos provides the critical safety foundation to ensure system-level reliability and iterative improvement for automated driving systems. This includes integration of third party-assessed hardware, software, and processes with a diverse algorithmic architecture and validation pipelines.

NVIDIA DGX

Design-time safety guardrails for built-in hardware/software safety and trustworthy development processes.

NVIDIA Omniverse With Cosmos

Validation-time guardrails for data generation, simulation, evaluation, and lifelong safety assurances.

NVIDIA DRIVE AGX

Deployment-time guardrails for run-time monitoring and real-time introspection.

Benefits

A Comprehensive System for Autonomous Vehicle Safety

NVIDIA Halos helps to ensure AI-driven AV systems are safe and secure. Partners can tap into NVIDIA’s investments in AI safety to accelerate development and enhance AV reliability. NVIDIA Halos is also open to developers, enabling adoption or customization of safety elements to drive the shared mission to create safe and reliable autonomous vehicle technology.

Design-time, deployment-time, and validation-time guardrails collectively build safety and explainability into several layers of technologies spanning platform safety, AI algorithmic safety, and ecosystem safety. 

At the top of the NVIDIA Halos elements sits the NVIDIA Halos AI Systems Inspection Lab, which allows customers and ecosystem partners to verify the safe integration of their products with NVIDIA Halos elements. The lab is the first worldwide program to be accredited by ANAB for AI functional safety.

Use Cases

A Full-Stack Comprehensive Safety System

NVIDIA Halos integrates foundational models and a diverse algorithmic stack, combining classical and AI-based, end-to-end models to drive system-level safety in the shift toward AI-driven AV architectures.

Platform Safety

The robust foundation for autonomous driving systems includes: 

  • A System-on-a-Chip (SoC) that’s designed for safety, with hundreds of built-in safety mechanisms.
  • NVIDIA Halos OS extends deployment-time safety into the vehicle software stack with certified core software, safe interfaces, and deterministic AI guardrails. See the Halos OS tab for full details.
  • A safety-assessed base platform that delivers the foundational safe computer needed to enable safe systems for all types of applications.
  • NVIDIA DRIVE Hyperion™,a diverse hardware platform that connects the SoC, OS, and sensors in a vehicle architecture. This enables a vehicle to safely execute contingency plans if needed.

Halos OS

NVIDIA Halos OS is a unified, production-ready software foundation for AI-driven vehicles, built on three in-vehicle software layers and a cloud-side infrastructure layer:

  • Halos Core, built on ISO 26262 ASIL D certified DriveOS™, with a hypervisor that isolates safety-critical functions from AI workloads and safety-certified support for CUDA™ and TensorRT™.
  • Halos SDK, a middleware layer with sensor and vehicle abstraction, deterministic scheduling, and zero-copy inter-process communication.
  • Halos Applications, rule-based safety guardrails for AI, including the NVIDIA DRIVE™ active safety stack (automatic emergency braking, lane departure warning, blind spot monitoring, collision warning), world model perception, and support for NVIDIA Alpamayo end-to-end models.
  • Halos Workflow is the cloud-side development infrastructure connecting NVIDIA DGX, NVIDIA Omniverse on OVX™, and NVIDIA AGX™ into a unified development lifecycle. It underpins the Halos Safety Evaluation Framework (SEF) — providing the tools and guidelines needed to build credible safety cases from L2 ADAS to L4 robotaxis.

Click image to enlarge

“Joining NVIDIA's Halos AI Systems Inspection Lab marks our commitment to advancing driving safety. By combining Bosch's comprehensive in-house ADAS sensor expertise with NVIDIA's AI validation framework, we're setting new standards for safe and reliable ADAS solutions.”

— Dennis Raabe, Senior Vice President ADAS Components, Bosch

“NVIDIA’s latest evaluation with ANAB verifies the demonstration of competence and compliance with internationally recognized standards, helping ensure that developers of autonomous machines—from automotive to robotics—can meet the highest benchmarks for functional safety.”

— R. Douglas Leonard Jr., Executive Director, ANAB

“Aligned with our shared mission to enhance safety, efficiency and productivity, we congratulate NVIDIA on the launch of its Halos AI Systems Inspection Lab. The Lab's reports will provide valuable insights to support our certification efforts.”

— Thomas Steffens, Head of Certification Body Functional Safety and Cybersecurity, TUV Rheinland

“We are pleased to hear of NVIDIA's commitment to advancing autonomous vehicle safety and welcome NVIDIA's Halos Inspection Lab efforts for structured and thorough development of AI for safety-relevant applications.”

— Dominik Strixner, Global Lead Functional Safety Auto and Mobility, TÜV Rheinland (automotive)

“UL Solutions is a global leader in applied safety science. We are pleased to announce our intent to collaborate with the NVIDIA Halos AI Systems Inspection Lab to harmonize testing activities and reports for companies who are pursuing safety certification with us.”

— Alex Dadakis, EVP, Chief Business Ops and Innovation, UL Solutions

“We are committed to fostering digital trust and delivering rigorous AI assurance at scale. By recognizing the inspection reports of the NVIDIA Halos AI Systems Inspection Lab, we’re supporting the industry’s move toward more transparent, reliable, and secure AI — while enabling developers to bring innovative systems to market faster and more safely.”

— Vincent Sabot, CEO, CertX

Algorithmic Safety

Algorithmic AI safety spans:

  • A diverse AV stack that combines a modular stack and NVIDIA Alpamayo reasoning VLA models for algorithmic AI safety.
  • Training, simulation, and validation environments that use NVIDIA Omniverse and Cosmos platforms to build safe AVs.
  • A separate safety dataset that ensures AV performance is tested against diverse, unbiased data.

Ecosystem Safety

Building a safer AV ecosystem includes:

  • Continual improvements through a safety data flywheel, which continually learns from the road how to expand the set of operational design domains for safe deployment.
  • Seamless integration of physically based and diverse sensor simulation into existing workflows to safely train, test, and validate AVs with the NVIDIA Omniverse Blueprint for AV Simulation.
  • Open-source data, such as the NVIDIA Physical AI Dataset, to enable critical safety research throughout the industry.
  • A growing list of partners using the NVIDIA Halos system, listed here.

Certification

Assessed by Experts

Independent third-party safety and cybersecurity assessments of NVIDIA Halos elements demonstrate NVIDIA’s ongoing commitment to AV safety.

ANSI National Accreditation Board

ANAB accredited the NVIDIA Halos AI Systems Inspection Lab as an ISO/IEC 17020 Inspection Body. NVIDIA is the first company accredited by ANAB for an inspection plan that combines cybersecurity, AI, and functional safety.

TÜV SÜD

TÜV SÜD certified the core NVIDIA hardware and software process to Automotive Safety Integrity Level (ASIL) D.  Under the ISO 26262 standard, NVIDIA DriveOS 6.0 is certified  ASIL D conformant and Thor-X SoC is assessed as ASIL D conformant. NVIDIA also received ISO/SAE 21434 Cybersecurity Process certification for its automotive system-on-a-chip, platform, and software engineering processes.

TÜV Rheinland

TÜV Rheinland performed an independent United Nations Economic Commission for Europe safety assessment of NVIDIA DRIVE AV related to safety requirements for complex electronic systems.

Research

NVIDIA Research for Autonomous Vehicles

Our research and development have published 330+ research papers on autonomous vehicle safety.

NVIDIA Halos Safety Evaluation Framework (SEF)

Provides tools and guidelines to build a credible safety case from L2 ADAS to L4 robotaxis, drawing on 330+ research papers and 1,000+ patents within NVIDIA Halos.

Alpamayo 1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tail

Comprehensive evaluations with open-loop metrics, closed-loop simulation, and real-world vehicle tests demonstrate that Alpamayo 1 is state-of-the-art in multiple aspects (including reasoning, trajectory generation, alignment, safety, latency, and more).

Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation With World Foundation Models

Collecting and annotating real-world data for safety-critical physical AI systems, such as Autonomous Vehicles (AVs), is time-consuming and costly. To address this challenge, we introduce the Cosmos-Drive-Dreams, a synthetic data generation (SDG) pipeline for generating challenging scenarios to facilitate downstream tasks such as perception and driving policy training.

SafeVL: Driving Safety Evaluation Using Meticulous Reasoning in Vision Language Models

Safety remains a fundamental challenge in autonomous driving, with a key step being the development of a safety evaluator that can reliably identify unsafe (i.e., collision-prone) scenarios.

Enhancing Autonomous Driving Safety With Collision Scenario Integration

HydraSafe is a framework that addresses the challenge of ensuring autonomous vehicle safety in hazardous scenarios by improving data availability and planner robustness.

Safety Evaluation of Motion Plans Using Trajectory Predictors as Forward Reachable Set Estimators

The advent of end-to-end autonomy stacks—often lacking interpretable intermediate modules—has placed an increased burden on ensuring that the final output, i.e., the motion plan, is safe in order to validate the safety of the entire stack.

For a list of additional AV Research papers, click here.

NVIDIA Alpamayo

Designed to handle real-world scenarios, Alpamayo accelerates safe Level 4 AV development by enabling reasoning-based autonomy through a family of open VLA models, physical AI datasets, and simulation frameworks.

Partners

Partners Using NVIDIA Halos System

Leading robotaxi companies, OEMs, industry safety pioneers, mapping and simulation companies, and software and sensor providers worldwide are using the system to deliver autonomous vehicle safety at all levels of automation.

Cars

Trucks

Robotaxis

Suppliers

Simulation

Sensors

Software

Mapping

Resources

The Latest in NVIDIA Halos Resources

Scaling Functionally Safe AVs With NVIDIA DriveOS and Hyperion

How do you scale autonomous vehicles to large fleets while meeting the world’s strictest safety standards? This livestream presented by NVIDIA safety experts shows how the DriveOS stack and Hyperion reference architecture solve the safety-scalability problem. 

Open Dataset for Autonomous Vehicle Safety Research

In this livestream, we showcase how the newly launched NVIDIA Alpamayo autonomous vehicles open dataset creates new opportunities to advance AV safety.

Accelerating Physical AI Certification With NVIDIA Halos

Learn about NVIDIA Halos AI Systems Inspection Lab—the first ANSI National Accreditation Board (ANAB)-accredited lab dedicated to physical AI systems.

Autonomous Vehicle Safety Validation Through Simulation

In this livestream, we present a general, theoretically grounded framework for AV safety validation whereby real-world tests are paired with simulated tests on corresponding reconstructed scenarios.

Next Steps

Redefining Safe Autonomy

Learn how cutting-edge AI, rigorous validation frameworks, and global standards are shaping autonomous vehicle safety.

Automotive News

Sign up for the latest news and updates from NVIDIA.

NVIDIA Automotive

NVIDIA solutions give you the performance and scalability to design, visualize, develop, and simulate the future of driving.

Read the NVIDIA Autonomous Vehicles Safety Report