なぜ高忠実度のセンサーシミュレーションが AV 開発とテストに不可欠な理由

自動運転車(AV)はセンサーによって成り立っています。カメラ、LiDAR、レーダーは車両の“目と耳”として機能し、環境理解のために必要なデータを認識システムへ提供します。もしセンサーが誤作動したり、車載ソフトウェアがそれを誤解したりすれば、安全性が危険にさらされます。センサー性能やセンサーデータの(機能)安全性を現実世界のテストだけで保証するのはコストが非常に高くつきます。だからこそ、高忠実度なセンサーシミュレーションはもはや“オプション”ではありません。AV/ADAS システムを検証するための業界標準となっています。

センサーシミュレーションが不可欠な理由

長年、自動車業界は実走行テストにほぼ全面的に依存してきました。多様な天候、光、交通状況を収集するために、冬のテストにはドイツからフィンランド、またはデトロイトからカナダへ、暑い天候のてすとにはスペインやアリゾナへと何台もの車両が走行を行いました。この方法は、時間がかかり、費用が高く、不完全です。重要なシナリオの多くは発生頻度が低く、テスト車両では十分に収集できないこともあります。

この問題は、Tesla や Wayve が取り組むようなエンドツーエンド AI モデルの普及に伴いさらに大きくなっています。こうしたモデルはコンポーネントごとに検証することができず、センサーを含むフルスタックでのトレーニングとテストが必要になります。コストと開発期間を現実的に保つには、トレーニングとテストの大部分をシミュレーションに移行する必要があります。

従来のトレーニング/テストデータの限界

現実の走行データには多くの隠れた非効率性が伴います。

  • センサーの種類や取付位置が変わると、それまでのデータが無効になる
  • “LiDAR をルーフに載せる?” “バンパーに隠す?” といった議論が根拠不足で停滞
  • 変更のたびに同様の高コストの走行距離を再収集する必要がある

一方、シミュレーションであれば 同じシナリオを新しい条件で即座に再実行 できます。これは開発スピードを加速させ、設計上のトレードオフを迅速に解決するために極めて重要です。

センサーシミュレーションの優位性

高忠実度センサーシミュレーションは実走行では不可能な優位性を提供します:

  • 早期検証:フロントエンド設計が固まる前に仮想センサー配置を検証
  • テスト再利用:センサー構成が変わっても同じシナリオで再テスト可能
  • 設計の柔軟性:取付位置をバーチャルに比較して技術・デザイン要件の両立を支援
  • スケーラビリティ:低コストで圧倒的なテスト量を実現し、開発期間を短縮

最も重要なのは、センサーシミュレーションは単なる代替手段ではなく、現代の開発に必要なスピードと規模を唯一実現できる方法だということです。

センサー毎の相違(シミュレーションを困難にする要因)

各センサーは全く異なる動作特性を持ち、それがシミュレーションの難しさにつながります。

カメラ

  • 比較的シミュレーションしやすいが、リアリズムと計算性能が鍵
  • 眩光、霧、雨、反射などを“自然に”表現しなければ CV モデルは騙せない

LiDAR

  • 時間 flight / FMCW により高密度点群を生成
  • ノイズ・雨雪・波長依存の挙動の忠実再現が必要

レーダー

  • 最も複雑
  • ガードレール、濡れた路面、壁による多重反射が“ゴーストターゲット”を生成
  • これが追跡アルゴリズムを混乱させる
  • 高忠実度レーダーシミュレーションには極めて深いセンサーモデルが必要

Foretellix + NVIDIA:完全なツールチェーン

Foretellix の Foretify プラットフォームは、AI 駆動 AV スタックのトレーニング・検証・安全性評価のための Physical AI ツールチェーン です。

  • Foretify Generate:ODD をまたぐエッジケースを含む大規模な合成データ生成
  • Foretify Evaluate:現実世界の走行データとシミュレーション結果を統合し、カバレッジギャップを特定

さらに:

  • NVIDIA Omniverse、NuRec、Cosmos と統合
    → カメラ、LiDAR、レーダーの高忠実度センサーモデル
    → ログ走行データの“神経再構成(neural reconstruction)”により
    編集・再利用可能な仮想シーンへ変換
    → 天候、周囲車両、センサー配置などを変化させて再シミュレーション可能

これらを組み合わせることで、AV 開発者は トレーニングとテストを統合したデータ駆動型開発 を実現できます。

今後の展望

センサーシミュレーションはまだ普及初期ですが、
5 年以内にすべての自動車メーカーが日常的に利用するようになる と予測されます。

忠実度も急速に向上しており、多くのエッジケースが既にシミュレーション可能です。物理走行が完全になくなることはありませんが、訓練と検証の大部分は仮想空間へ移行するでしょう。

コスト圧力の増大、開発期間の短縮、エンドツーエンド AI への移行を背景に、
高忠実度センサーシミュレーションは不可欠な技術 となりました。

著者について

Sebastian Klaas – Foretellix プロダクトマネジメントディレクター
 Audi、Luminar、Samsung Semiconductor にて上級技術職を歴任。
KIT(カールスルーエ工科大学)でコンピュータサイエンスを専攻。

 

 

Additional content for you

Automated Map Construction from Vehicle Perception Data

Beyond NCAP: Achieving ADAS Safety in the Real World

シフト・レフト:コスト削減とAV開発加速のケーススタディ

開発コストの高騰と長期化するバリデーションサイクルに直面したレベル4自動運転車(AV)企業は、実走行に加えてシミュレーションを導入し、テスト戦略を近代化しました。従来は物理テストに大きく依存していましたが、この方法では先進的なAVプログラムに必要な複雑さ、安全性要件、スピードに対応できなくなっていました。...

Register to receive ALKS scenarios verification code examples

AI, Autonomy, V&V and Abstractions – Automating at Hyper Speed

Subscribe to our newsletter

Ziv Binyamini

CEO & Co-Founder

Ziv is a verification visionary and a passionate leader. Previously, Ziv served as Corporate VP at Cadence running the simulation and verification business. Through his career at Cadence, Verisity and Intel, Ziv led the development of verification businesses including chip simulation and Verification IP, industry first Coverage Driven Verification solutions and test bench products including Specman for chip verification and Perspec for SoC HW/SW verification.

Yoav Hollander

CTO & Founder

Yoav is a world expert and leader in complex systems expert verification and validation. he Invented the “e” verification language and related methodology (later followed by the UVM methodology). Yoav founded Verisity to deliver “e” and related tools. Verisity was acquired by Cadence Design Systems. In the last few years, Yoav has been researching complex-system verification.

Gil Amid

Chief Regulatory Affairs Officer, VP Operations & Co-founder

Gil is a former Vice President of Intel Corp. Gil has 30 years of experience working for Intel , in which he led the development of EDA and CAD tools in all design domains as well as leading VLSI design projects. In his recent years he was in charge of (among others) the verification tools development organization within Intel.

Jeni Osternik

Jeni Osternik

VP Product & Execution

Jeni is a versatile leader with over 17 years of experience spanning product management, operations, engineering, and business leadership. He leads the company’s product and delivery execution, ensuring the successful alignment of business, technology, and customer value. Before joining Foretellix, Jeni held management roles in the defense and homeland security sectors, where he led multidisciplinary teams and large-scale international programs, driving growth and innovation across complex technology ecosystems.

Vicky Revzin

HR & Global Employee Operations Director

Vicky Revzin – HR & Global Employee Operations Director

Ron Grossberg

VP R&D

Ron is an experienced manager and a passionate software engineer with more than 20 years of experience. Previously Ron managed a group in Algotec (now a Philips subsidiary), fully in charge of the development of complex medical imaging software used by radiologists in thousands of hospitals around the globe. Ron started his way in the IDF programming academy and technological units.

Roger Ordman

VP Marketing

Roger has over 20 years of global experience managing product, marketing and business development teams. Roger’s experience spans the networking, mobile and automotive industries previously serving as EVP of Marketing at Aurora Labs, and Marketing and Product Director at HARMAN. Roger is a frequent speaker on emerging trends in automotive software and holds an engineering degree in Industrial Management from Tel Aviv University.

Udi Jacobi

Udi Jacobi

Chief Commercial Officer

Udi has over 20 years of commercial leadership experience, managing and growing businesses throughout the USA, Europe, and APAC. His experience spans a broad range of industries and disciplines, including Automotive, New Media, and Digital Transformation. Prior to joining Foretellix, Udi founded and successfully grew Brightcom Media into a multi-million-dollar profitable business.

Doron Ilan

CFO

Doron is an experienced CFO with over 20 years in corporate finance, in various private and public companies. As the CFO of 012 Smile Telecom [Nasdaq: BCOM], he led the company’s successful NASDAQ IPO, and later, as the CFO of SuperCom [SPCB] executed an M&A process and a public offering on NASDAQ. In recent years he was the CFO of Xfone, an Israeli telecom provider.

Sharon Rosenberg

Solution Architect & Chief Methodologist

Sharon has over two decades of experience in the verification and validation of highly complex systems. He is the author of two landmark verification & validation textbooks and a key contributor to ASAM OpenSCENARIO® 2.0.

Mike Stellfox

Head of Methodology

Mike is a world expert in advanced verification methodologies and solutions. He has spent more than twenty-five years working with customers around the world on solutions to address their verification challenges in a wide range of industries from Automotive and Autonomous Transport, to Mobile and Hyperscale Computing, to Aerospace and Defense. Before joining Foretellix, Mike was a Fellow at Cadence where he helped transform the semiconductor industry’s approach to verification, based on the automated verification solutions he helped pioneer at Verisity in the early 2000s. Mike started his career at IBM as a VLSI Chip Designer.

Alex Hitzinger

CEO & Co-Founder

Alex started his automotive career at Toyota Motorsport before joining Cosworth and Red Bull Technology. Hitzinger then joined Porsche as Technical Director and Chief Engineer of Porsche 919, which won the 24 Hours of Le Mans in 2015. He spent three years at Apple as Head of Product Design for Project Titan. Most recently, Hitzinger served as Senior Vice President of Autonomous Driving at VW Group and Member of the Executive Board VWN, where he was involved in developing the ID Buzz. He also served as Chief Executive Officer of Artemis GmbH, where he was the Chief Architect of the revolutionary new vehicle concept for next-generation autonomous mobility for their flagship-product Audi Landjet.

Moshe Gavrielov

Chairman of the Board

Moshe Gavrielov last served as the President and CEO of Xilinx from 2008-2018, during which the company delivered three successive generations of technology leadership. These yielded revenue growth to over $2.5B, significantly increased profitability, and market share expansion. As a result market capitalization quadrupled during his tenure and approached $20B. Prior to that Moshe was the CEO of Verisity, delivered revenue growth to over $70M while leading its successful IPO in 2001 and led its sale to Cadence for $315M in 2005. Prior to Verisity, Moshe served in numerous executive management roles in LSI Logic, Digital Equipment and National Semiconductor.

Boaz Schwartz

Chairman of the Board

Boaz Schwartz is a seasoned finance professional and a tech investor. Dr. Schwartz has founded and managed Deutsche Bank Israel for 24 years and until December 2020. Following his retirement from Deutsche Bank, Boaz has become an active tech investor in both early and late-stage companies. Dr. Schwartz is a board member of IDC Herzliya, iArgento Ltd and the vice-Chairman of Zabar Solar Ltd. He earned a Ph.D in Finance from the University of Chicago; MBA with Distinction from the Wharton School at the University of Pennsylvania; MSc and BSc in Electrical Engineering from the University of Tel Aviv.

Gil Goren

CEO & Co-Founder

Gil Goren joined 83North in 2016, after more than a decade at EMC in a variety of roles in Boston and Tel Aviv. At his last role as SVP & Managing Partner at EMC Ventures he managed strategic partnerships Investments and M&A internationally. Prior investments include Anobit (acquired by Apple), XtremIO & ScaleIO (both acquired by EMC), Cyvera & Secdo (both acquired by Palo Alto Networks), Adallom (acquired by Microsoft), CloudEndure (acquired by Amazon) Jfrog, RedisLabs, Guardicore and VastData among others. Currently on the boards of VDOO, Foretellix, and IBEX. He has B.SC in Electrical Engineering from the Technion and MBA from Boston University.

Glen De Vos

Mr. De Vos has over 30 years of senior leadership experience in automotive and industrial technology sectors, particularly around autonomy and mobility. In his career he has held a number of leadership roles at Aptiv and its predecessor Delphi Automotive. Positions included Chief Technology Officer and President of the Advanced Safety and User Experience business unit. He currently serves as the CEO of MicroVision, Inc.

Mark Mohr

VP Global Sales & Business Development

Since March 2021 Mark is SVP of Vehicle Technology at Volvo Group Truck Technology. Before he was Head of Development Commercial Vehicle Division at ZF Friedrichshafen AG. In this role, Mark’s main was on driver assistance systems automation, new hardware, and software architectures besides the classical driveline and chassis business. Since his Ph.D. in Mechanical Engineering from the Technical University Kaiserslautern, Germany, he has a long experience in simulation and digital engineering.

Carl-Peter Forster

VP Global Sales & Business Development

Carl-Peter Forster started his career at McKinsey & Company as a management consultant in 1982. After four years there, he joined BMW in Munich, where he became a member of the Executive Board in 1999 as head of global manufacturing. In 2001, he joined the European division of General Motors and became Managing Director of Opel and Vice President of GM Europe. In 2006 he became CEO and President of GM Europe and joined the parent company’s Global Automotive Strategy Board. After leaving General Motors, he became Group CEO at Tata Motors, where he was responsible for the Jaguar and Land Rover brands. In 2013, he joined the boards of Geely Automotive Holdings and Volvo Cars.

Eran Sandhaus

Eran recently led Delphi Automotive’s (now Aptiv) Autonomous Driving and Connected Services business unit, overseeing global engineering teams, business staff and wholly owned subsidiaries focused on providing hardware, software, algorithms and cloud services to transform future mobility. Prior to Delphi, Eran was a senior executive for over 20 years in Fortune 500 companies including Qualcomm, Cypress, Texas Instruments and Marvell. During this period Eran led global businesses, operations and M&A focused on server communications, storage, mobile handsets and Internet-of-Things (IoT) for consumer, automotive and industrial applications.

Benny Schnaider

Benny Schnaider is a high-tech serial entrepreneur. Benny co-founded Ravello Systems and served as its President and Chairman. The company has developed an over-the-top cloud services. Since Ravello acquisition by Oracle in 2016, Benny serves as VP SW development for Oracle-Ravello. Previously, Benny co-founded and was the CEO Qumranet (KVM), acquired by Red Hat in 2008. Co-founded P-Cube, acquired by Cisco in 2004. Benny was the CEO and Founder of PentaCom Ltd., acquired by Cisco in 2000. Benny invests and serves as a board member in several startups like: Traffix Systems (acquired by F5 in 2012) and B-Hive (acquired by VMware in 2008), ScyllaDB, Otonomo, Colabo, CathWorks.

Book A Meeting