Main Content

Choose a Sensor for Unreal Engine Simulation

In Automated Driving Toolbox™, you can obtain high-fidelity sensor data from a virtual environment. This environment is rendered using the Unreal Engine® from Epic Games®.

Simulating models in the 3D visualization environment requires Simulink® 3D Animation™.

The table summarizes the sensor blocks that you can simulate in this environment.

Sensor BlockDescriptionVisualizationExample

Simulation 3D Camera

  • Camera with lens that is based on the ideal pinhole camera. See What Is Camera Calibration?

  • Includes parameters for image size, focal length, distortion, and skew

  • Includes options to output ground truth for depth estimation and semantic segmentation

Display camera images by using a Video Viewer or To Video Display block. Sample visualization:

Sample camera visualization

Design Lane Marker Detector Using Unreal Engine Simulation Environment

Display depth maps by using a Video Viewer or To Video Display block. Sample visualization:

Sample depth visualization

Depth and Semantic Segmentation Visualization Using Unreal Engine Simulation

Display semantic segmentation maps by using a Video Viewer or To Video Display block. Sample visualization:

Sample semantic segmentation visualization

Depth and Semantic Segmentation Visualization Using Unreal Engine Simulation

Simulation 3D Fisheye Camera

  • Fisheye camera that can be described using the Scaramuzza camera model. See Fisheye Calibration Basics

  • Includes parameters for distortion center, image size, and mapping coefficients

Display camera images by using a Video Viewer or To Video Display block. Sample visualization:

Sample fisheye camera visualization

Simulate Simple Driving Scenario and Sensor in Unreal Engine Environment

Simulation 3D Lidar

  • Scanning lidar sensor model

  • Includes parameters for detection range, resolution, and fields of view

Display point cloud data by using pcplayer within a MATLAB Function block. Sample visualization:

Sample pcplayer point cloud visualization

Design Lidar SLAM Algorithm Using Unreal Engine Simulation Environment

Display lidar coverage areas and detections by using the Bird's-Eye Scope. Sample visualization:

Sample Bird's-Eye Scope point cloud visualization

Visualize Sensor Data from Unreal Engine Simulation Environment

Simulation 3D Probabilistic Radar

  • Probabilistic radar model that returns a list of detections

  • Includes parameters for radar accuracy, radar bias, detection probability, and detection reporting

Display radar coverage areas and detections by using the Bird's-Eye Scope. Sample visualization:

Sample Bird's-Eye Scope radar visualization

Simulate Vision and Radar Sensors in Unreal Engine Environment

Visualize Sensor Data from Unreal Engine Simulation Environment

Simulation 3D Vision Detection Generator
  • Camera model that returns a list of object and lane boundary detections

  • Includes parameters for detection accuracy, measurement noise, and camera intrinsics

Display vision coverage areas and detections by using the Bird's-Eye Scope. Sample visualization:

Sample Bird's-Eye Scope vision visualization

Simulate Vision and Radar Sensors in Unreal Engine Environment

Simulation 3D Ultrasonic Sensor
  • Ultrasonic sensor model that returns detections as range values.

  • Includes range parameters for object-only detection reporting as well as object and range detection reporting.

Display ultrasonic range coverage areas and range detections by using the Bird's-Eye Scope. Sample visualization: Sample Bird's-Eye Scope ultrasonic sensor visualization

Build Occupancy Map Using Simulation 3D Ultrasonic Sensor

See Also

Blocks

Related Topics