Main Content

Image and Video Ground Truth Labeling

Interactive image and video labeling for object detection, semantic segmentation, instance segmentation, and image classification

Use the Image Labeler and Video Labeler apps to interactively label ground truth data in a collection of images, a video, or a sequence of images. You can label rectangular regions of interest (ROIs) or polylines for object detection, pixels for semantic segmentation, polygons for instance segmentation, and scenes for image classification. The apps also include computer vision algorithms to automate the labeling of ground truth data for use with detection and tracking algorithms. They also provide an API and workflow that enables you to import your own algorithms to automate the labeling of ground truth data.

To get started labeling a collection of images, see Get Started with the Image Labeler. To get started labeling a video or sequence of images, see Get Started with the Video Labeler.

Apps

Image LabelerLabel images for computer vision applications
Video LabelerLabel video for computer vision applications

Functions

expand all

Load Data

groundTruthDataSourceObject for storing ground truth data sources
pixelLabelDatastoreDatastore for pixel label data
boxLabelDatastoreDatastore for bounding box label data
groundTruthGround truth label data

Create Label Definitions

labelDefinitionCreatorObject for storing, modifying and creating label definitions table
create Create label definitions table from the label definition creator object
infoDisplay information about a label, sublabel, or attribute stored in label definition creator object

Add

addLabelAdd label to label definition creator object
addSublabelAdd sublabel to label in label definition creator object
addAttributeAdd attributes to label or sublabel in label definition creator object

Edit

editLabelGroupModify a label group name
editGroupNameChange group name
editLabelDescriptionModify description of label or sublabel in label definition creator object
editAttributeDescriptionModify description of attribute in label definition creator object

Remove

removeLabelRemove label from label definition creator object
removeSublabelRemove sublabel from label in label definition creator object
removeAttributeRemove attribute from label or sublabel in label definition creator object

Action Flags

initializeInitialize state for algorithm execution (optional)
runRun label automation on every frame in interval
terminateTerminate automated algorithm (optional)

Validation

checkSetupSet up validation (optional)
checkLabelDefinitionValidate label definition

Algorithm

vision.labeler.AutomationAlgorithmInterface for algorithm automation in ground truth labeling
settingsDialogDisplay algorithm settings (optional)
vision.labeler.mixin.TemporalMixin interface for adding temporal context to automation algorithms
vision.labeler.mixin.BlockedImageAutomationMixin interface for performing blocked image automation
blockedImageAutomationAlgorithmImplements the blocked image automation algorithm
supportsReverseAutomationSet reverse algorithm automation flag

Store Data

groundTruthGround truth label data
pixelLabelDatastoreDatastore for pixel label data
boxLabelDatastoreDatastore for bounding box label data
changeFilePathsChange file paths in ground truth data
writeVideoScenesWrite video sequence to video file
sceneTimeRangesTime ranges of scene labels from ground truth data
gatherLabelDataGather label data from ground truth

Select Labels

selectLabelsByGroupSelect ground truth labels by label group
selectLabelsByTypeSelect ground truth labels by label type
selectLabelsByNameSelect ground truth labels by label name

Enumerate Attribute and Label Types

attributeTypeAttribute type enumerations for labeling
labelTypeLabel type enumerations for labeling

Create Training Data for Object Detectors

objectDetectorTrainingDataCreate training data for an object detector
pixelLabelTrainingDataCreate training data for semantic segmentation from ground truth
polyToBlockedImageCreate labeled blockedImage object from set of ROIs

Topics

Get Started

Load Ground Truth Data Sources

Label Ground Truth

Automate Labeling

Use Ground Truth Labels