Skip to content

Draft: onnx: add overlay renderer to display bounding boxes and associated text

Aaron Boxer requested to merge boxerab/gstreamer:onnx-over into main

image

This MR adds a pango-based element onnxoverlayrenderer to render bounding box and label meta data generated by the onnxobjectdetector element. See ONNX MR for more details on onnxobjectdetector.

Sample pipeline:

uridecodebin  uri=file:///crowd_people_in_city_town.mp4  !
videoconvertscale !
onnxobjectdetector 
box-node-index=0
class-node-index=1
score-node-index=2
detection-node-index=3
execution-provider=cpu
model-file=onnx-runtime-examples/data/models/model.onnx  label-file=onnx-runtime-examples/data/labels/COCO_classes.txt  ! 
onnxoverlayrenderer !
videoconvertscale !
autovideosink
Edited by Aaron Boxer

Merge request reports