MASK_FILTERING

Table of Contents

Introduction

Plugin usage - to get correct mask from the MLA which return mask prediction to the proper class id and concat it with the corresponding bbox.

Features

Getting Started

To build the plugin use:

source /opt/poky/4.0.10/environment-setup-cortexa65-poky-linux
mkdir build && cd build && cmake .. && make

Prerequisites

  • Yocto SDK installed

Installation

For manual installation:

scp libgstsimaaimask_filtering.so sima@<IP address of DaVinci board>:/data/my_pipeline/libs

Usage

Example of usage:

GST_DEBUG=2 gst-launch-1.0 --gst-plugin-path=/data/simaai/applications/Mask_RCNN/lib simaaisrc location=/data/ev_kernel.out delay=1000 ! mask_filtering config="/data/mask_filtering_config.json" ! fakesink

Configuration

Configuration example:

{
  "version": 0.1,
  "node_name": "mask_filtering",
  "memory": {
    "cpu": 0, <================================================== NOT USED
    "next_cpu": 0 <============================================== Memory type used by allocator. 0 means A65 memory will be used
  },
  "system": {
    "out_buf_queue": 1,
    "debug": 0, <================================================ NOT USED
    "dump_data": 0 <============================================= Dump the output buffer into file at /tmp
  },
  "buffers": {
    "input": [
      {
        "name": "bbox", <======================================== Input buffer 0 name
        "size": 604     <======================================== Input buffer 0 size
      },
      {
        "name": "masks", <======================================= Input buffer 1 name
        "size": 28537600 <======================================= Input buffer 1 size
      }
    ],
    "output": {
      "size": 362400 <=========================================== Output buffer size
    }
  },
  "num_of_classes": 90 <========================================= Number of classes based on coco_labels.txt
}

Contributing

License

Acknowledgments