simaaimrcnnmaskfiltering

This section describes the GStreamer plugin named simaaimrcnnmaskfiltering.

Brief Description

This plugin is used to get the correct mask from the MLA which returns mask prediction to the proper class ID and concatenates it with the corresponding BBOX.

Config JSON Parameters

{
  "version": 0.1,
  "node_name": "mask_filtering",
  "memory": {
    "cpu": 0, <================================================== NOT USED
    "next_cpu": 0 <============================================== Memory type used by allocator. 0 means A65 memory will be used
  },
  "system": {
    "out_buf_queue": 1,
    "debug": 0, <================================================ NOT USED
    "dump_data": 0 <============================================= Dump the output buffer into file at /tmp
  },
  "buffers": {
    "input": [
      {
        "name": "bbox", <======================================== Input buffer 0 name
        "size": 604     <======================================== Input buffer 0 size
      },
      {
        "name": "masks", <======================================= Input buffer 1 name
        "size": 28537600 <======================================= Input buffer 1 size
      }
    ],
    "output": {
      "size": 362400 <=========================================== Output buffer size
    }
  },
  "num_of_classes": 90 <========================================= Number of classes based on coco_labels.txt
}

Example Usage

GST_DEBUG=2 gst-launch-1.0 --gst-plugin-path=/data/simaai/applications/Mask_RCNN/lib simaaisrc location=/data/ev_kernel.out delay=1000 ! mask_filtering config="/data/mask_filtering_config.json" ! fakesink

gst-inspect-1.0 Output

 1Plugin Details:
 2Name                     simaaimrcnnmaskfiltering
 3Description              GStreamer SiMa.ai Simaaimrcnnmaskfiltering Plugin
 4Filename                 ./libgstsimaaimrcnnmaskfiltering.so
 5Version                  1.18.16
 6License                  LGPL
 7Source module            gst-plugins-sima
 8Binary package           GStreamer SiMa.ai gstsimaaimrcnnmaskfiltering Plug-in
 9Origin URL               https://bitbucket.org/sima-ai/gst-plugins-sima
10
11simaaimrcnnmaskfiltering: SiMa.AI Simaaimrcnnmaskfiltering Plugin
12
131 features:
14+-- 1 elements

Note

Please refer to simaaimrcnnmaskfiltering’s README file for more information.