simaaimrcnnboxcomposer2

This section describes the GStreamer plugin named simaaimrcnnboxcomposer2.

Brief Description

A plugin that performs DecodeBox + Filter Proposals and Feature Map Align operators.

• Dequantization - Dequant is added because of optimization reasons.

• Decode Boxes - Calculates BBox coordinates using Stage1 input and applying bbox_preds received from BoxHeadPredictor

• PreTopK - reducing number of boxes

• NMS - removing interceptions * TopK - reducing number of boxes

• Level Mapper - Calculates the feature map id for every bounding box

• Feature Map Align - Aligns the output of Box Composer (which is BBox structures) to the memory layout which is acceptable by ROI Align kernel

Config JSON Parameters

   {
 "version": 0.1,
 "node_name": "stg2_a65_mrcnn",
 "memory": {
   "cpu": 0,
   "next_cpu": 1
 },
 "system": {
   "out_buf_queue": 5,
   "debug": 0,
   "dump_data": 0
 },
 "buffers": {
   "input": [
     {
       "name": "stg1_a65_mrcnn",
       "size": 3616
     },
     {
       "name": "boxhead_MLA",
       "size": 139200
     }
   ],
   "output": {
     "size": 1216
   }
 },
 "anchors" : {
   "num_in_tensor" : 75,
   "num_of_tensors" : 4
 },
 "mla_output" : {
   "bbox_size" : 368,
   "score_size" : 96,
   "num_of_classes": 91
 },
 "filters": {
   "threshold": 0.05,
   "min_size": {
     "width": 1,
     "height": 1
   },
   "filter_by_class_id": 1,
   "class_ids": [1]
 },
 "limiter": {
   "width": 544,
   "height": 544
 },
 "nms": {
   "threshold": 0.35,
   "class_id_split" : 1,
   "split_shift": 1000
 },
 "pretopk": 300,
 "posttopk" : 25,
 "de_quant": {
   "q_zp_score": -71,
   "q_scale_score" : 8.728287302468107,
   "q_zp_bbox": 4,
   "q_scale_bbox" : 30.135475648217263
 }
}

Example Usage

... ! simaaimrcnnboxcomposer2 config="/data/simaai/applications/MaskRCNN/etc/mrcnn_stage2.json" name="mrcnn_stage2" ! ...

gst-inspect-1.0 Output

Plugin Details:
Name                     simaaimrcnnboxcomposer2
Description              SiMa.Ai Simaaimrcnnboxcomposer2 plugin
Filename                 libgstsimaaimrcnnboxcomposer2.so
Version                  1.18.16
License                  LGPL
Source module            gst-plugins-sima
Binary package           GStreamer SiMa.ai gstsimaaimrcnnboxcomposer2 Plug-in
Origin URL               https://bitbucket.org/sima-ai/gst-plugins-sima

simaaimrcnnboxcomposer2: SiMa.ai simaaimrcnnboxcomposer2 element

1 features:
+-- 1 elements

Note

Please refer to simaaimrcnnboxcomposer2’s README file for more information.