vits14-postproc-overlay ======================= .. py:module:: vits14-postproc-overlay Attributes ---------- .. autoapisummary:: vits14-postproc-overlay.log_file_path vits14-postproc-overlay.logger vits14-postproc-overlay.INPUT_HEIGHT vits14-postproc-overlay.INPUT_WIDTH vits14-postproc-overlay.OUTPUT_WIDTH vits14-postproc-overlay.OUTPUT_HEIGHT vits14-postproc-overlay.plugin_name Classes ------- .. autoapisummary:: vits14-postproc-overlay.MyPlugin Module Contents --------------- .. py:data:: log_file_path :value: '/var/log/simaai.log' .. py:data:: logger .. py:data:: INPUT_HEIGHT :value: 224 .. py:data:: INPUT_WIDTH :value: 224 .. py:data:: OUTPUT_WIDTH :value: 1280 .. py:data:: OUTPUT_HEIGHT :value: 720 To use Metadata fieds from the input buffers: Parse the MetaStruct object. It has the following 4 fields: class MetaStruct: def __init__(self, buffer_name, stream_id, timestamp, frame_id): self.buffer_name = buffer_name self.stream_id = stream_id self.timestamp = timestamp self.frame_id = frame_id .. py:data:: plugin_name :value: 'vits14-postproc-overlay' .. py:class:: MyPlugin A Python based gstreamer plugin template. Enables the user to: - Accept incoming buffers from dynamic pads - Define any custom plugin runtime logic User has to only override the run() function .. py:attribute:: frame_id :value: 0 .. py:attribute:: out_width_aligned :value: 1280 .. py:attribute:: out_height_aligned :value: 720 .. py:attribute:: outsize :value: 1382400.0 .. py:method:: round_up_to_multiple(value, base=8) .. py:method:: softmax(logits) .. py:method:: postprocess(tensor: numpy.ndarray) -> list .. py:method:: get_nv12(image: numpy.ndarray) -> numpy.ndarray .. py:method:: label_image(image: numpy.ndarray, result: list) -> numpy.ndarray .. py:method:: run(input_buffers: List[python_plugin_template.SimaaiPythonBuffer], output_buffer: bytes) -> None Input: input_buffers: List[Gst.Buffer] List of input buffers, source from each pad. output_buffer: Gst.Buffer Output buffer that needs to be overwritten. Implement your logic within this function. Process the input buffers, and modify the output buffer.