Logo

Getting Started

  • System Architectures
  • SiMa.ai DevKit
    • Set up DevKit in PCIe Mode
    • Set up DevKit in Standalone Mode
      • Configure Serial Connection
      • Configure DevKit Network
    • Firmware Update
      • Update with Direct File Copy
      • Update with Palette
  • Hello SiMa!
    • Application Pipeline
      • A Typical ML Application
      • ML Preprocessing and Postprocessing
      • ResNet50 Classification Application
      • Mapping the ResNet50 Application to the MLSoC
      • Tesselation and Quantization
    • Run Demos
    • Compile Your Model
    • Build Your First Pipeline
      • Build with Edgematic
      • Build with Palette
      • PCIe Pipeline Adaptation
      • Run Multiple (Concurrent) Pipelines

Pipeline Development

  • Palette
    • Software Overview
      • Palette Components
        • ModelSDK
        • Palette CLI / MPK
        • GStreamer Plugin Zoo
        • MLA Compiler
        • Debugging and Logging
        • Arm Cross-Compiler
      • Development Flow
    • System Requirements
      • CPU, Memory, and Storage
      • Operating Systems
      • Palette SDK / MLSoC Firmware
      • Docker Engine
      • Python
      • Ports
      • Firewall Settings
      • SSH Capabilities
    • Software Installation
      • Installation Requirements
      • Downloading Palette Software
      • Installing on Linux
        • Dependencies Checklist
        • Installing the Software
        • Running/Launching Software
        • Verifying the Installation
      • Installing on Windows using Hyper-V
      • Uninstalling the Palette Software
    • Get Model FPS
      • Executing Model Files using Network Evaluation
        • Verifying Runtime Statistics
    • Get Model Accuracy
      • PyTorch ResNet50-1.5v
        • Preprocessing and Dataset
        • PyTorch Inferencing
      • Compiling ResNet50-1.5v
      • Model Accelerator ResNet50-1.5v
      • Running the Example
    • MPK Tool
      • Device Connectivity using mpk
      • mpk device
        • More Options
      • mpk create
      • mpk project create
      • mpk deploy
      • mpk launch
      • mpk list
      • mpk kill
      • mpk remove
      • mpk firmware-upgrade
      • Performance Estimator
    • MLPerf Benchmark
      • Accessing the MLPerf Files
      • Running MLPerf Tests
        • Batch1 Performance Mode Test
        • Batch1 Accuracy Mode Test
        • Batch8 Performance Mode Test
        • Batch8 Accuracy Mode Test
        • Batch14 Performance Mode Test
        • Batch14 Accuracy Mode Test
  • Edgematic 🔥
    • Introduction to Edgematic
      • Key Features
      • Benefits
      • Getting Started
        • Layout
    • Terminology
    • Edgematic Dashboard
    • Edgematic Features
      • Machine Learning Models
      • GStreamer Pipelines
      • GStreamer Plugins
      • Applications
      • KPI Measurement
    • Building Applications
      • Image File Inferencing
      • RTSP Video Stream Inferencing
    • Application Catalog
      • Developer Community Applications
      • SiMa-Provided Applications
    • Model Catalog
      • Image Classification Models
      • Object Detection Models
      • Pose Estimation Models
      • Depth Estimation Models
      • Anomaly Detection & Feature Extraction
    • Plugin Catalog
      • simaaidecoder
      • simaaiencoder
      • simaaiedetmemory
      • nms
        • Features
        • Usage
        • Configuration
      • nmsyolov5
        • Features
        • Usage
        • Configuration
      • overlay_v2
        • Description
        • Configuration
      • regressboxes
        • Features
        • Configuration
      • simaai_color_converter
        • Configuration
      • simaai_muxer
        • Configuration
      • simaai_resize
        • Features
        • Configuration
      • simaaibufferconcatenator
        • Configuration
      • simaaimetaparser
        • Direct Mode (Primary)
        • Header Parsing Mode (Fallback)
        • Configuration
      • simaaisrc
        • Parameters
        • Configuration
      • transform_anchors
        • Features
        • Usage
        • Configuration
      • yolov8boxcomposer
        • Features
        • Usage
        • Configuration
  • Develop with GStreamer
    • Key Components
    • Plugins
    • Development Workflow
    • Key Features
      • CAPS Negotiation
      • GStreamer Application
        • Features
        • Components
        • Usage
  • Develop with PePPi
    • Installation
    • Typical Workflow
    • Code Example
    • Build and Deploy
    • Sample Pipelines
      • YOLOv8 on RTSP Stream
        • Purpose
        • Configuration Overview
        • Main Python Script
        • Model Details
      • YOLOv7 Inference over PCIe
        • Purpose
        • Configuration Overview
        • Main Python Script
        • Model Details
      • PeopleDetector on RTSP Stream
        • Purpose
        • Configuration Overview
        • Main Python Script
        • Model Details
      • YOLOv7 on RTSP Stream
        • Purpose
        • Configuration Overview
        • Main Python Script
        • Model Details
      • Effdet on RTSP Stream
        • Purpose
        • Configuration Overview
        • Main Python Script
        • Model Details
      • Multimodel Demo
        • Purpose
        • Configuration Overview
        • Main Python Script
        • Model Details
      • DETR on RTSP Stream
        • Purpose
        • Configuration Overview
        • Main Python Script
        • Model Details
  • ModelSDK
    • Model Compatibility Guide
      • Terminology
      • Supported Operations
        • Custom Implementation
      • Unsupported Operators
      • A65 Supported Operators
      • MLA Supported Operators
      • Individual Operators
    • ONNX Operators Support List
    • Post Training Quantization
      • load_model
      • quantize
        • with_custom_quantization_configs()
        • LoadedNet.convert_to_sima_quantization()
        • Model.analyze_quantization_error()
        • Model.execute_in_accelerator_mode()
      • compile
        • Compile with Default Options
        • Compiling for Batch Sizes > 1
        • Printing tar.gz Contents
        • Per-Layer Runtime Statistics
    • Quantization Aware Training
      • Pre-requisites
      • QAT Process
      • QAT Workflow
      • Model Training Process
        • Scaffolding
        • Finalization
        • Export
        • Training Loop
        • PyTorch Integration
        • User API
    • Graph Surgery
      • What is Graph Surgery
      • Why Do You Need to Perform Graph Surgery
      • Graph Surgery Using SiMa Tools
        • Analyzing a Model
        • ONNX Model
      • Example Case Studies
        • UFLD: Simple Operator Replacement
        • YoloV8: Output to be Modified
        • Post Processing
        • ViT-s14
        • Pre-Processing
        • Post-Processing

App Development

  • PCIe Mode App
    • Build Host App With C++ API
  • Standalone Mode App
    • Cross Compilation Environment
    • Build Custom C/C++ App
    • Build Third-Party Component
    • Run Pipeline without MPK Tools
    • Understand the MPK Package

References

  • PCIe Mode Host APIs
    • C++ API
      • simaai::SimaMlsocApi
        • setLogVerbosity()
        • enumerateDeviceGuids()
        • openDevice()
        • load()
        • load()
        • load()
        • unload()
        • isAppActive()
        • isAppActive()
        • isDeviceOpen()
        • runSynchronous()
        • runAsynchronous()
        • closeDevice()
        • resetDevice()
        • log()
        • getLastErrorCode()
        • setMaxOutstandingRequests()
        • getMaxOutstandingRequests()
        • setRequestTimeout()
        • getRequestTimeout()
        • resetQueue()
        • SimaMlsocApi()
        • operator=()
        • SimaMlsocApi()
        • operator=()
        • getInstance()
      • simaai::SiMaDevice
        • slotNumber
        • deviceType
        • guid
      • simaai::SiMaModel
      • simaai::SiMaTensor
        • SiMaTensor()
        • reset()
        • SiMaTensor()
        • reset()
        • getPtr()
        • getShape()
        • getSizeInBytes()
        • getSeqId()
        • getAppId()
        • setSeqId()
        • setAppId()
    • Python API
      • sima_host
        • Attributes
        • Classes
        • Functions
        • Module Contents
  • ModelSDK APIs
    • afe.apis.model
      • Classes
      • Module Contents
        • Model
    • afe.apis.loaded_net
      • Attributes
      • Classes
      • Functions
      • Module Contents
        • GroundTruth
        • LoadedNet
        • load_model()
    • afe.load
      • Submodules
        • afe.load.importers
        • afe.load.loader
    • afe.apis.defines
      • Attributes
      • Classes
      • Functions
      • Module Contents
        • InputValues
        • gen1_target
        • gen2_target
        • ExceptionFuncType
        • ColorSpaceStandard
        • BT_COLOR_COEFF
        • YUV2RGB_FULL_RANGE_CONSTANTS
        • ColorConversion
        • ChromaSampling
        • ResizeMethod
        • ResizeDepositLocation
        • CalibrationMethod
        • MinMaxMethod
        • HistogramMSEMethod
        • MovingAverageMinMaxMethod
        • HistogramEntropyMethod
        • HistogramPercentileMethod
        • default_calibration()
        • QuantizationScheme
        • quantization_scheme()
        • bfloat16_scheme()
        • QuantizationParams
        • default_quantization
        • int16_quantization
    • sima_qat.qat_api
      • Attributes
      • Classes
      • Functions
      • Module Contents
        • device_modifier_ops
        • sima_prepare_qat_model()
        • sima_finalize_qat_model()
        • sima_export_onnx()
        • SimaQatWrapper
        • check_graph_nodes()
        • replace_dropout()
        • replace_batchnorm()
    • onnx_helpers
      • Classes
      • Functions
      • Module Contents
        • ModelSplit
        • update_model_version()
        • remove_infer_shape()
        • load_model()
        • save_model()
        • run_model()
        • verify_models_equal()
        • verify_models_close()
        • extract_model()
        • split_model()
        • verify_split_models()
        • merge_model()
        • merge_split_model_with_shared_constant()
        • find_node()
        • find_node_output()
        • find_node_input()
        • make_node()
        • remove_node()
        • insert_node()
        • replace_node()
        • set_attribute_to_node()
        • remove_nodes_by_name_list()
        • insert_transpose_pair()
        • rewrite_matmul_as_conv()
        • rewrite_matmul_as_einsum()
        • insert_slices_after_node()
        • insert_concat()
        • insert_slices_concat_between_nodes()
        • rewrite_gemm_as_conv()
        • connect_nodes()
        • remove_output()
        • remove_outputs_by_name_list()
        • remove_inputs_by_name_list()
        • add_io()
        • add_input()
        • add_output()
        • get_io_shape()
        • update_io_shape()
        • change_node_output()
        • is_initializer()
        • find_initializer_value()
        • remove_initializers()
        • add_initializer()
        • remove_duplicated_initializer()
        • transpose_reshape_constant()
        • convert_initializer()
        • uniquify_initializer_name()
        • export_to_json()
        • update_model_node_names()
  • PePPi APIs
    • sima
      • Submodules
        • sima.gst_utils
        • sima.mini_pipeline_base
        • sima.operations
        • sima.video_reader
      • Classes
      • Functions
      • Package Contents
        • resize()
        • cvtColor()
        • SimaBoxRender
        • set_log_level()
        • MLSoCSession
        • VideoReader
        • VideoWriter
  • GStreamer Plugins
    • buffer_concatenator
      • Properties
        • Installation
      • Usage
      • Configuration
    • simaaimask_filtering
      • Features
      • Components
        • UserContext Class
        • Utilities
      • Input Buffers
      • Output Buffer
        • Installation
      • Usage
      • Configuration
      • Contributing
      • License
      • Acknowledgments
    • pcie
      • Description
      • Features
        • Multiple source pad/stream support
        • CAPs Negotiation
        • Automatic Output Buffer Size Calculation
      • Getting Started
        • Prerequisites
        • Installation
      • Example Usage
      • Configuration
      • Contributing
      • License
      • Acknowledgments
    • simaaiprocesscvu
      • Description
      • Requirements
      • Properties
      • Configuration
        • Graph parameters
        • Segment to buffer mapping blocks
        • Caps block
      • Usage
        • Example Configuration File
    • simaaisigmoid
      • Installation
      • Properties
      • Usage
      • Configuration
    • simaaisrc
      • Properties
      • Usage
        • Segment Property
      • Configuration
    • simaaisoftmax2d
      • Installation
        • Usage
        • Configuration
  • CVU Graphs Library
    • CVU Graphs
      • SIMA_COLORCONVERT
        • Description
        • Graph Info
        • Example Config
        • CVU Configuration Application
      • SIMA_RESIZE
        • Description
        • Graph Info
        • Example Config
        • CVU Configuration Application
      • SIMA_TESSELATE
        • Description
        • Graph Info
        • Example Config
        • CVU Configuration Application
      • SIMA_GENERIC_PREPROC
        • Description
        • Graph Info
        • Example Config
        • CVU Configuration Application
      • SIMA_DETESS_DEQUANT
        • Description
        • Graph Info
        • Example Config
        • CVU Configuration Application
  • Software Downloads
    • Software Updates
    • ML Models
    • File Examples
    • AWS SageMaker Blog
  • Additional Technical Documentation
    • Product Briefs
    • Market Briefs
    • Device Datasheets
    • Hardware Reference Manuals

Release Notes

  • Palette SDK version 1.6
    • New Features and Enhancements
    • Performance Validations
    • Known Issues
  • Palette SDK Version 1.5
    • New Features & Enhancements
    • Performance Validations
    • Bug Fixes
    • Known Issues
Documentation
  • sima_qat
  • View page source

sima_qat

Submodules

  • sima_qat.misc
  • sima_qat.onnx_ops
  • sima_qat.qat_api
  • sima_qat.sima_quantizer

© Copyright 2025, SiMa Technologies.

Built with Sphinx using a theme provided by Read the Docs.
Other Versions v: latest
Tags
latest
v1.4.0
v1.5.0