Palette SDK version 1.7

This page lists new features released in SiMa’s Palette SDK version 1.7, including known issues and their workarounds.

New Features and Enhancements

Feature Category

Availability

Feature Description

MLA

GA

Versioning support, Automated graph surgery improvements, New operators support.

MLA (GenAI)

GA

4-bits block quantization and auto-codegen to convert any LLM on Huggingface to work with Sima Modalix platform.

Platform

GA

Full image supporting Modalix DevKit for NVMe, GUI, and many other peripherals such as USB camera, mouse and keyboard.

Platform

Preview

Elxr O/S in technical preview

Video Platform

GA

Precompiled Plugins improving deployment speed and reducing the MPK file size, support for MPK versioning, performance improvement for various video models.

Video Platform

GA

Real-time profiling support with LTTNG.

Performance Validations

Model Name

Type

FPS

MaskRCNN

PCIe

Achieved 20 FPS performance.

OpenPose

PCIe

Achieved 45 FPS performance.

YOLOv5

PCIe

Achieved 20 FPS performance.

YOLOv7

PCIe

Achieved 120 FPS performance.

YOLOv8 single-Camera

Standalone

Achieved 120 FPS performance.

DETR

Standalone

Achieved 120 FPS performance.

OpenPose

Standalone

Achieved 45 FPS performance.

YOLOv5

Standalone

Achieved 20 FPS performance.

YOLOv7

Standalone

Achieved 120 FPS performance.

YOLOv7 (4-Camera)

Standalone

Each camera runs at 35 FPS, tested with 4 cameras (35*4).

PeopleTracker

Standalone

Achieved 30 FPS performance.

EfficientDet

Standalone

Achieved 20 FPS performance.

PeopleDetector single-Camera

Standalone

Achieved 120 FPS performance.

PeopleDetector (4-Camera)

Standalone

Each camera runs at 35 FPS, tested with 4 cameras (35*4).

Known Issues

Issue

Impact

Workaround

Installing python packages as sudo can break the system

May cause system failure such as loss of GUI, DNS, etc after the reboot.

Update the DevKit again using the same firmware version to reset root file system. Avoid using sudo to install system Python packages, always resort to virtual environment.