Platform SDK

The Platform SDK provides the drivers, firmware, and runtime libraries required to execute compiled models on Cloud AI hardware. It must be installed on every host that has Cloud AI cards physically attached.

Preparation

  1. Copy the Platform SDK zip file to your host machine.

  2. Extract the archive:

    unzip aic_platform.Core.<version>.Linux-AnyCPU.zip

  3. Navigate to the correct directory for your architecture:

    cd <architecture>/<package-format>
# Examples:
# cd x86_64/deb    # Ubuntu/Debian on x86-64
# cd x86_64/rpm    # RHEL on x86-64
# cd aarch64/deb   # Ubuntu on ARM64

Uninstall Previous Version

If upgrading from a previous installation:

sudo ./uninstall.sh
sync

Important

Installation may take up to 30 minutes depending on the number of Cloud AI cards. Cards undergo multiple resets during installation.

Note

Upgrading from a version earlier than 1.19? See Platform SDK Upgrade from Version < 1.19 for alternate installation instructions.

Installation

sudo ./install.sh --auto_upgrade_sbl --ecc enable --setup_mdp all

Option

Description

--auto_upgrade_sbl

Upgrades the Secondary Bootloader (SBL) firmware if the version does not match the SDK.

--ecc enable

Enables Error Correcting Code (ECC) for device memory. Recommended for production deployments.

--setup_mdp all

Enables Multi-Device Partitioning (MDP) on all devices, required for multi-card tensor-slicing configurations.

Note

For VMs on ESXi hypervisor, add --datapath_polling to install the kernel module driver (KMD) in polling mode:

Post-Installation

Verify installation directory

The SDK installs to /opt/qti-aic/:

/opt/qti-aic/
├── config/
├── dev/
├── examples/
├── exec/
├── firmware/
├── lib/
├── services/
├── test-data/
├── tools/
└── versions/

Check SDK version

/opt/qti-aic/tools/qaic-version-util --platform

Add user to qaic group (run tools without sudo)

sudo usermod -aG qaic $USER
newgrp qaic

Manage qmonitor service

# Check status
sudo systemctl is-active qmonitor-proxy

# Stop/start service
sudo /opt/qti-aic/scripts/qaic-monitor-service.sh stop
sudo /opt/qti-aic/scripts/qaic-monitor-service.sh start