logo
Qualcomm® Cloud AI
QAIRT SDK
Initializing search
    • User Guide
    • API
    • FAQ
    • Blogs
      • Introduction
      • Quick Start Guide
      • Installation
        • Checklist
        • Pre-requisites
        • Cloud AI SDK
        • Hypervisors
        • Containers
          • Docker
          • Kubernetes
        • Triton Inference Server
        • vLLM
        • AWS
        • Text Generation Inference
      • Inference Workflow
        • Export the Model
          • Exporting ONNX Model from Different Frameworks
          • Operator and Datatype support
          • Introduction to the Model Preparator Tool
        • Compile the Model
          • Compile the Model
          • Tune Performance
        • Execute the QPC
          • Execute the QPC
          • Inference Profiling
      • Pytorch Workflow
      • Model Architecture Support
        • Large Language Models (LLMs)
      • Features
        • Custom Operations (C++)
        • Model Sharding
      • System Management
        • System Management
        • AIC-manager
      • Architecture
      • QAIRT SDK
        • QAIRT SDK Installation
        • QAIRT Software architecture
        • QAIRT Integration Workflow
        • QAIRT Model Compilation and execution
        • Tutorial
        • Precision support
        • Supported Operations
        • Addition of Custom-op
        • QAIRT Tools
        • APIs
      • QAIRT SDK
        • QAIRT SDK Installation
        • QAIRT Software architecture
        • QAIRT Integration Workflow
        • QAIRT Model Compilation and execution
        • Tutorial
        • Precision support
        • Supported Operations
        • Addition of Custom-op
        • QAIRT Tools
        • APIs
      • Glossary
      • Python API
        • qaic package
        • class Util
        • class InferenceBenchmarkSet
      • CPP API
        • InferenceSet IO Example
        • Features
        • Runtime
      • ONNX Runtime
        • QAIC execution provider
      • Frequently Asked Questions
      • Train anywhere, Infer on Qualcomm® Cloud AI 100
      • Quadruple LLM Decoding Performance with Speculative Decoding (SpD) and Microscaling (MX) Formats
      • Accelerate Inference of Fully Transparent Open-Source LLMs from LLM360 on Qualcomm® Cloud AI 100 DL2q Instances
      • Extremely Low-Cost Text Embeddings on Qualcomm® Cloud AI 100 DL2q Instances
      • Accelerate Large Language Model Inference by ~2x Using Microscaling (Mx) Formats

    QAIRT SDK¶

    This is an Engineering release for QAIRT SDK for Cloud backend.

    • QAIRT SDK Installation
    • QAIRT Software architecture
    • QAIRT Integration Workflow
    • QAIRT Model Compilation and execution
    • Tutorial
    • Precision support
    • Supported Operations
    • Addition of Custom-op
    • QAIRT Tools
    • APIs
    Back to top
    Previous Architecture
    Next QAIRT SDK Installation
    © Copyright 2025 Qualcomm Innovation Center, Inc.
    Created using Sphinx 7.1.2. and Sphinx-Immaterial