Analysis tools

AIMET offers these tools to view and analyze a model’s interal quantization results.

Interactive visualization

Interactive visualization produces an interactive HTML console showing the statistics collected by each quantizer during calibration.

Quantization analyzer

Quantization analyzer (QuantAnalyzer) analyzes your pre-trained model and identifies layers sensitive to quantization. It checks model sensitivity to weight and activation quantization, and performs per-layer sensitivity and mean square error analysis. It also exports per-layer encoding min and max ranges and statistics histograms for every layer.

Layer output generation

Layer output generation is an API that captures and saves intermediate layer model outputs. This allows layer-output comparison between a quantization simulated model (QuantSim object) and an actual quantized model on a target device in order to debug accuracy mismatch issues at the layer level.