aimet_torch.experimental.spinquant

Top level APIs

aimet_torch.experimental.spinquant.apply_spinquant(model)[source]

Apply SpinQuant to the model, modifying weights in place. https://arxiv.org/pdf/2405.16406 Currently only R1 rotations without optimization are supported. The model is updated in place.

Parameters:

model (Module) – The model to apply SpinQuant to.