Attribute Error: Phi3Model has no attribute 'rotary_emb'

[avisheka93]

Trying to quantize microsoft/Phi-3-mini-128k-instruct using Auto AWQ via onnxruntime and running into this error
Attribute Error: Phi3Model has no attribute 'rotary_emb'

anyone has seen this before?

[kunal-vaishnavi]

Can you share all of your package versions in your environment? This could be coming from an older version of ONNX Runtime GenAI that does not contain this change or the v5 version of Hugging Face's Transformers. You can try upgrading to the latest ORT GenAI version and downgrading your transformers version to 4.57.6, which was the last release before 5.0.0.