max_position_embeddings of qwen2.5 math

[Sorr7maker]

In your paper and bash code，response length is set to 8192. But in qwen2.5 math's config, max_position_embeddings is set to only 4096. How did you solve this issue?

[telxt]

Thank you for your interest in our work! You’ll need to update the config.json in your model directory according to line 33 of train.sh: “Following LUFFY, rope_theta should be reset to 40000 and max_position_embeddings to 16384.”