Fix: Preserve hyperparameter order when invoking training jobs#223
Open
vsimkus wants to merge 1 commit intoaws:masterfrom
Open
Fix: Preserve hyperparameter order when invoking training jobs#223vsimkus wants to merge 1 commit intoaws:masterfrom
vsimkus wants to merge 1 commit intoaws:masterfrom
Conversation
prtsh
approved these changes
Dec 6, 2024
Contributor
prtsh
left a comment
There was a problem hiding this comment.
Approved. Change replaces the args sorting so that the order of the hyper-param cli args is preserved. Do not see any intended harm with this change as the cli args are order agnostic.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fixes #221.
Removed the alphanumeric sorting of the hyperparameters in
sagemaker-training-toolkit/src/sagemaker_training/mapping.py
Lines 65 to 78 in 628166c
This makes sure that training scripts are invoked with the same order of hyperparameters as passed in the
hyperparametersargument to the SageMakerEstimatorclass. This sorting was undocumented and as argued in issue #221 can cause issues for scripts where order of the arguments matters.I have updated the unit tests in
test_mapping.pyto verify that the order of the arguments is preserved.I ran the unit tests with
tox -e py310 -- -s -vv test/unitand they passed. Let's see if the CI tests find anything...Merge Checklist
General
Tests
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.