Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Importing into a Sagemaker MLFlow instance #200

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

msharp9
Copy link

@msharp9 msharp9 commented Nov 14, 2024

I recently had to set up a Sagemaker MLFlow instance and import data from our previous MLFlow instance. The AWS Sagemaker team has provided an MLFlow plugin to make connection easier. https://docs.aws.amazon.com/sagemaker/latest/dg/mlflow-track-experiments.html

With it you set the tracking uri to an ARN of form: arn:aws:sagemaker:{region}:{account-id}:mlflow-tracking-server/{server-name}. Because of this I found there were some checks in the code that didn't expect this format that were unnecessary.

Another note, is that this plugin makes connecting to the MLFlow server via the python client a breeze, but doing so directly through the REST endpoint is near impossible. I had to change one instance where the http_client was used instead of the mlflow_client to make importing runs with Dataset inputs to work properly.

The last thing I changed was just adding a warning as models with names "my_model" wouldn't import, but "my-model" would work. I have no idea where this limitation comes into play, but I didn't get any errors surface when I ran the export-import tool, so a warning would have helped. I discovered the issue after trying to manually add a registered model in the MLFlow UI.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant