Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is there no way to stream or wait for environment creation with ml_client #36218

Closed
obiii opened this issue Jun 24, 2024 · 3 comments
Closed
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. Machine Learning needs-team-attention Workflow: This issue needs attention from Azure service team or SDK team question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention Workflow: This issue is responsible by Azure service team.

Comments

@obiii
Copy link

obiii commented Jun 24, 2024

  • Package Name: azure.ai.ml.entities
  • Package Version: V2
  • Operating System: Linux Ubuntu 20.04
  • Python Version: 31.11

Describe the bug
We are creating aml environments within the aml pipeline before actually submitting the job. We cannot find a way to wait for the environment creation to finish. Like with jobs, there is no stream functionality with environments.

To Reproduce
Steps to reproduce the behavior:

ml_client_workspace = get_client_workspace(
    credentials, e.subscription_id, e.resource_group, e.workspace_name
)

gpu_image = "mcr.microsoft.com/azureml/openmpi4.1.0-cuda11.1-cudnn8-ubuntu20.04"
cpu_image = "mcr.microsoft.com/azureml/openmpi4.1.0-ubuntu20.04"
env_docker_conda = Environment(
    image=gpu_image if gpu_accelerated else cpu_image,
    conda_file=conda_dependencies_file,
    name=env_name,
    description="Environment created from a Docker image plus Conda environment.",
)
env = ml_client.environments.create_or_update(env_docker_conda)

Expected behavior
There should be a way to wait for environment creation and get completion/failure status.

@github-actions github-actions bot added customer-reported Issues that are reported by GitHub users external to the Azure organization. Machine Learning Mgmt This issue is related to a management-plane library. needs-team-attention Workflow: This issue needs attention from Azure service team or SDK team question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention Workflow: This issue is responsible by Azure service team. labels Jun 24, 2024
Copy link

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @Azure/azure-ml-sdk @azureml-github.

@kristapratico kristapratico added Client This issue points to a problem in the data-plane of the library. and removed Mgmt This issue is related to a management-plane library. labels Jun 24, 2024
@kristapratico
Copy link
Member

@obiii thanks for your feedback, @azureml-github will take a look and get back to you as soon as possible.

@diondrapeck
Copy link
Contributor

@obiii There is no support for this in V2 today. It is a known feature ask in our backlog; however, there are not concrete plans to address it. If that changes, we will update this issue.

@github-actions github-actions bot locked and limited conversation to collaborators Sep 22, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. Machine Learning needs-team-attention Workflow: This issue needs attention from Azure service team or SDK team question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention Workflow: This issue is responsible by Azure service team.
Projects
None yet
Development

No branches or pull requests

3 participants