Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

failure to register experiment data asset #152

Open
nhjiejan opened this issue May 23, 2024 · 0 comments
Open

failure to register experiment data asset #152

nhjiejan opened this issue May 23, 2024 · 0 comments

Comments

@nhjiejan
Copy link

Trying to run the flows out of the box following the tutorial for github workspaces gives the following error:

task: Register Experiment data asset

error:

8s
Prepare all required actions
Run ./.github/actions/execute_script
Run python -m llmops.common.register_data_asset \
  
2024-05-23 [1](https://github.com/axpo-ts/llmops-demo/actions/runs/9210931908/job/25339446853#step:7:1)5:48:41,721 - register_data_asset - INFO - Registering dataset: named_entity_recognition_train
[2](https://github.com/axpo-ts/llmops-demo/actions/runs/9210931908/job/25339446853#step:7:2)024-05-23 15:48:41,722 - register_data_asset - INFO - Hash of the folder: 1e448338b9eeb8d72[19](https://github.com/axpo-ts/llmops-demo/actions/runs/9210931908/job/25339446853#step:7:20)26dd36da71ce601e8ec24ba07440edc514b347cff4972
2024-05-23 15:48:44,183 - register_data_asset - INFO - Updating dataset. New hash: 1e448338b9eeb8d721926dd36da71ce601e8ec24ba07440edc514b[34](https://github.com/axpo-ts/llmops-demo/actions/runs/9210931908/job/25339446853#step:7:35)7cff4972
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/_utils/_asset_utils.py", line 775, in _get_latest_version_from_container
    else container_operation.get(
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/core/tracing/decorator.py", line 78, in wrapper_use_tracer
    return func(*args, **kwargs)
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/_restclient/v2023_04_01_preview/operations/_data_containers_operations.py", line 430, in get
    map_error(status_code=response.status_code, response=response, error_map=error_map)
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/core/exceptions.py", line 164, in map_error
    raise error
azure.core.exceptions.ResourceNotFoundError: (UserError) named_entity_recognition_train container was not found.
Code: UserError
Message: named_entity_recognition_train container was not found.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/operations/_data_operations.py", line 265, in get
    return _resolve_label_to_asset(self, name, label)
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/_utils/_asset_utils.py", line 1022, in _resolve_label_to_asset
    return resolver(name)
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/operations/_data_operations.py", line 675, in _get_latest_version
    latest_version = _get_latest_version_from_container(
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/_utils/_asset_utils.py", line 795, in _get_latest_version_from_container
    raise ValidationException(
azure.ai.ml.exceptions.ValidationException: Asset named_entity_recognition_train does not exist in workspace llmops-demo.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/home/runner/work/llmops-demo/llmops-demo/llmops/common/register_data_asset.py", line 89, in register_data_asset
    data_info = ml_client.data.get(name=ds.name, label="latest")
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/_telemetry/activity.py", line 292, in wrapper
    return f(*args, **kwargs)
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/operations/_data_operations.py", line 279, in get
    log_and_raise_error(ex)
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/_exception_helper.py", line 337, in log_and_raise_error
    raise MlException(message=formatted_error, no_personal_data_message=formatted_error)
azure.ai.ml.exceptions.MlException: 
1) Resource was not found.
Details: 
(x) Asset named_entity_recognition_train does not exist in workspace llmops-demo.
Resolutions: 
1) Double-check that the resource has been specified correctly and that you have access to it.
If using the CLI, you can also check the full log in debug mode for more details by adding --debug to the end of your command
Additional Resources: The easiest way to author a yaml specification file is using IntelliSense and auto-completion Azure ML VS code extension provides: https://code.visualstudio.com/docs/datascience/azure-machine-learning. To set up VS Code, visit https://docs.microsoft.com/azure/machine-learning/how-to-setup-vs-code
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/home/runner/work/llmops-demo/llmops-demo/llmops/common/register_data_asset.py", line 147, in <module>
    main()
  File "/home/runner/work/llmops-demo/llmops-demo/llmops/common/register_data_asset.py", line 140, in main
    register_data_asset(args.base_path, args.file, args.subscription_id, args.env_name)
  File "/home/runner/work/llmops-demo/llmops-demo/llmops/common/register_data_asset.py", line 102, in register_data_asset
    ml_client.data.create_or_update(aml_dataset)
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/_telemetry/activity.py", line 292, in wrapper
    return f(*args, **kwargs)
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/operations/_data_operations.py", line 425, in create_or_update
    raise ex
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/operations/_data_operations.py", line [36](https://github.com/axpo-ts/llmops-demo/actions/runs/9210931908/job/25339446853#step:7:38)7, in create_or_update
    data, _ = _check_and_upload_path(
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/_artifacts/_artifact_utilities.py", line 518, in _check_and_upload_path
    uploaded_artifact = _upload_to_datastore(
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/_artifacts/_artifact_utilities.py", line [39](https://github.com/axpo-ts/llmops-demo/actions/runs/9210931908/job/25339446853#step:7:41)6, in _upload_to_datastore
    artifact = upload_artifact(
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/_artifacts/_artifact_utilities.py", line 252, in upload_artifact
    datastore_info = get_datastore_info(datastore_operation, datastore_name)
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/_artifacts/_artifact_utilities.py", line 100, in get_datastore_info
    datastore = operations.get(name, include_secrets=credential is None)
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/_telemetry/activity.py", line 292, in wrapper
    return f(*args, **kwargs)
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/operations/_datastore_operations.py", line 150, in get
    datastore_resource = self._operation.get(
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/core/tracing/decorator.py", line 78, in wrapper_use_tracer
    return func(*args, **kwargs)
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/ai/ml/_restclient/v2023_04_01_preview/operations/_datastores_operations.py", line [51](https://github.com/axpo-ts/llmops-demo/actions/runs/9210931908/job/25339446853#step:7:53)2, in get
    map_error(status_code=response.status_code, response=response, error_map=error_map)
  File "/opt/hostedtoolcache/Python/3.9.19/x64/lib/python3.9/site-packages/azure/core/exceptions.py", line 164, in map_error
    raise error
azure.core.exceptions.ResourceNotFoundError: (UserError) Could not find datastore: workspaceblobstore.
Code: UserError
Message: Could not find datastore: workspaceblobstore.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant