You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
With the new interface we can initialise a dataset from a manifest. The manifest are currently located in the working directory. If we want to share the dataset/manifest we have to adapt the manifest location manually as well uploading the data to the final location.
Ideally, we would come with a method that allows to export a dataset to a remote storage bucket. The parquet files and a modified manifest have to be uploaded to defined location.
We do something similar with the write_to_file component, but there we don't modify the manifest itself.
The text was updated successfully, but these errors were encountered:
With the new interface we can initialise a dataset from a manifest. The manifest are currently located in the working directory. If we want to share the dataset/manifest we have to adapt the manifest location manually as well uploading the data to the final location.
Ideally, we would come with a method that allows to export a dataset to a remote storage bucket. The parquet files and a modified manifest have to be uploaded to defined location.
We do something similar with the
write_to_file
component, but there we don't modify the manifest itself.The text was updated successfully, but these errors were encountered: