Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Non-private method to retrieve run details comparable to LocalStorageOperations.load_detail #1079

Closed
bwilliams2 opened this issue Nov 9, 2023 · 1 comment
Assignees
Labels
enhancement New feature or request

Comments

@bwilliams2
Copy link
Contributor

Is your feature request related to a problem? Please describe.
I am investigating the logging evaluation runs of Prompt flow using the PFClient. I am especially interested in logging the inter-node inputs and outputs of the flow which are not returned in any of the public facing methods (e.g., get_metrics, get_details). These are readily available when visualizing with PFClient.runs.visualize and the details are internally retrieved using LocalStorageOperations.load_detail.

local_storage = LocalStorageOperations(run)
detail = local_storage.load_detail()

LocalStorageOperations is not public facing class and I am hesitant to utilize it directly since it may be subject to undocumented changes.

Describe the solution you'd like
Provide a public facing method to retrieve complete run details including inter-node inputs and outputs along with other information currently displayed in a flow visualization.

Describe alternatives you've considered
I have not found any alternatives of retrieving the desired run details but am open to other suggestions.

@bwilliams2 bwilliams2 added the enhancement New feature or request label Nov 9, 2023
@0mza987
Copy link
Contributor

0mza987 commented Nov 14, 2023

Hi @bwilliams2,
Thank you for your feedback. As you can observe from the results of the pf run visualize command, it provides a comprehensive overview of a completed flow run. However, it is unlikely that we can expose all the data contracts as they may undergo changes during code development.

To better understand your user scenario and determine what information you require the most, could you please provide more details? This will allow us to have a more in-depth discussion and ascertain if the requested data can be exposed.

@0mza987 0mza987 closed this as not planned Won't fix, can't repro, duplicate, stale Dec 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants