Workflow List and History RPCs for Durable Task#19
Merged
Conversation
b1588c4 to
79770d4
Compare
* Author(s): @JoshVanL This proposal adds two new RPCs to the durabletask framework which are used to support observability and discoverability of running and completed workflows in Dapr. Specifically, adding a `ListInstances` and `GetInstanceHistory` RPC to the durabletask gRPC service. Today, there is no ways of discovering the list of workflow instances that are currently running or have completed in the past without using external storage queries. The Dapr CLI [introduced list and workflow history commands](dapr/cli#1560) to get information about running and completed workflows, however these commands rely on direct queries to the underlying storage provider. By introducing this functionality into the durabletask framework itself, these commands need only talk to Daprd, removing the requirement for direct access to the storage provider as well as authentication. Daprd can make these queries itself, and use the Actor State Store component to access the underlying storage. Two new RPCs will be added to the durabletask gRPC service, which will be available to both the application client, as well as the dapr CLI. The list RPC will be used to discover the workflow instance IDs, which their metadatda can then be fetched. The workflow history RPC will be used to fetch the full history of a given workflow instance. ```proto service TaskHubSidecarService { rpc ListInstanceIDs (ListInstanceIDsRequest) returns (ListInstanceIDsResponse); rpc GetInstanceHistory (GetInstanceHistoryRequest) returns (GetInstanceHistoryResponse); } // ListInstanceIDsRequest is used to list all orchestration instances. message ListInstanceIDsRequest { // continuationToken is the continuation token to use for pagination. This // is the token which the next page should start from. If not given, the // first page will be returned. optional string continuationToken = 1; // pageSize is the maximum number of instances to return for this page. If // not given, all instances will be attempted to be returned. optional uint32 pageSize = 2; } // ListInstanceIDsResponse is the response to executing ListInstanceIDs. message ListInstanceIDsResponse { // instanceIds is the list of instance IDs returned. repeated string instanceIds = 1; // continuationToken is the continuation token to use for pagination. If // there are no more pages, this will be null. optional string continuationToken = 2; } // GetInstanceHistoryRequest is used to get the full history of an // orchestration instance. message GetInstanceHistoryRequest { string instanceId = 1; } // GetInstanceHistoryResponse is the response to executing GetInstanceHistory. message GetInstanceHistoryResponse { repeated HistoryEvent events = 1; } ``` Signed-off-by: joshvanl <me@joshvanl.dev>
5c8c7aa to
5d4bd98
Compare
cicoyle
reviewed
Nov 6, 2025
cicoyle
left a comment
There was a problem hiding this comment.
lgtm just 2 nits bc I prefer ID over Id
| // ListInstanceIDsResponse is the response to executing ListInstanceIDs. | ||
| message ListInstanceIDsResponse { | ||
| // instanceIds is the list of instance IDs returned. | ||
| repeated string instanceIds = 1; |
There was a problem hiding this comment.
Suggested change
| repeated string instanceIds = 1; | |
| repeated string instanceIDs = 1; |
| // GetInstanceHistoryRequest is used to get the full history of an | ||
| // orchestration instance. | ||
| message GetInstanceHistoryRequest { | ||
| string instanceId = 1; |
There was a problem hiding this comment.
Suggested change
| string instanceId = 1; | |
| string instanceID = 1; |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This proposal adds two new RPCs to the durabletask framework which are used to support observability and discoverability of running and completed workflows in Dapr. Specifically, adding a
ListInstancesandGetInstanceHistoryRPC to the durabletask gRPC service.Today, there is no ways of discovering the list of workflow instances that are currently running or have completed in the past without using external storage queries. The Dapr CLI introduced list and workflow history commands to get information about running and completed workflows, however these commands rely on direct queries to the underlying storage provider. By introducing this functionality into the durabletask framework itself, these commands need only talk to Daprd, removing the requirement for direct access to the storage provider as well as authentication. Daprd can make these queries itself, and use the Actor State Store component to access the underlying storage.
Two new RPCs will be added to the durabletask gRPC service, which will be available to both the application client, as well as the dapr CLI. The list RPC will be used to discover the workflow instance IDs, which their metadatda can then be fetched. The workflow history RPC will be used to fetch the full history of a given workflow instance.