implement passthrough middleware for entities #2572
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
sebastianburckhardt
added
core-entities
jviau
approved these changes
Sep 8, 2023
| { | ||
| functionResult = await functionInfo.Executor.TryExecuteAsync( | ||
| input, | ||
| cancellationToken: this.HostLifetimeService.OnStopping); |
There was a problem hiding this comment.
Add the following lines here:
if (!functionResult.Succeeded)
{
// Shutdown can surface as a completed invocation in a failed state.
// Re-throw so we can abort this invocation.
this.HostLifetimeService.OnStopping.ThrowIfCancellationRequested();
}
jviau
reviewed
Sep 8, 2023
|
|
||
| // We convert the binary payload into a base64 string because that seems to be the most commonly supported | ||
| // format for Azure Functions language workers. Attempts to send unencoded byte[] payloads were unsuccessful. | ||
| string encodedRequest = ProtobufUtils.Base64Encode(entityBatchRequest); |
There was a problem hiding this comment.
one of the reasons we used proto encoding for orchestrations is that the OrchestrationRuntimeState wasn't serializable itself, and this was a quick way to reach serialization. If the built in DT.Core EntityBatchRequest and EntityBatchResult types are serializable, we can stick with those if you prefer.
There was a problem hiding this comment.
It is indeed serializable. But I don't have much reason to replace the protobuf serialization as done right now with a different one.
sebastianburckhardt
added a commit
that referenced
this pull request
Oct 19, 2023
* udpate readme. * update durability provider class for new core-entities support. (#2570) * update durability provider class for new core-entities support. * add configuration setting for max entity concurrency to DurableTaskOptions * minor fixes. * update DurableClient to take advantage of native entity queries (#2571) * update DurableClient to take advantage of native entity queries if available * fix minor errors. * address PR feedback * implement passthrough middleware for entities (#2572) * implement passthrough middleware for entities. * propagate changes to protocol * update/simplify protobuf format * address PR feedback * implement entity queries for grpc listener (#2573) * implement entity queries for grpc listener * propagate changes to protocol * update/simplify protobuf format * Various fixes (#2585) * durability provider must implement and pass-through IEntityOrchestrationService since it wraps the orchestration service * simple mistake * fix misunderstanding of initializer syntax (produced null, not empty list) * fix missing failure details * fix missing compile-time switch for trigger value type * fix missing optional arguments * fix missing override * simplify how entities are excluded from instance queries (#2586) * add an entity example to the DotNetIsolated smoke test project. (#2584) * add an entity example to the DotNetIsolated smoke test project. * remove superfluous argument. * address PR feedback * Entities: Add worker side entity trigger and logic (#2576) * Add worker side entity trigger and logic * update comments * Address PR comments * another small fix that got lost somewhere. (#2596) * Update packages and version for entities preview (#2599) * Switch to Microsoft.DurableTask.Grpc (#2605) * Fix grpc core (#2616) * pass entity parameters for task orchestration. (#2611) * Core entities/various fixes and updates (#2619) * assign the necessary AzureStorageOrchestrationServiceSettings * propagate changes to query name and metadata parameters * add missing override for TaskOrchestrationEntityFeature * Update to entities preview 2 (#2620) * Add callback handler for entity dispatching (#2624) * Core entities/propagate changes (#2625) * add configuration for EnableEntitySupport * rename includeStateless to includeTransient * Rev dependencies to entities-preview.2 (#2627) * Call EnsureLegalAccess from EntityFeature in dotnet-isolated (#2633) * create a better error message in situations where client entity functions are called on a backend that does not support entities (#2630) * Rev package versions, update release notes (#2638) * Address smoke test build issue (#2647) * fix translation of legacy query to new entity query support (#2648) * fix translation of legacy query to new entity query support * comment out CleanEntityStorage_Many * try to enable CI on feature branch * Revert "comment out CleanEntityStorage_Many" This reverts commit aeaa4b8. * update to preview.2 packages --------- Co-authored-by: Varshitha Bachu <vabachu@microsoft.com> Co-authored-by: Jacob Viau <javia@microsoft.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
With new core entity support, storage providers can now dispatch entity work items separately, and DT.Core processes them through in a separate dispatcher.
This PR updates the middleware passthrough to reflect this.
This PR depends on Azure/durabletask#953.
Pull request checklist
is targeting feature branch
feature/core-entities.