Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New EventHubs performance tests #178

Merged
merged 2 commits into from
Oct 12, 2023
Merged

New EventHubs performance tests #178

merged 2 commits into from
Oct 12, 2023

Conversation

sebastianburckhardt
Copy link
Member

revise design of EventHubs performance test.

Uses a new design:

  • the namespace-under-test can contain up to 10 hubs with 32 partitions each
  • up to 320 pusher entities can be started, stopped, and queried
  • up to 320 puller entities (one per partition) can be started, stopped, and queried
  • puller entities use PartitionReceivers to reliably pull events and then either
    a. forward them to an entity, or
    b. start a new orchestration

@sebastianburckhardt sebastianburckhardt changed the title Pr/eh perftests New EventHubs performance tests Jun 23, 2022
@sebastianburckhardt
Copy link
Member Author

sebastianburckhardt commented Jun 23, 2022

Some things that remain to do:

  • revise host.json changes
  • test autoscaling
  • measure numbers and add to documentation
  • document the design of this test, and how to run it

@sebastianburckhardt sebastianburckhardt added this to the 1.1.0 milestone Jul 12, 2022
@sebastianburckhardt sebastianburckhardt modified the milestones: 1.1.0, 1.2.0 Aug 2, 2022
@sebastianburckhardt sebastianburckhardt modified the milestones: 1.2.0, 1.3.0 Nov 17, 2022
@sebastianburckhardt sebastianburckhardt modified the milestones: 1.3.0, 1.4.0 Jan 3, 2023
@sebastianburckhardt sebastianburckhardt marked this pull request as ready for review September 18, 2023 21:28
@sebastianburckhardt sebastianburckhardt modified the milestones: 1.4.0, 1.4.1 Sep 27, 2023
@sebastianburckhardt sebastianburckhardt merged commit 83d16d2 into dev Oct 12, 2023
1 of 2 checks passed
sebastianburckhardt added a commit that referenced this pull request Oct 23, 2023
* Update CreationRequestReceived.cs

* remove the faster-alternate data store and fix broken deserialization. (#308)

* fix and instrument commitlog serialization and deserialization. (#305)

* fix discard of packets so the next packet to expect is updated correctly (#302)

* New EventHubs performance tests (#178)

* rebase, and remove changes to scale monitor

* add hello cities test that prints the history of a nested orchestration

* implement a watchdog that terminates CompletePending quickly if it hangs (#318)

* add unique id to scale monitor constructor (#316)

* fix bugs from PR #302 (#315)

* fix cache size reporting (#321)

* added a comment

* update durable task package references to 2.15.1 and 2.12.0 (#317)

* update DT and DF package references

* update to latest

* sync dev w/ main (#324)

* Update GH automation (#303)

* initial commit (#290)

* Revert "initial commit (#290)" (#314)

This reverts commit 3a2d193.

* Bump Azure.Identity from 1.7.0 to 1.10.2 in /samples/TokenCredentialDTFx (#323)

Bumps [Azure.Identity](https://github.com/Azure/azure-sdk-for-net) from 1.7.0 to 1.10.2.
- [Release notes](https://github.com/Azure/azure-sdk-for-net/releases)
- [Commits](Azure/azure-sdk-for-net@Azure.Identity_1.7.0...Azure.Identity_1.10.2)

---
updated-dependencies:
- dependency-name: Azure.Identity
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Terminate partition when FASTER refuses to checkpoint for over a minute (#301)

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: Varshitha Bachu <vabachu@microsoft.com>
Co-authored-by: Sebastian Burckhardt <sburckha@microsoft.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: Sebastian Burckhardt <sburckha@microsoft.com>
Co-authored-by: David Justo <david.justo.1996@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant