Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add default benchmark scheduler #271

Merged

Conversation

boomanaiden154
Copy link
Collaborator

This patch adds a default benchmark scheduler. This scheduler assumes
the worker performing the benchmarking has three hyperthreads available
inside its CPU mask, with two of them being part of a pair (from the
same core). It then selects one core from the pair to be used for the
benchmarking subprocess, and selects the core outside of the pair to be
used to run the main exegesis/python program. Verification is also added
to ensure that nothing external to the program changes the process mask,
or at least to catch it early if it does happen.

boomanaiden154 added a commit to boomanaiden154/gematria that referenced this pull request Dec 25, 2024
This patch adds a default benchmark scheduler. This scheduler assumes
the worker performing the benchmarking has three hyperthreads available
inside its CPU mask, with two of them being part of a pair (from the
same core). It then selects one core from the pair to be used for the
benchmarking subprocess, and selects the core outside of the pair to be
used to run the main exegesis/python program. Verification is also added
to ensure that nothing external to the program changes the process mask,
or at least to catch it early if it does happen.

Pull Request: google#271
boomanaiden154 added a commit to boomanaiden154/gematria that referenced this pull request Dec 25, 2024
This patch adds a default benchmark scheduler. This scheduler assumes
the worker performing the benchmarking has three hyperthreads available
inside its CPU mask, with two of them being part of a pair (from the
same core). It then selects one core from the pair to be used for the
benchmarking subprocess, and selects the core outside of the pair to be
used to run the main exegesis/python program. Verification is also added
to ensure that nothing external to the program changes the process mask,
or at least to catch it early if it does happen.

Pull Request: google#271
Created using spr 1.3.4
boomanaiden154 added a commit to boomanaiden154/gematria that referenced this pull request Dec 30, 2024
This patch adds a default benchmark scheduler. This scheduler assumes
the worker performing the benchmarking has three hyperthreads available
inside its CPU mask, with two of them being part of a pair (from the
same core). It then selects one core from the pair to be used for the
benchmarking subprocess, and selects the core outside of the pair to be
used to run the main exegesis/python program. Verification is also added
to ensure that nothing external to the program changes the process mask,
or at least to catch it early if it does happen.

Pull Request: google#271
Created using spr 1.3.4

[skip ci]
Created using spr 1.3.4
gematria/datasets/pipelines/benchmark_cpu_scheduler.py Outdated Show resolved Hide resolved
gematria/datasets/pipelines/benchmark_cpu_scheduler.py Outdated Show resolved Hide resolved
gematria/datasets/pipelines/benchmark_cpu_scheduler.py Outdated Show resolved Hide resolved
gematria/datasets/pipelines/benchmark_cpu_scheduler.py Outdated Show resolved Hide resolved
gematria/datasets/pipelines/benchmark_cpu_scheduler.py Outdated Show resolved Hide resolved
gematria/datasets/pipelines/benchmark_cpu_scheduler.py Outdated Show resolved Hide resolved
boomanaiden154 added a commit to boomanaiden154/gematria that referenced this pull request Dec 31, 2024
This patch adds a default benchmark scheduler. This scheduler assumes
the worker performing the benchmarking has three hyperthreads available
inside its CPU mask, with two of them being part of a pair (from the
same core). It then selects one core from the pair to be used for the
benchmarking subprocess, and selects the core outside of the pair to be
used to run the main exegesis/python program. Verification is also added
to ensure that nothing external to the program changes the process mask,
or at least to catch it early if it does happen.

Pull Request: google#271
Created using spr 1.3.4

[skip ci]
Created using spr 1.3.4
boomanaiden154 added a commit to boomanaiden154/gematria that referenced this pull request Dec 31, 2024
This reverts commit 86a1c06.

I apparently accidentally fixed up google#271 into google#270. This reverts the
changes that accidentally made there way into the tree.

Pull Request: google#276
boomanaiden154 added a commit to boomanaiden154/gematria that referenced this pull request Dec 31, 2024
This patch adds a default benchmark scheduler. This scheduler assumes
the worker performing the benchmarking has three hyperthreads available
inside its CPU mask, with two of them being part of a pair (from the
same core). It then selects one core from the pair to be used for the
benchmarking subprocess, and selects the core outside of the pair to be
used to run the main exegesis/python program. Verification is also added
to ensure that nothing external to the program changes the process mask,
or at least to catch it early if it does happen.

Pull Request: google#271
Created using spr 1.3.4
boomanaiden154 added a commit to boomanaiden154/gematria that referenced this pull request Dec 31, 2024
This patch adds a default benchmark scheduler. This scheduler assumes
the worker performing the benchmarking has three hyperthreads available
inside its CPU mask, with two of them being part of a pair (from the
same core). It then selects one core from the pair to be used for the
benchmarking subprocess, and selects the core outside of the pair to be
used to run the main exegesis/python program. Verification is also added
to ensure that nothing external to the program changes the process mask,
or at least to catch it early if it does happen.

Pull Request: google#271
Created using spr 1.3.4
Created using spr 1.3.4
boomanaiden154 added a commit to boomanaiden154/gematria that referenced this pull request Dec 31, 2024
This patch adds a default benchmark scheduler. This scheduler assumes
the worker performing the benchmarking has three hyperthreads available
inside its CPU mask, with two of them being part of a pair (from the
same core). It then selects one core from the pair to be used for the
benchmarking subprocess, and selects the core outside of the pair to be
used to run the main exegesis/python program. Verification is also added
to ensure that nothing external to the program changes the process mask,
or at least to catch it early if it does happen.

Pull Request: google#271
Created using spr 1.3.4
boomanaiden154 added a commit to boomanaiden154/gematria that referenced this pull request Jan 16, 2025
This patch adds a default benchmark scheduler. This scheduler assumes
the worker performing the benchmarking has three hyperthreads available
inside its CPU mask, with two of them being part of a pair (from the
same core). It then selects one core from the pair to be used for the
benchmarking subprocess, and selects the core outside of the pair to be
used to run the main exegesis/python program. Verification is also added
to ensure that nothing external to the program changes the process mask,
or at least to catch it early if it does happen.

Pull Request: google#271
Created using spr 1.3.4
boomanaiden154 added a commit that referenced this pull request Jan 16, 2025
This reverts commit 86a1c06.

I apparently accidentally fixed up #271 into #270. This reverts the
changes that accidentally made there way into the tree.

Reviewers: ondrasej, orodley

Reviewed By: ondrasej

Pull Request: #276
boomanaiden154 and others added 2 commits January 16, 2025 22:12
Created using spr 1.3.4

[skip ci]
Created using spr 1.3.4
@boomanaiden154 boomanaiden154 changed the base branch from users/boomanaiden154/main.add-default-benchmark-scheduler to main January 16, 2025 22:15
boomanaiden154 added a commit to boomanaiden154/gematria that referenced this pull request Jan 17, 2025
This patch adds a default benchmark scheduler. This scheduler assumes
the worker performing the benchmarking has three hyperthreads available
inside its CPU mask, with two of them being part of a pair (from the
same core). It then selects one core from the pair to be used for the
benchmarking subprocess, and selects the core outside of the pair to be
used to run the main exegesis/python program. Verification is also added
to ensure that nothing external to the program changes the process mask,
or at least to catch it early if it does happen.

Pull Request: google#271
@boomanaiden154 boomanaiden154 merged commit 992299a into main Jan 17, 2025
11 of 13 checks passed
@boomanaiden154 boomanaiden154 deleted the users/boomanaiden154/add-default-benchmark-scheduler branch January 17, 2025 16:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants