Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release/v 1.3.0 #1298

Merged
merged 104 commits into from
May 1, 2024
Merged

Release/v 1.3.0 #1298

merged 104 commits into from
May 1, 2024

Conversation

shuds13
Copy link
Member

@shuds13 shuds13 commented Apr 25, 2024

Ref #1268

jlnav and others added 30 commits March 20, 2024 12:59
…worker on thread (#1216)

** Commit Highlights: **

* first round of refactoring runners.py, Runner base class for normal in-place launches, but based on the contents of passed-in specs, instantiates the relevant subclass

* ThreadRunner uses comms.QCommThread, slightly modified, to launch its user function. corresponding unit test

* removing now-redundant content from manager, trying to see if we can start a temporary, local Worker for handling work

* use _Worker class to correctly index into W and wcomms. add initial option to libE_specs

* add "threaded" tentative option to sim/gen_specs

* fix ThreadRunner shutdown when that worker didn't launch a thread

* adjust alloc_support to not use w - 1 indexing

* add tentative gen_on_manager option, separate additional_worker_launch into function

* move _WorkerIndexer into libensemble.utils, also use within PersistentSupport

* manager also needs to send workflow_dir location to worker 0

* simply gen_workers parameter description for avail_worker_ids

* filter for gen_workers within avail_worker_ids, if set and there are gen_workers. solution resembles zrw, like shuds predicted all along!

* refactor give_sim_work_first for running on gen_workers if no points_to_evaluate. add test for mixed existing sample plus calling a gen

* it turns out that values set by validators are still considered "unset". So for updating purposes for libE_specs, we want to exclude fields that are still set to their defaults

* platform_specs sometimes seems to be at risk of disappearing when we convert LibeSpecs to dict, so lets save it and reinsert

* add libE_specs["gen_workers"] option, adjust ensure_one_active_gen so multiple gen work orders aren't given out at once

** Major features: **

* runners.py refactored to more easily develop additional methods to submit/run user functions

* User functions can be launched by workers on separate threads alternatively to calling in-place.

* Generator can be launched on the Manager - various refactors to make this possible

* gen_workers option to specify workers that should run generators only

* Various bugfixes and refactors of allocation functions

---------

Co-authored-by: shudson <shudson@anl.gov>
Co-authored-by: Jeffrey Larson <jmlarson@anl.gov>
Fixing issue with start/end crossrefs
Bumps [pytest-cov](https://github.com/pytest-dev/pytest-cov) from 4.1.0 to 5.0.0.
- [Changelog](https://github.com/pytest-dev/pytest-cov/blob/master/CHANGELOG.rst)
- [Commits](pytest-dev/pytest-cov@v4.1.0...v5.0.0)

---
updated-dependencies:
- dependency-name: pytest-cov
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
…st-cov-5.0.0

Bump pytest-cov from 4.1.0 to 5.0.0
Bumps [crate-ci/typos](https://github.com/crate-ci/typos) from 1.19.0 to 1.20.0.
- [Release notes](https://github.com/crate-ci/typos/releases)
- [Changelog](https://github.com/crate-ci/typos/blob/master/CHANGELOG.md)
- [Commits](crate-ci/typos@v1.19.0...v1.20.0)

---
updated-dependencies:
- dependency-name: crate-ci/typos
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Bumps [globus-compute-sdk](https://github.com/funcx-faas/funcx) from 2.15.0 to 2.17.0.
- [Release notes](https://github.com/funcx-faas/funcx/releases)
- [Changelog](https://github.com/funcx-faas/funcX/blob/main/docs/changelog.rst)
- [Commits](globus/globus-compute@2.15.0...2.17.0)

---
updated-dependencies:
- dependency-name: globus-compute-sdk
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
…us-compute-sdk-2.17.0

Bump globus-compute-sdk from 2.15.0 to 2.17.0
…evelop/crate-ci/typos-1.20.0

Bump crate-ci/typos from 1.19.0 to 1.20.0
@shuds13 shuds13 marked this pull request as ready for review May 1, 2024 18:55
@shuds13 shuds13 requested a review from jmlarson1 May 1, 2024 18:55
Copy link

codecov bot commented May 1, 2024

Codecov Report

Attention: Patch coverage is 81.51515% with 61 lines in your changes are missing coverage. Please review.

Project coverage is 73.94%. Comparing base (325abb2) to head (09ef5ba).
Report is 44 commits behind head on main.

Files Patch % Lines
...ble/alloc_funcs/start_persistent_local_opt_gens.py 0.00% 9 Missing ⚠️
libensemble/utils/runners.py 80.00% 7 Missing and 2 partials ⚠️
libensemble/gen_funcs/persistent_ax_multitask.py 0.00% 8 Missing ⚠️
libensemble/manager.py 85.96% 4 Missing and 4 partials ⚠️
libensemble/tools/test_support.py 46.66% 5 Missing and 3 partials ⚠️
libensemble/alloc_funcs/start_fd_persistent.py 0.00% 7 Missing ⚠️
libensemble/comms/comms.py 78.57% 3 Missing ⚠️
libensemble/alloc_funcs/fast_alloc.py 81.81% 2 Missing ⚠️
libensemble/alloc_funcs/only_one_gen_alloc.py 86.66% 2 Missing ⚠️
libensemble/alloc_funcs/inverse_bayes_allocf.py 83.33% 0 Missing and 1 partial ⚠️
... and 4 more
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1298      +/-   ##
==========================================
+ Coverage   72.61%   73.94%   +1.32%     
==========================================
  Files          90       90              
  Lines        8151     8243      +92     
  Branches     1458     1464       +6     
==========================================
+ Hits         5919     6095     +176     
+ Misses       1996     1934      -62     
+ Partials      236      214      -22     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@shuds13 shuds13 merged commit 99934db into main May 1, 2024
16 checks passed
@jmlarson1 jmlarson1 deleted the release/v_1.3.0 branch July 2, 2024 20:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

3 participants