- Speed up final constraint enforcement (#1286)
- resource: make feasibility service registration optional (#1281)
- qmanager-stats: fix jansson refcount issue (#1273)
- qmanager: fix lifetime issue in partial release (#1277)
- move feasibility service into sched-fluxion-resource and fix associated test (#1276)
- update satisfiability RPC to conform with RFC 27 (#1275)
- Require gcc version 12 or higher and clang version 15 or higher (#1272)
- docker-run-checks: export INSTALL_ONLY (#1279)
- mergify: update to new mergify.yml requirements (#1278)
- Resolve issues with Alpine linux and build release containers for amd64 and arm64 (#1274)
- deps: add install-deps.sh script, use in docker (#1282)
- scripts: add build-matrix script to ease matching ci (#1283)
- Update build and ci to enforce compiler versions, bump to C++23, remove vestigial deps, and generate images matching core (#1272)
- alpine: use root to avoid nosuid issue in ci (#1280)
- flux-sharness: sync with flux-core (#1252)
- graph: use builtin bidirectional graph (#1240)
- ion-resource: add meaningful error message when subcommand is missing (#1243)
- Don't add pruning filter for leaf vertices (#1248)
- qmanager: add get-stats and clear-stats callbacks (#1265)
- String interner for subsystems and resource types and initial usage (#1246)
- Support and handle optional "final" flag in .free RPC (#1266)
- qmanager: annotate each job only once on reservation (#1250)
- interner/res_type: add a refcounted backend for interned strings (#1262)
- traverser: set iter count when request_feasible returns < 0 (#1263)
- Reformat (#1218)
- chore: flux ion-resource jobspec argument redundancy (#1244)
- actions/docker: add
el9,f40,noble drop focal (#1257) - matrix: add explicit python path for el8 (#1256)
- pre-commit: show diff on failure (#1267)
- Add support for broker rank-based partial release (#1163)
- planner/dfu: avoid dereferencing empty vector (#1239)
- graph: remove unused subsystem selector class (#1241)
- qmanager: Asynchronously communicate with resource in the scheduling loop to allow job updates while matching (#1227)
- pruner: don't track own type for pruning (#1228)
- Excise filter (#1225)
- qmanager: restart sched loop on updates (#1236)
- qpolicy/base: schedulable on reconsider (#1224)
- dfu: add a quick-to-test feasibility precheck to match (#1232)
- Fix match average calculation (#1233)
- github-actions: actually push the flux-sched manifest (#1235)
- checks_run: work when no autogen.sh is present (#1234)
- Add jobid and schedule iteration count to match stats; make perf a global variable (#1205)
- make backfill reactive during sched loop (#1211)
- qmanager: always process unblocked jobs (#1211)
- qmanager: search blocked jobs during pending removal (#1209)
- qmanager: reconsider blocked jobs on reprioritize (#1217)
- avoid copying of std::map in
out_edges(#1206)
- comment blocks: stop using full-star boxes (#1216)
- test/match-formats: make jq command valid (#1213)
- cmake: ensure we install libraries to our prefix (#1203)
- Test repair (#1207)
- qmanager: defer jobs with unmatchable constraints (#1188)
- Add planner reinitialization for elasticity (#1156)
- Update match stats and implement stats-clear (#1168)
- Add sanitizers (#1179)
- reduce unnecessary logging (#1186)
- Update stats output to include data for failed matches (#1187)
- Implement rv1exec reader update to facilitate Fluxion reload (#1176)
- refactor: optmgr to simpler design, one file (#1177)
- autoconf removal (#1196)
- queue_base_manager: refactor to remove impl (#1178)
- cmake: look for ver file in source directory (#1199)
- docker-run-checks: ensure we match user's home (#1197)
- Add sanitizers (#1179)
- resource: ensure all resources start in DOWN state when some ranks are excluded by configuration (#1183)
- docs/cmake:stop constantly rebuilding manpages (#1190)
- qmanager: split remove to separate pending (#1175)
- up the required C++ standard to 20 (#1174)
- test: run t10001 under flux (#1181)
- testsuite: add valgrind suppressions for hwloc (#1173)
- ci: update deprecated github actions (#1191)
- Improve match performance with node constrains when feasibility is enabled (#1162)
- policies: add firstnodex to the known policies (#1161)
- reader: fix jgf properties (#1149)
- Replace deprecated 'flux job cancel[all]' usage (#1157)
- Correct typo into 'because'. (#1155)
- Add match options and match satisfy to reapi (#1133)
- Build reapi_cli as a shared library (#1120)
- configure: drop src/shell requirements (#1141)
- Improve sched.resource-status RPC and search performance (#1144)
- Planner comparison and update (#1061)
- debbuild: fix Python purelib paths on Debian systems (#1139)
- Fix overflow in
calc_factor(#1132)
- testsuite: prepare for flux_job_wait(3) change (#1147)
- testsuite: remove trailing ampersands in tests (#1145)
- Reactivate planner_multi and schema unit tests (#1131)
- python: add a 'status' parameter to FluxionResourcePool (#1123)
- flux-ion-resource: move to src/cmd and install (#1127)
- Fix 'resource_pool_t' constructor and JGF reader (#1125)
- resource: add a set-status RPC for marking vertices up/down (#1110)
- fix race conditions in t4011-match-duration.t (#1109)
- resource: support resource expiration updates (#1105)
- traverser: fix default job duration when no duration specified (#1104)
- shell: remove data-staging shell plugin (#1102)
- ci: fix coverage build (#1106)
- ci: do not force configure --prefix to /usr (#1100)
- ci: remove deprecated syntax and update release action (#1097)
- Add first nodex policy (#1055)
- Enable Fluxion resource graph elasticity (#989)
- add delete subgraph functionality (#1053)
- Update branch of golang release (#1062)
- rc: use posix shell (#1070)
- Remove flux-tree (#1056)
- Add missing config.h globally (#1054)
- Add cmake build system (#1049, #1071, #1082, #1086, #1090, #1094)
- Add development environment (#1045)
- ci: style checks change python version from 3.6 to 3.8 (#1080)
- Change binfmt flags to ensure setuid is enabled in qemu-user-static supported CI runs (#1077)
- docker: avoid sudo in Dockerfile for arm runner (#1076)
- testsuite: improve test event check (#1074)
- fix: devcontainer to use jammy and install cmake (#1067)
- actions: update typo checker version (#1063)
- mergify: remove rule listing, use branch protection (#1060)
- transition bionic containers to jammy (#1057)
- testsuite: drop resource exclusion test (#1051)
This release fixes a critical bug (#1043) where resources that are allocated to a job that exceeds its time limit could be re-allocated to a new job while the first job is still in CLEANUP state.
- reapi: implement find (#1020)
- Prevent allocation of currently allocated resources (#1046)
- mark all ranks known to graph when "all" is specified (#1042)
- planner: ensure result in planner_avail_resources_at (#1038)
- testsuite: t1024-alloc-check.t: do not fail if rank 0 not drained (#1047)
- testsuite: add test for double-booking (#1044)
- Add false positives typos config (#1030)
- Update sphinx version (#1032)
- ensure licenses appear in distribution tarball (#1031)
- add spell check for news and readme (#1021)
- build: add
make debtarget to build test debian package (#1024) - testsuite: drop meaningless check (#1023)
- testsuite: make module list awk less fragile (#1022)
- performance: fix match performance degradation (#1007)
- resource: fix GCC build errors (#1011)
- testsuite: update uses of
flux mini CMD(#1010) - github: add workflow dispatch (#1012)
- support for RFC 31 Job Constraints (#997)
- report Fluxion version when broker modules are loaded (#998)
- reapi: Rename resource/hlapi to resource/reapi (#983)
- resource: improve error messages for jobspec parse errors (#1003)
- resource: fix 'Internal match error' when hostlist constraint is provided (#1005)
- testsuite: adjust expectations of recovery in
rv1_noschedmode (#1000) - testsuite: do not assume queues started by default (#996)
- testsuite: start/stop all queues with --all option (#992)
- github: change ubuntu version for python ci (#993)
- testsuite: update flux-tree-helper.py for new OutputFormat constructor (#985)
Note: the flux-sched test suite requires flux-core 0.44.0 or newer.
- qmanager: support RFC33 TOML queue config (#980, #971)
- Resource graph duration and job expiration to conform to RFC 14 (#969)
- Fix REAPI C++ bindings (#974)
- add an exception note to fatal queue exceptions (#957)
- rc: combine fluxion rc scripts (#958)
- move flux-tree to the test suite (#956)
- build: drop unnecessary preqreqs, update README (#954)
- testsuite: fix coverage method for queue exception (#978)
- testsuite: cover queues with non-overlapping resource constraints (#976)
- testsuite: fix integer overflow (#968)
- testsuite: use explicit duration units (#966)
- minor cleanup (#973, #959)
- Always emit exclusive resources with --exclusive (#951)
- Add property constraints-based matching support (#922)
- qmanager: fix potential leak in alloc callback (#943)
- hlapi: workaround integer compare error with gcc 9.4.0 (#937)
- docs: fix code sample in resource README (#935)
- Fix an integer overflow bug etc. (#933)
- reader: fix index type (#934)
- Don't assume each hierarchical path is unique (#924)
- Add rv1exec reader support (#921)
- resource: support discovery of AMD RSMI GPUs in hwloc reader (#918)
- testsuite: disable hwloc reader tests (#926)
- testsuite: disable more failing test that need resource.get-xml (#929)
A minor release fixing two problems discovered during system instance testing of v0.21.0.
- Encode the nodelist key in strict rank order (#893, #916)
- build: fix missing doc file in distributed tarball (#915)
Check out our new node-exclusive scheduling support!
- HLAPI: add CLI initialization and implement match_allocate, cancel, and info (#888)
- fluxion-resource: Introduce multilevel ID match policy support (#895)
- fluxion-resource: Add node-exclusive scheduling (#900)
- doc: add infrastructure for sphinx documentation (#906)
- config: Add TOML config support for sched-fluxion-[qmanager|resource] (#906, #910)
- doc: add LLNL code release number to README.md (#885)
- build: Fix compilation issues with clang-12 and gcc-11 (#891)
- build: add JANSSON_CFLAGS into Makefile.am (#892)
- Replace DBL_MAX with std::numeric_limits (#902)
- testsuite: fix a couple brittle tests (#909)
- testsuite: use flux mini not flux jobspec (#884)
- t5000-valgrind.t: do not run valgrind test by default (#887)
- testsuite: drop flux overlay status from test (#890)
- mergify: update configuration to replace deprecated keys (#901)
- ci: rename centos7 and centos8 docker images to el7 and el8 (#904)
- testsuite: update flux-sharness.sh and add fedora34 (#905)
This version of Fluxion lays a foundation for node-exclusive scheduling, which will use a moldable jobspec to match every node-local resource of each selected compute node.
- jobspec: make max/operator/operand optional (#879)
- resource: improve effective max calc performance for operator="+" (#882)
- resource: beefing up min/max count-based matching (#878)
- build: drop ax_python_devel.m4 (#881)
This version of Fluxion includes bug fixes for the issues discovered during system instance testing on an LLNL cluster.
- Add
sched.feasibilityservice for flux-core's jobspec feasibility validator (#871)
- queue: add provisional queuing for reprioritization in support of async. execution (#862)
- resource: fix a satisfiability bug with backfilling (#859)
- testsuite: fix logging test in t7000-shell-datastaging.t (#865)
- Using static_cast to ensure type compatibility in readers. (#858)
- Fix an assortment of issues discovered during system instance testing on LLNL's Fluke machine (#872)
- data-staging: define FLUX_SHELL_PLUGIN_NAME (#864)
This version of Fluxion includes updates required for compatibility with flux-core v0.29.0.
- resource: update for libflux API change (#852)
This version re-releases Fluxion under the LGPL-3.0 license.
This version also changes the default match policy to first-match and the default queue-depth to 32, resulting in further performance improvements.
- LLNS re-release under LGPL-3.0 (#850)
- python: export FluxionResource classes (#845)
- Default policy changes (#843)
- Fix cancel race (#838)
- bugfix: include missing header (limits.h) (#837)
- datastaging: add -avoid-version to LDFLAGS (#835)
- Replace GNU readline with editline (#849)
- planner: port to Yggdrasil's augmented red-black library (#846)
- github: fix ci builds on master (#848)
- github: fixes for auto-release deployment (#834)
Note: Do you have a need to run high-throughput workloads at large scale? Check out this version. It combines our new first-match policy with asynchrous communications to significantly improve scheduling scalability.
- Add async FCFS policy support and other scheduling optimization (#826)
- Add "ultrafast" first-match policy support (#820)
- CI: Add fedora33 for gcc10 (#825)
- libczmqcontainers: introduce new internal library of czmq zhashx library (#822)
- Add bug fix for by_subplan pruning (#817)
- resource: fix 'namespace' spelling (#813)
- Add minor C++ safety improvements (#809)
- sharness: update flux start options (#823)
- testsuite: fix shell path discovery in datastaging test (#810)
- Implement unpack_at for JGF (#775)
- qmanager: support re-prioritization of jobs (#803)
- fluxion-R: add flux-ion-R.py as a public command (#800)
- ci: migrate to github actions (#794)
- traverser: fix segfault for bi-edge traversal (#775)
- qmanager: update per libschedutil API changes (#801)
- mergify: fix referenced test name (#804)
- Globally standardize spelling of "canceled" (#797)
Note: In support of fully hierarchical scheduling for our workflow users, Fluxion is now capable of correctly discovering and scheduling GPUs at any level of nesting.
- ci: drop unnecessary flux keygen (#788)
- shell: reduce logging verbosity of datastaging plugin (#779)
- t0000-sharness.sh: fix test with debug/verbose set in env (#784)
- codecov: ignore vendored json.hpp (#774)
- use RV1+JGF JSON from resource.acquire to populate graph data store (#787)
- execution target and core/gpu Id remapping support for nesting (#773, #787)
- Globally rename "administrative priority" to "urgency" (#781)
- expect Rv1 from resource.acquire, use flux resource reload (#766)
- update configs for travis-ci.com migration (#769)
- Add support for nodelist for RV1 change and R_lite compression (#764)
- Add job shell plugin for data staging on tiered storage systems (#743)
- qmanager: remove
t_estimatewhen job alloc succeeds (#746) - rc: avoid unloading sched-simple, which is no longer loaded by default (#749)
- rc: only load/unload scheduler on rank 0 (#741)
- makefile: workaround boost errors under latest compilers (#757)
Note: Fluxion can now annotate its jobs with their
start-time estimate and queue info (to be displayed by flux-jobs).
- Handle invalid sibling requests in jobspecs more gracefully (#737)
- Fix various errors detected when tests are run under valgrind (#734)
- fluxion-resource: check return value of
find_first_not_of(#715)
- Add support for job annotation including its start-time estimate (#735)
- Add support for node-local storage to hwloc reader (#714)
- flux module load returns early for staggered system-instance bring-up (#719)
- Update for non-integer jobid encodings (#718)
- Use version 9999 for test jobspecs (#739)
Note: Fluxion now uses flux-core's resource service to acquire resources to schedule.
- qmanager: support for ordering pending jobs by priority/submit time (#694)
- testsuite: increase wait-event timeouts (#692)
- testsuite: enable valgrind testing (#703)
- resource: errno support for std::ifstream open (#698)
- Undo compiler workarounds (#697)
- Add support for hwloc 2.0+ (#677)
- Augment multi-tiered storage scheduling test (#673)
- Integrate with flux-core's resource module (#665, #667, #674, #693, #694)
- Update for flux-core annotation support changes (#681)
- Update pkg dependency matrix in README.md (#696)
- Globally rename whitelist to allowlist (#690)
Note: flux-sched has been re-branded to "Fluxion"!
- testsuite: break a race in a qmgr reload test (#617)
- testsuite: avoid rc3 hang in qmanager-reload test (#593)
- Fix build/test issues and enable travis on CentOS 8 (#565)
- t4000-match-params.t: suppress flux module unload failure (#561)
- Fix t2002-qmanager-reload.t with new core resource module (#661)
- docker: add ENTRYPOINT to start munged by default (#648)
- testsuite: prevent python version mismatch in test scripts (#568)
- Add state recovery support (#663, #666)
- qmanager: add multi-queue support (#649)
- Add flux-tree (#622, #621, #616, #582)
- Add configuration file support (#599, #645, #630)
- Multi-tiered storage scheduling support demo and tests (#620)
- Update the project name to Fluxion (#655)
- qmanager: add exception safety for schedutil callbacks (#646)
- Add path, vertex pair to by_path map (#641)
- testsuite: update flux-sharness.sh from flux-core (#657)
- Use Jansson for JSON-based writers + time keys in RV1 (#614)
- rc: use reload -f to load qmanager/resource (#619)
- simplify build process and instructions (#603, #578, #595, #578, #579)
- testsuite: update flux-job list usage (#571)
- mergify: add config from flux-core (#562)
- github: add workflow action to validate PR commits (#553)
- drop flux module -r option (#557)
- resource/sched/simulator: update KVS API usage (#435)
- build: fix build issues for priority_mod_fair_tree.so (#434)
- api: sync flux-sched with removed interfaces in flux-core (#440)
- resource: update for kvs watch API removal (#442)
- API: remove the use of deprecated Python API (#450)
- resource: update to flux_respond_error() (#457)
- resource: bug fix for incorrectly handling implicit exclusivity (#502)
- libschedutil: remove vendored copy and use flux-core's exported lib (#516)
- testsuite: update flux-sharness.sh to version from flux-core (#523)
- rc3: Fix a bug in RC3 dir definition within configure.ac (#525)
- resource: fix buffer overflow when handling slot type in a jobspec (#548)
- qmanager: integrate with the new exec system (#481)
- qmanager: add hello/exception callback support (#493)
- qmanager: add EASY/HYBRID/CONSERVATIVE policies (#504)
- resource: RFC20 resource set specification version 1 support (#455)
- resource: add hwloc whitelist support (#467)
- resource: add set- and get-property support (#490, #513)
- resource: add support for checking a job's satisfiability (#503)
- resource: support for variation-aware scheduler (#517)
- resource: add JGF reader support (#521)
- resource: resource graph metadata (by_path) optimization (#536)
- libjobspec: update command to be list instead of list or string (#549)
- resource: add resource update support (#543)
- add smart pointer support and misc. cleanup (#537)
- test: add test cases to support systems with disaggregated resources (#460)
- test: add test cases for AMD GPUs (#464)
- resource: tidy up JGF match writer support (#520)
- sched/plugin: track flux-core module API changes (#414)
- Ensure scheduling correctness with different prune filter configurations (#419)
- travis: fix docker and github release deployment (#424)
- travis-ci: fix docker deploy better (#426)
- docker: update repo tag names, ensure flux-sched installed with prefix=/usr (#427)
- docker: add yaml-cpp dependency (#428)
- config: Fix a non-portable use of schell conditionals for automake (#405)
- config: Add libtoolize into autogen.sh (#406)
- Integrate jobspec into resource, etc (#398)
- Compilation fixes (#417)
- travis-ci: use docker for test builds (#392)
- resource: support for hwloc ingestion (#385)
- Add support for resource matching service (#386)
- planner: Replace zhash_t to zhashx_t for higher performance (#391)
- resource: wire in --prune-filters option for resource-query and matching module (#401)
- resource: Add run-level support for resource matching module (#418)
- Add better autoconf support for libboost (#394)
- build: do not install libflux-rdl.so, fix rebuild of aclocal.m4 on first make (#421)
- sched: remove trailing whitespaces (#376)
- sched: fix request handler type mismatch on i386 (#346)
- sched: Fix a job resrc_tree memory leak (#365)
- sched: Print error messages when schedule_job cannot run (#348)
- simulator: track a flux-core API change (#351)
- resource: Introduce planner_multi_t (#349)
- Add hwloc-based GPU scheduling support (#354)
- add sched parameter get & set commands to wreck (#362)
- rdl: Lua 5.2 compatibility (#373)
- travis: change email notifications to go to the flux-sched-dev listserv (#353)
- c++ configuration changes to mirror flux-core (#270)
- track upstream changes in flux-core APIs (#271, #272, #278)
- portability fixes for Ubuntu 16.04 and 17.10 (#298, #301)
- fixes for hwloc input xml (#310)
- add pending job cancellation support (#291)
- add support for excluding resources for specific nodes (#305)
- support for GPU scheduling (#313)
- add new, more scalable resource assignment schema in kvs (R_lite) (#321)
- include host names in R_lite resource assignment data (#324)
- optimize queue-depth=1 FCFS (#294)
- support for enhanced wreck submitted state event (#295)
- support for new completing state for wreck jobs (#341)
- add planner and resource-query utility support (#283, #323, #325, #274, #281)
- initial priority plugin development (#290)
- testsuite enhancements (#316, #328, #331)
- drop old rank.N method for resource assignment (#339)
- Fix allocation of cores unevenly across nodes (#226)
- Fixes and updates to track latest libflux-core API changes (#255, #253, #246, #238, #234)
- simulator: fix and re-enable sim integration tests (#250)
- Fix autoreconf when using side-installed autotools (#243)
- flux-waitjob: fixes to avoid flux-core issue #1027 (#244)
- Other fixes (#227, #231)
- simulator: add ISO time parsing to job traces (#260)
- resrc: add resource API context support (#236)
- simulator: refactor, cleanup, and ensure proper initialization. (#240, #250)
-
Support resource membership in multiple hierarchies and include "flow graphs" for modeling flow resources such as power and bandwidh. Enhance find/select of resources to support consideration of power, bandwidth, etc. (#189)
-
Add configurable scheduling optimizations for throughput-oriented workloads (#190, #191):
sched-params=queue-depth=<k>: limits the number of jobs to consider per scheduling loopsched-params=delay-scheduling=true: delays scheduling to batch up individual scheduling events
- Updates to track changes in flux-core (#188, #207, #212, #216)
-
Update JSON handling to libjansson (#215, #220)
-
Simulator updates and cleanup (#203, 218, #219)
-
RDL enhancements for multi-hierarchy support (#196)
-
Do not assume kvs path to jobid is in lwj.jobid (#216)
-
Versatile scheduling: replace resource tree list searches with tree searches.
-
Runtime selection of backfill algorithm (#159). Examples of selecting various algorithms are (first remove any loaded sched plugin, e.g., flux module remove sched.fcfs):
- Conservative :
flux module load sched.backfill reserve-depth=-1 - EASY :
flux module load sched.backfill reserve-depth=1 - Hybrid :
flux module load sched.backfill reserve-depth=4 - Pure :
flux module load sched.backfill reserve-depth=0
-
Update to latest flux-core logging apis
-
Fix segfaults in simulator during shutdown
-
Small leak fixes in simulator
- Remove
sim_schedcode that ran under simulator. The simulator now interfaces directly with sched module.
- Initial release for build testing only