CompilerGym v0.2.5 #767

ChrisCummins · 2022-10-05T16:59:10Z

Release 0.2.5 (2022-11-01)

CompilerGym v0.2.5 adds a new LLVM dataset, two new observation spaces, and includes numerous updates and bug fixes.

Summary of Changes

[llvm] Added two new observation spaces, LexedIr and LexedIrTuple, providing access to a sequence of IR tokens (#742, thanks @fivosts!).
[llvm] Added the "Jotaibench" benchmark suite, providing 18,761 new executable C programs extracted from handwritten code on GitHub (#705, thanks @canesche!).
Added support for Python 3.10.
[llvm] Fixed a bug with non-terminating subprocesses (#741, thanks @thecoblack!).
[llvm] Fixed a bug where the incorrect number of runtimes were reported by reset() (#761), and an incorrect number of warm up runs were being performed (#717, thanks @lqwk!).
[llvm] New leaderboard submission using GATv2 and DD-PPO (#728, thanks @anthony0727!).
Added the ability to set timeout on each of the individual environment operations (#716, thanks @ricardoprins!).

Added support for loading URLs in CompilerEnvStateReader.read_paths() (#692, thanks @thecoblack!).

Simplified Makefile rules: renamed install-test to test and deprecated bazel test rules.
Fixed a bug where the TimeLimit wrapper would interfere with benchmark iterator wrappers (#739, thanks @nluu175!).
[ci] Added CI test coverage of example services (#695, #642, #699, thanks @mostafaelhoushi!).
[ci] Updated Github actions to use Node v16.
Reduced verbosity and wall time of CMake builds.
Updates and fixes dependent package conflicts (fixes ERROR: Cannot install -r requirements.txt (line 18), -r requirements.txt (line 2) and numpy<1.20.0 and >=1.19.3 because these package versions have conflicting dependencies. #771, env.fork() raises TypeError: "cannot convert dictionary update sequence element #0 to a sequence" #768).

Credits

A huge thank you to all code contributors!

@anthony0727
@canesche made their first contribution in #705
@fivosts made their first contribution in #742
@jaopaulolc made their first contribution in #738
@lqwk made their first contribution in #717
@mostafaelhoushi
@nluu175 made their first contribution in #739
@ricardoprins made their first contribution in #716
@ryanrussell made their first contribution in #755
@sahirgomez1
@thecoblack
@youweiliang made their first contribution in #751

Full Changelog: v0.2.4...v0.2.5

According to https://github.com/actions/download-artifact#permission-loss: ``` ❗ File permissions are not maintained during artifact upload ❗ ```

…ice_env_test enable `example_compiler_gym_service` unit tests in CI

Code style fixes

and also remove running examples during build-linux-cmake

On my local Linux VM, it seems that removing USES_TERMINAL solves the problem of that 3 hour hang after bazel build

…bazel-build Fix build hang by removing USES_TERMINAL from Programl Cmake command

Added support for loading URLs in CompilerEnvStateReader.read_paths()

It is very noisy otherwise.

This is to prevent an incompatibility between older versions of gym and importlib-metadata.

Addresses deprecation warnings from Github actions runner.

This is to fix a generic warning from gym library: UserWarning: WARN: The environment example-v0 is out of date. You should consider upgrading to version `v1` with the environment ID `example-v1`.

Mitigates warnings: WARN: Overriding environment example-v1

At this point 3.6 is quite lagging in features and some of dependencies have dropped support for it.

mostafaelhoushi and others added 30 commits June 7, 2022 16:23

Run examples in cmake CI

4344987

make pre-commit hook happy

0fe508d

install wheel so we can run the examples

2594cba

Fix typo in path of script

fee3e89

upload and download example binaries

088ee47

make pre-commit happy

2706976

Try removing mv command

f8213f2

Upload and download each binary separately

8aa1670

Mv binaries after downloading them

949596f

fix paths of examples

f9f9529

Try again with minor modifications

a946976

Show path and test existence of binaries

3afcee0

enable example_compiler_gym_service unit tests in CI

977c64a

fix echo and test commands

2efdc3d

add executable permission to binaries

4eab536

According to https://github.com/actions/download-artifact#permission-loss: ``` ❗ File permissions are not maintained during artifact upload ❗ ```

a modification to force CI to rerun

d877a4a

force CI to re-run

ad674cb

Merge pull request #699 from mostafaelhoushi/enable_compiler_gym_serv…

1f587ac

…ice_env_test enable `example_compiler_gym_service` unit tests in CI

Add missing licence headers.

4771536

[docs] Add Terms of Use and Privacy Policy links.

ea92d22

[docs] Update Copyright name.

772c704

Merge pull request #700 from ChrisCummins/fix/code-checkup

45fb0a0

Code style fixes

upload/download compute_programl binary

75d0968

and also remove running examples during build-linux-cmake

remove USES_TERMINAL from bazel Cmake command

2463ecd

On my local Linux VM, it seems that removing USES_TERMINAL solves the problem of that 3 hour hang after bazel build

Merge pull request #703 from mostafaelhoushi/mostafaelhoushi-speedup-…

5912cac

…bazel-build Fix build hang by removing USES_TERMINAL from Programl Cmake command

Merge pull request #692 from thecoblack/path

13a0d34

Added support for loading URLs in CompilerEnvStateReader.read_paths()

[ci] Add the --quiet flag when downloading with wget.

228a936

It is very noisy otherwise.

[ci] Remove verbose flag from tar extract.

b3e3dea

[service] Fix action space assignment.

9120ed5

[cmake] Add --batch flag to programl bazel build.

d28c4f5

[spaces] Prohibit empty named discrete spaces.

795ca79

ChrisCummins mentioned this pull request Oct 5, 2022

[llvm] Fix the number of runtime observations in reward reset. #761

Closed

Permit gym v0.21.

3142419

ChrisCummins mentioned this pull request Oct 12, 2022

ERROR: Cannot install -r requirements.txt (line 18), -r requirements.txt (line 2) and numpy<1.20.0 and >=1.19.3 because these package versions have conflicting dependencies. #771

Closed

ChrisCummins added 4 commits October 12, 2022 00:44

[core] Prevent benchmark attribute setting outside of constructor.

ef23178

Pin importlib-metadata version for python < 3.8.

cf039b6

This is to prevent an incompatibility between older versions of gym and importlib-metadata.

[tests] Fix regex matching argument.

97fc5aa

[examples] Update module path for A2C agent in ray.

0f84761

ChrisCummins mentioned this pull request Oct 31, 2022

[llvm] Add utility functions to split and merge benchmarks. #772

Merged

3 tasks

ChrisCummins added 6 commits November 1, 2022 15:38

[ci] Update actions to node v16 from v12.

f001059

Addresses deprecation warnings from Github actions runner.

[packaging] Use pip's requirements parser to install deps.

142ac8e

[examples] Fix the A2CTrainer module path.

2ae85a1

[tests] Update benchmark attribute test.

27865a4

Add a $(TEST_TARGET) option to examples Makefile.

3351f9a

[examples] Rename example-v0 to example-v1.

3f6b286

This is to fix a generic warning from gym library: UserWarning: WARN: The environment example-v0 is out of date. You should consider upgrading to version `v1` with the environment ID `example-v1`.

ChrisCummins force-pushed the release/v0.2.5 branch from d6f9353 to b98a52a Compare November 1, 2022 22:38

CompilerGym v0.2.5.

b927a61

ChrisCummins force-pushed the release/v0.2.5 branch from b98a52a to b927a61 Compare November 1, 2022 22:38

ChrisCummins added 3 commits November 1, 2022 16:06

Merge branch 'jotaibench' into release/v0.2.5

b36af8a

Updates and fixes for jotai benchmark dataset.

160e883

Rename example-v1 to compiler-example-v0.

a664d33

Mitigates warnings: WARN: Overriding environment example-v1

ChrisCummins marked this pull request as ready for review November 2, 2022 00:35

ChrisCummins added 3 commits November 1, 2022 17:37

[llvm] Fix name of dataset in test.

c436418

Drop support for Python 3.6.

a48c9f5

At this point 3.6 is quite lagging in features and some of dependencies have dropped support for it.

Add changelog for CompilerGym v0.2.5.

24c7c30

ChrisCummins force-pushed the release/v0.2.5 branch from 34cd68d to 24c7c30 Compare November 2, 2022 00:42

ChrisCummins added 3 commits November 1, 2022 17:48

[docs] Remove empty link.

3d8ae50

[docs] Update sphinx dependency version.

9ac9284

[tests] Update environment test name.

fd26fd5

ChrisCummins merged commit 64bdd6c into stable Nov 2, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

CompilerGym v0.2.5 #767

CompilerGym v0.2.5 #767

ChrisCummins commented Oct 5, 2022 •

edited

Loading

CompilerGym v0.2.5 #767

CompilerGym v0.2.5 #767

Conversation

ChrisCummins commented Oct 5, 2022 • edited Loading

Release 0.2.5 (2022-11-01)

Summary of Changes

Credits

ChrisCummins commented Oct 5, 2022 •

edited

Loading