Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

{devel}[foss/2023b] TensorFlow v2.15.1, Bazel v6.3.1, dill v0.3.8, flatbuffers-python v23.5.26, grpcio v1.57.0, ml_dtypes v0.4.0, nsync v1.29.2 #21169

Open
wants to merge 16 commits into
base: develop
Choose a base branch
from

Conversation

tanmoy1989
Copy link
Contributor

@tanmoy1989 tanmoy1989 commented Aug 12, 2024

(created using eb --new-pr)

…ore-13.2.0.eb, dill-0.3.8-GCCcore-13.2.0.eb, flatbuffers-python-23.5.26-GCCcore-13.2.0.eb, grpcio-1.57.0-GCCcore-13.2.0.eb, ml_dtypes-0.4.0-gfbf-2023b.eb, nsync-1.29.2-GCCcore-13.2.0.eb
@boegel boegel changed the title {devel}[GCCcore/13.2.0] TensorFlow v2.15.1, Bazel v6.3.1, dill v0.3.8, ... {devel}[foss/2023b] TensorFlow v2.15.1, Bazel v6.3.1, dill v0.3.8, ... Aug 14, 2024
@boegel boegel added the update label Aug 14, 2024
@boegel boegel added this to the 4.x milestone Aug 14, 2024
@boegel
Copy link
Member

boegel commented Aug 14, 2024

@tanmoy1989 A bunch of patch files for Bazel are missing?

@tanmoy1989
Copy link
Contributor Author

@boegel: thanks, done!

tanmoy1989 and others added 2 commits September 4, 2024 16:10
@@ -69,7 +68,7 @@ exts_list = [
'checksums': ['aedf21eec7fb2dc91150fc91a1ce12bc44dbb72278a08b58e79ff87c9e28f153'],
}),
('Werkzeug', '3.0.2', {
'source_tmpl': SOURCELOWER_TAR_GZ,
'source_tmpl': '%(namelower)s-%(version)s.tar.gz',
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why this change?

Copy link
Contributor Author

@tanmoy1989 tanmoy1989 Sep 16, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Honestly the change was not intentional and also not manual. It appeared when I did: "eb --inject-checksums=sha256 --force Tensorflow-2.15.1-foss-2023b.eb" to include the two new patches - probably due to formatting by EasyBuild/Python?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I opened an issue for that: easybuilders/easybuild-framework#4695

Co-authored-by: Alexander Grund <Flamefire@users.noreply.github.com>
tanmoy1989 and others added 3 commits September 17, 2024 18:16
Co-authored-by: Alexander Grund <Flamefire@users.noreply.github.com>
Co-authored-by: Alexander Grund <Flamefire@users.noreply.github.com>
@pavelToman
Copy link
Collaborator

Is there any progress on this PR? I would use dill-0.3.8 in my PR.

@pavelToman
Copy link
Collaborator

@boegelbot please test @ generoso

@tanmoy1989
Copy link
Contributor Author

@pavelToman Thanks for triggering the bot. I am not aware of any further progress except me just waiting for someone to review it.

tanmoy1989 and others added 2 commits November 5, 2024 10:24
…b.eb

Co-authored-by: Adam Huffman <verdurin@users.noreply.github.com>
…b.eb

Co-authored-by: Adam Huffman <verdurin@users.noreply.github.com>
…b.eb

Co-authored-by: Adam Huffman <verdurin@users.noreply.github.com>
…b.eb

Co-authored-by: Adam Huffman <verdurin@users.noreply.github.com>
…b.eb

Co-authored-by: Adam Huffman <verdurin@users.noreply.github.com>
@verdurin
Copy link
Member

verdurin commented Nov 5, 2024

Test report by @verdurin
FAILED
Build succeeded for 16 out of 17 (7 easyconfigs in total)
easybuild-el8.cloud.in.bmrc.ox.ac.uk - Linux Rocky Linux 8.10, x86_64, Intel Xeon Processor (Skylake, IBRS), Python 3.6.8
See https://gist.github.com/verdurin/05b74e682325ef9bceae73de4aaa5924 for a full test report.

@boegelbot
Copy link
Collaborator

@pavelToman: Request for testing this PR well received on login1

PR test command 'EB_PR=21169 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs /opt/software/slurm/bin/sbatch --job-name test_PR_21169 --ntasks=4 ~/boegelbot/eb_from_pr_upload_generoso.sh' executed!

  • exit code: 0
  • output:
Submitted batch job 14617

Test results coming soon (I hope)...

- notification for comment with ID 2456621242 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

@tanmoy1989
Copy link
Contributor Author

@verdurin Looks like the failure is related to No space left on device and not particular related to TensorFlow?

@boegelbot
Copy link
Collaborator

Test report by @boegelbot
SUCCESS
Build succeeded for 7 out of 7 (7 easyconfigs in total)
cns1 - Linux Rocky Linux 8.9, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8
See https://gist.github.com/boegelbot/8bdaf113c6b73fabeda2465dcea607ac for a full test report.

@verdurin
Copy link
Member

verdurin commented Nov 6, 2024

Yes, I've restarted the build after cleaning up the build node.

@pavelToman
Copy link
Collaborator

@boegelbot please test @ jsc-zen3

@boegelbot
Copy link
Collaborator

@pavelToman: Request for testing this PR well received on jsczen3l1.int.jsc-zen3.fz-juelich.de

PR test command 'if [[ develop != 'develop' ]]; then EB_BRANCH=develop ./easybuild_develop.sh 2> /dev/null 1>&2; EB_PREFIX=/home/boegelbot/easybuild/develop source init_env_easybuild_develop.sh; fi; EB_PR=21169 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs EB_BRANCH=develop /opt/software/slurm/bin/sbatch --job-name test_PR_21169 --ntasks=8 ~/boegelbot/eb_from_pr_upload_jsc-zen3.sh' executed!

  • exit code: 0
  • output:
Submitted batch job 5199

Test results coming soon (I hope)...

- notification for comment with ID 2459478172 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

@verdurin
Copy link
Member

verdurin commented Nov 6, 2024

Test report by @verdurin
SUCCESS
Build succeeded for 7 out of 7 (7 easyconfigs in total)
easybuild-el8.cloud.in.bmrc.ox.ac.uk - Linux Rocky Linux 8.10, x86_64, Intel Xeon Processor (Skylake, IBRS), Python 3.6.8
See https://gist.github.com/verdurin/415a6cd280d57a8e62ad71b394065a79 for a full test report.

@boegelbot
Copy link
Collaborator

Test report by @boegelbot
SUCCESS
Build succeeded for 9 out of 9 (7 easyconfigs in total)
jsczen3c1.int.jsc-zen3.fz-juelich.de - Linux Rocky Linux 9.4, x86_64, AMD EPYC-Milan Processor (zen3), Python 3.9.18
See https://gist.github.com/boegelbot/2b476d11c4cc22494596694790a1e7f9 for a full test report.

Copy link

github-actions bot commented Nov 7, 2024

Updated software Bazel-6.3.1-GCCcore-13.2.0.eb

Diff against Bazel-6.1.0-GCCcore-12.3.0.eb

easybuild/easyconfigs/b/Bazel/Bazel-6.1.0-GCCcore-12.3.0.eb

diff --git a/easybuild/easyconfigs/b/Bazel/Bazel-6.1.0-GCCcore-12.3.0.eb b/easybuild/easyconfigs/b/Bazel/Bazel-6.3.1-GCCcore-13.2.0.eb
index 1bacc7b936..ddae356501 100644
--- a/easybuild/easyconfigs/b/Bazel/Bazel-6.1.0-GCCcore-12.3.0.eb
+++ b/easybuild/easyconfigs/b/Bazel/Bazel-6.3.1-GCCcore-13.2.0.eb
@@ -1,23 +1,33 @@
 name = 'Bazel'
-version = '6.1.0'
+version = '6.3.1'
 
 homepage = 'https://bazel.io/'
 description = """Bazel is a build tool that builds code quickly and reliably.
 It is used to build the majority of Google's software."""
 
-toolchain = {'name': 'GCCcore', 'version': '12.3.0'}
+toolchain = {'name': 'GCCcore', 'version': '13.2.0'}
 
 source_urls = ['https://github.com/bazelbuild/%(namelower)s/releases/download/%(version)s']
 sources = ['%(namelower)s-%(version)s-dist.zip']
-patches = ['Bazel-6.3.1_add-symlinks-in-runfiles.patch']
+patches = [
+    'Bazel-6.3.1_cc-info.patch',
+    'Bazel-6.3.1_add-symlinks-in-runfiles.patch',
+    'Bazel-6.3.1_use_std=c++17_instead_of_0x.patch',
+    'Bazel-6.3.1_fix_missing_cstdin_in_abseil.patch',
+]
 checksums = [
-    {'bazel-6.1.0-dist.zip': 'c4b85675541cf66ee7cb71514097fdd6c5fc0e02527243617a4f20ca6b4f2932'},
+    {'bazel-6.3.1-dist.zip': '2676319e86c5aeab142dccd42434364a33aa330a091c13562b7de87a10e68775'},
+    {'Bazel-6.3.1_cc-info.patch': 'f0b43ba05c2353a0324f0c7e532e9192f82f6937f68fb3e24fabcca7996ff6aa'},
     {'Bazel-6.3.1_add-symlinks-in-runfiles.patch': '81db53aa87229557480b6f719c99a0f1af9c69dfec12185451e520b0128c3ae2'},
+    {'Bazel-6.3.1_use_std=c++17_instead_of_0x.patch':
+     'ffb7ab652c962bf437440db72f796c523e9ac768b26e832362dcea3d2ad7e6ef'},
+    {'Bazel-6.3.1_fix_missing_cstdin_in_abseil.patch':
+     '60f71e6004298c0c67cdb14fc31d3184b4a0de4f38a4d8c3ebb92711b22f3f41'},
 ]
 
 builddependencies = [
     ('binutils', '2.40'),
-    ('Python', '3.11.3'),
+    ('Python', '3.11.5'),
     ('Zip', '3.0'),
 ]
 
Diff against Bazel-6.3.1-GCCcore-12.2.0.eb

easybuild/easyconfigs/b/Bazel/Bazel-6.3.1-GCCcore-12.2.0.eb

diff --git a/easybuild/easyconfigs/b/Bazel/Bazel-6.3.1-GCCcore-12.2.0.eb b/easybuild/easyconfigs/b/Bazel/Bazel-6.3.1-GCCcore-13.2.0.eb
index 8c284f50a4..ddae356501 100644
--- a/easybuild/easyconfigs/b/Bazel/Bazel-6.3.1-GCCcore-12.2.0.eb
+++ b/easybuild/easyconfigs/b/Bazel/Bazel-6.3.1-GCCcore-13.2.0.eb
@@ -5,19 +5,29 @@ homepage = 'https://bazel.io/'
 description = """Bazel is a build tool that builds code quickly and reliably.
 It is used to build the majority of Google's software."""
 
-toolchain = {'name': 'GCCcore', 'version': '12.2.0'}
+toolchain = {'name': 'GCCcore', 'version': '13.2.0'}
 
 source_urls = ['https://github.com/bazelbuild/%(namelower)s/releases/download/%(version)s']
 sources = ['%(namelower)s-%(version)s-dist.zip']
-patches = ['Bazel-6.3.1_add-symlinks-in-runfiles.patch']
+patches = [
+    'Bazel-6.3.1_cc-info.patch',
+    'Bazel-6.3.1_add-symlinks-in-runfiles.patch',
+    'Bazel-6.3.1_use_std=c++17_instead_of_0x.patch',
+    'Bazel-6.3.1_fix_missing_cstdin_in_abseil.patch',
+]
 checksums = [
     {'bazel-6.3.1-dist.zip': '2676319e86c5aeab142dccd42434364a33aa330a091c13562b7de87a10e68775'},
+    {'Bazel-6.3.1_cc-info.patch': 'f0b43ba05c2353a0324f0c7e532e9192f82f6937f68fb3e24fabcca7996ff6aa'},
     {'Bazel-6.3.1_add-symlinks-in-runfiles.patch': '81db53aa87229557480b6f719c99a0f1af9c69dfec12185451e520b0128c3ae2'},
+    {'Bazel-6.3.1_use_std=c++17_instead_of_0x.patch':
+     'ffb7ab652c962bf437440db72f796c523e9ac768b26e832362dcea3d2ad7e6ef'},
+    {'Bazel-6.3.1_fix_missing_cstdin_in_abseil.patch':
+     '60f71e6004298c0c67cdb14fc31d3184b4a0de4f38a4d8c3ebb92711b22f3f41'},
 ]
 
 builddependencies = [
-    ('binutils', '2.39'),
-    ('Python', '3.10.8'),
+    ('binutils', '2.40'),
+    ('Python', '3.11.5'),
     ('Zip', '3.0'),
 ]
 

Updated software dill-0.3.8-GCCcore-13.2.0.eb

Diff against dill-0.3.7-GCCcore-12.2.0.eb

easybuild/easyconfigs/d/dill/dill-0.3.7-GCCcore-12.2.0.eb

diff --git a/easybuild/easyconfigs/d/dill/dill-0.3.7-GCCcore-12.2.0.eb b/easybuild/easyconfigs/d/dill/dill-0.3.8-GCCcore-13.2.0.eb
index 69f1f370a9..0cc0fb8820 100644
--- a/easybuild/easyconfigs/d/dill/dill-0.3.7-GCCcore-12.2.0.eb
+++ b/easybuild/easyconfigs/d/dill/dill-0.3.8-GCCcore-13.2.0.eb
@@ -2,22 +2,22 @@
 easyblock = 'PythonPackage'
 
 name = 'dill'
-version = '0.3.7'
+version = '0.3.8'
 
 homepage = 'https://pypi.org/project/dill/'
 description = """dill extends python's pickle module for serializing and de-serializing python objects to the majority
  of the built-in python types. Serialization is the process of converting an object to a byte stream, and the inverse
  of which is converting a byte stream back to on python object hierarchy."""
 
-toolchain = {'name': 'GCCcore', 'version': '12.2.0'}
+toolchain = {'name': 'GCCcore', 'version': '13.2.0'}
 
 sources = [SOURCE_TAR_GZ]
-checksums = ['cc1c8b182eb3013e24bd475ff2e9295af86c1a38eb1aff128dac8962a9ce3c03']
+checksums = ['3ebe3c479ad625c4553aca177444d89b486b1d84982eeacded644afc0cf797ca']
 
-builddependencies = [('binutils', '2.39')]
+builddependencies = [('binutils', '2.40')]
 
 dependencies = [
-    ('Python', '3.10.8'),
+    ('Python', '3.11.5'),
 ]
 
 use_pip = True
Diff against dill-0.3.7-GCCcore-12.3.0.eb

easybuild/easyconfigs/d/dill/dill-0.3.7-GCCcore-12.3.0.eb

diff --git a/easybuild/easyconfigs/d/dill/dill-0.3.7-GCCcore-12.3.0.eb b/easybuild/easyconfigs/d/dill/dill-0.3.8-GCCcore-13.2.0.eb
index 1576a8a029..0cc0fb8820 100644
--- a/easybuild/easyconfigs/d/dill/dill-0.3.7-GCCcore-12.3.0.eb
+++ b/easybuild/easyconfigs/d/dill/dill-0.3.8-GCCcore-13.2.0.eb
@@ -2,22 +2,22 @@
 easyblock = 'PythonPackage'
 
 name = 'dill'
-version = '0.3.7'
+version = '0.3.8'
 
 homepage = 'https://pypi.org/project/dill/'
 description = """dill extends python's pickle module for serializing and de-serializing python objects to the majority
  of the built-in python types. Serialization is the process of converting an object to a byte stream, and the inverse
  of which is converting a byte stream back to on python object hierarchy."""
 
-toolchain = {'name': 'GCCcore', 'version': '12.3.0'}
+toolchain = {'name': 'GCCcore', 'version': '13.2.0'}
 
 sources = [SOURCE_TAR_GZ]
-checksums = ['cc1c8b182eb3013e24bd475ff2e9295af86c1a38eb1aff128dac8962a9ce3c03']
+checksums = ['3ebe3c479ad625c4553aca177444d89b486b1d84982eeacded644afc0cf797ca']
 
 builddependencies = [('binutils', '2.40')]
 
 dependencies = [
-    ('Python', '3.11.3'),
+    ('Python', '3.11.5'),
 ]
 
 use_pip = True

Updated software flatbuffers-python-23.5.26-GCCcore-13.2.0.eb

Diff against flatbuffers-python-24.3.25-GCCcore-13.3.0.eb

easybuild/easyconfigs/f/flatbuffers-python/flatbuffers-python-24.3.25-GCCcore-13.3.0.eb

diff --git a/easybuild/easyconfigs/f/flatbuffers-python/flatbuffers-python-24.3.25-GCCcore-13.3.0.eb b/easybuild/easyconfigs/f/flatbuffers-python/flatbuffers-python-23.5.26-GCCcore-13.2.0.eb
index 6e3bd31596..12eff93d47 100644
--- a/easybuild/easyconfigs/f/flatbuffers-python/flatbuffers-python-24.3.25-GCCcore-13.3.0.eb
+++ b/easybuild/easyconfigs/f/flatbuffers-python/flatbuffers-python-23.5.26-GCCcore-13.2.0.eb
@@ -1,20 +1,20 @@
 easyblock = 'PythonPackage'
 
 name = 'flatbuffers-python'
-version = '24.3.25'
+version = '23.5.26'
 
 homepage = 'https://github.com/google/flatbuffers/'
 description = """Python Flatbuffers runtime library."""
 
-toolchain = {'name': 'GCCcore', 'version': '13.3.0'}
+toolchain = {'name': 'GCCcore', 'version': '13.2.0'}
 
 source_urls = ['https://pypi.python.org/packages/source/f/flatbuffers']
 sources = [{'download_filename': 'flatbuffers-%(version)s.tar.gz', 'filename': SOURCE_TAR_GZ}]
-checksums = ['de2ec5b203f21441716617f38443e0a8ebf3d25bf0d9c0bb0ce68fa00ad546a4']
+checksums = ['9ea1144cac05ce5d86e2859f431c6cd5e66cd9c78c558317c7955fb8d4c78d89']
 
 dependencies = [
-    ('binutils', '2.42'),
-    ('Python', '3.12.3'),
+    ('binutils', '2.40'),
+    ('Python', '3.11.5'),
 ]
 
 download_dep_fail = True
Diff against flatbuffers-python-23.5.26-GCCcore-12.3.0.eb

easybuild/easyconfigs/f/flatbuffers-python/flatbuffers-python-23.5.26-GCCcore-12.3.0.eb

diff --git a/easybuild/easyconfigs/f/flatbuffers-python/flatbuffers-python-23.5.26-GCCcore-12.3.0.eb b/easybuild/easyconfigs/f/flatbuffers-python/flatbuffers-python-23.5.26-GCCcore-13.2.0.eb
index dbe8286010..12eff93d47 100644
--- a/easybuild/easyconfigs/f/flatbuffers-python/flatbuffers-python-23.5.26-GCCcore-12.3.0.eb
+++ b/easybuild/easyconfigs/f/flatbuffers-python/flatbuffers-python-23.5.26-GCCcore-13.2.0.eb
@@ -6,7 +6,7 @@ version = '23.5.26'
 homepage = 'https://github.com/google/flatbuffers/'
 description = """Python Flatbuffers runtime library."""
 
-toolchain = {'name': 'GCCcore', 'version': '12.3.0'}
+toolchain = {'name': 'GCCcore', 'version': '13.2.0'}
 
 source_urls = ['https://pypi.python.org/packages/source/f/flatbuffers']
 sources = [{'download_filename': 'flatbuffers-%(version)s.tar.gz', 'filename': SOURCE_TAR_GZ}]
@@ -14,7 +14,7 @@ checksums = ['9ea1144cac05ce5d86e2859f431c6cd5e66cd9c78c558317c7955fb8d4c78d89']
 
 dependencies = [
     ('binutils', '2.40'),
-    ('Python', '3.11.3'),
+    ('Python', '3.11.5'),
 ]
 
 download_dep_fail = True

Updated software grpcio-1.57.0-GCCcore-13.2.0.eb

Diff against grpcio-1.57.0-GCCcore-12.2.0.eb

easybuild/easyconfigs/g/grpcio/grpcio-1.57.0-GCCcore-12.2.0.eb

diff --git a/easybuild/easyconfigs/g/grpcio/grpcio-1.57.0-GCCcore-12.2.0.eb b/easybuild/easyconfigs/g/grpcio/grpcio-1.57.0-GCCcore-13.2.0.eb
index 27e974c5de..a3da21c559 100644
--- a/easybuild/easyconfigs/g/grpcio/grpcio-1.57.0-GCCcore-12.2.0.eb
+++ b/easybuild/easyconfigs/g/grpcio/grpcio-1.57.0-GCCcore-13.2.0.eb
@@ -8,22 +8,22 @@ description = """gRPC is a modern, open source, high-performance remote procedur
 framework that can run anywhere. gRPC enables client and server applications to
 communicate transparently, and simplifies the building of connected systems."""
 
-toolchain = {'name': 'GCCcore', 'version': '12.2.0'}
+toolchain = {'name': 'GCCcore', 'version': '13.2.0'}
 toolchainopts = {'pic': True}
 
 use_pip = True
 sanity_pip_check = True
 
 builddependencies = [
-    ('binutils', '2.39'),
+    ('binutils', '2.40'),
     ('OpenSSL', '1.1', '', SYSTEM),
-    ('RE2', '2023-03-01'),
+    ('RE2', '2024-03-01'),
 ]
 
 dependencies = [
-    ('Python', '3.10.8'),
-    ('protobuf-python', '4.23.0'),
-    ('Abseil', '20230125.2'),
+    ('Python', '3.11.5'),
+    ('protobuf-python', '4.25.3'),
+    ('Abseil', '20240116.1'),
 ]
 
 exts_list = [
Diff against grpcio-1.57.0-GCCcore-12.3.0.eb

easybuild/easyconfigs/g/grpcio/grpcio-1.57.0-GCCcore-12.3.0.eb

diff --git a/easybuild/easyconfigs/g/grpcio/grpcio-1.57.0-GCCcore-12.3.0.eb b/easybuild/easyconfigs/g/grpcio/grpcio-1.57.0-GCCcore-13.2.0.eb
index 01d839324b..a3da21c559 100644
--- a/easybuild/easyconfigs/g/grpcio/grpcio-1.57.0-GCCcore-12.3.0.eb
+++ b/easybuild/easyconfigs/g/grpcio/grpcio-1.57.0-GCCcore-13.2.0.eb
@@ -8,7 +8,7 @@ description = """gRPC is a modern, open source, high-performance remote procedur
 framework that can run anywhere. gRPC enables client and server applications to
 communicate transparently, and simplifies the building of connected systems."""
 
-toolchain = {'name': 'GCCcore', 'version': '12.3.0'}
+toolchain = {'name': 'GCCcore', 'version': '13.2.0'}
 toolchainopts = {'pic': True}
 
 use_pip = True
@@ -17,13 +17,13 @@ sanity_pip_check = True
 builddependencies = [
     ('binutils', '2.40'),
     ('OpenSSL', '1.1', '', SYSTEM),
-    ('RE2', '2023-08-01'),
+    ('RE2', '2024-03-01'),
 ]
 
 dependencies = [
-    ('Python', '3.11.3'),
-    ('protobuf-python', '4.24.0'),
-    ('Abseil', '20230125.3'),
+    ('Python', '3.11.5'),
+    ('protobuf-python', '4.25.3'),
+    ('Abseil', '20240116.1'),
 ]
 
 exts_list = [

Updated software ml_dtypes-0.4.0-gfbf-2023b.eb

Diff against ml_dtypes-0.3.2-gfbf-2023a.eb

easybuild/easyconfigs/m/ml_dtypes/ml_dtypes-0.3.2-gfbf-2023a.eb

diff --git a/easybuild/easyconfigs/m/ml_dtypes/ml_dtypes-0.3.2-gfbf-2023a.eb b/easybuild/easyconfigs/m/ml_dtypes/ml_dtypes-0.4.0-gfbf-2023b.eb
index 9c3a18bfdb..7cbba95b19 100644
--- a/easybuild/easyconfigs/m/ml_dtypes/ml_dtypes-0.3.2-gfbf-2023a.eb
+++ b/easybuild/easyconfigs/m/ml_dtypes/ml_dtypes-0.4.0-gfbf-2023b.eb
@@ -2,13 +2,12 @@
 easyblock = 'PythonBundle'
 
 name = 'ml_dtypes'
-version = '0.3.2'
+version = '0.4.0'
 
 homepage = 'https://github.com/jax-ml/ml_dtypes'
 description = """
 ml_dtypes is a stand-alone implementation of several NumPy dtype extensions used
 in machine learning libraries, including:
-
 bfloat16: an alternative to the standard float16 format
 float8_*: several experimental 8-bit floating point representations including:
 float8_e4m3b11fnuz
@@ -18,29 +17,26 @@ float8_e5m2
 float8_e5m2fnuz
 """
 
-toolchain = {'name': 'gfbf', 'version': '2023a'}
+toolchain = {'name': 'gfbf', 'version': '2023b'}
 
 dependencies = [
-    ('Python', '3.11.3'),
-    ('SciPy-bundle', '2023.07'),
+    ('Python', '3.11.5'),
+    ('SciPy-bundle', '2023.11'),
 ]
 
-
 use_pip = True
 
-default_easyblock = 'PythonPackage'
-
 exts_list = [
     ('opt_einsum', '3.3.0', {
         'checksums': ['59f6475f77bbc37dcf7cd748519c0ec60722e91e63ca114e68821c0c54a46549'],
     }),
-    ('etils', '1.6.0', {
-        'checksums': ['c635fbd02a79fed4ad76825d31306b581d22b40671721daa8bc279cf6333e48a'],
+    ('etils', '1.9.2', {
+        'checksums': ['15dcd35ac0c0cc2404b46ac0846af3cc4e876fd3d80f36f57951e27e8b9d6379'],
     }),
     (name, version, {
         'patches': [('ml_dtypes-0.3.2_EigenAvx512.patch', 1)],
         'checksums': [
-            {'ml_dtypes-0.3.2.tar.gz': '533059bc5f1764fac071ef54598db358c167c51a718f68f5bb55e3dee79d2967'},
+            {'ml_dtypes-0.4.0.tar.gz': 'eaf197e72f4f7176a19fe3cb8b61846b38c6757607e7bf9cd4b1d84cd3e74deb'},
             {'ml_dtypes-0.3.2_EigenAvx512.patch': '197b05b0b7f611749824369f026099f6a172f9e8eab6ebb6504a16573746c892'},
         ],
     }),

Updated software nsync-1.29.2-GCCcore-13.2.0.eb

Diff against nsync-1.29.2-GCCcore-13.3.0.eb

easybuild/easyconfigs/n/nsync/nsync-1.29.2-GCCcore-13.3.0.eb

diff --git a/easybuild/easyconfigs/n/nsync/nsync-1.29.2-GCCcore-13.3.0.eb b/easybuild/easyconfigs/n/nsync/nsync-1.29.2-GCCcore-13.2.0.eb
index e7c2035444..76c9745447 100644
--- a/easybuild/easyconfigs/n/nsync/nsync-1.29.2-GCCcore-13.3.0.eb
+++ b/easybuild/easyconfigs/n/nsync/nsync-1.29.2-GCCcore-13.2.0.eb
@@ -6,16 +6,16 @@ version = '1.29.2'
 homepage = 'https://github.com/google/nsync'
 description = """nsync is a C library that exports various synchronization primitives, such as mutexes"""
 
-toolchain = {'name': 'GCCcore', 'version': '13.3.0'}
+toolchain = {'name': 'GCCcore', 'version': '13.2.0'}
 
-source_urls = ['https://github.com/google/nsync/archive/refs/tags/']
-sources = ['%(version)s.tar.gz']
+source_urls = ['https://github.com/google/nsync/archive']
+sources = [{'download_filename': '%(version)s.tar.gz', 'filename': SOURCE_TAR_GZ}]
 checksums = ['1d63e967973733d2c97e841e3c05fac4d3fa299f01d14c86f2695594c7a4a2ec']
 
 builddependencies = [
-    ('binutils', '2.42'),
-    ('CMake', '3.29.3'),
-    ('Ninja', '1.12.1'),
+    ('binutils', '2.40'),
+    ('CMake', '3.27.6'),
+    ('Ninja', '1.11.1'),
 ]
 
 sanity_check_paths = {
Diff against nsync-1.26.0-GCCcore-12.3.0.eb

easybuild/easyconfigs/n/nsync/nsync-1.26.0-GCCcore-12.3.0.eb

diff --git a/easybuild/easyconfigs/n/nsync/nsync-1.26.0-GCCcore-12.3.0.eb b/easybuild/easyconfigs/n/nsync/nsync-1.29.2-GCCcore-13.2.0.eb
index a4a6fe8d2c..76c9745447 100644
--- a/easybuild/easyconfigs/n/nsync/nsync-1.26.0-GCCcore-12.3.0.eb
+++ b/easybuild/easyconfigs/n/nsync/nsync-1.29.2-GCCcore-13.2.0.eb
@@ -1,20 +1,20 @@
 easyblock = 'CMakeNinja'
 
 name = 'nsync'
-version = '1.26.0'
+version = '1.29.2'
 
 homepage = 'https://github.com/google/nsync'
 description = """nsync is a C library that exports various synchronization primitives, such as mutexes"""
 
-toolchain = {'name': 'GCCcore', 'version': '12.3.0'}
+toolchain = {'name': 'GCCcore', 'version': '13.2.0'}
 
-source_urls = ['https://github.com/google/nsync/archive/v%(version)s/']
-sources = [SOURCE_TAR_GZ]
-checksums = ['80fc1e605bb3cf5f272811ece39c4fb6761ffcb9b30563301845cc9ff381eb8b']
+source_urls = ['https://github.com/google/nsync/archive']
+sources = [{'download_filename': '%(version)s.tar.gz', 'filename': SOURCE_TAR_GZ}]
+checksums = ['1d63e967973733d2c97e841e3c05fac4d3fa299f01d14c86f2695594c7a4a2ec']
 
 builddependencies = [
     ('binutils', '2.40'),
-    ('CMake', '3.26.3'),
+    ('CMake', '3.27.6'),
     ('Ninja', '1.11.1'),
 ]
 

Updated software TensorFlow-2.15.1-foss-2023b.eb

Diff against TensorFlow-2.15.1-foss-2023a-CUDA-12.1.1.eb

easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023a-CUDA-12.1.1.eb

diff --git a/easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023a-CUDA-12.1.1.eb b/easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023b.eb
index 7b2f4888b2..04ee9e22cf 100644
--- a/easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023a-CUDA-12.1.1.eb
+++ b/easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023b.eb
@@ -2,25 +2,24 @@ easyblock = 'PythonBundle'
 
 name = 'TensorFlow'
 version = '2.15.1'
-versionsuffix = '-CUDA-%(cudaver)s'
 
 homepage = 'https://www.tensorflow.org/'
 description = "An open-source software library for Machine Intelligence"
 
-toolchain = {'name': 'foss', 'version': '2023a'}
+toolchain = {'name': 'foss', 'version': '2023b'}
 toolchainopts = {'pic': True}
 
 use_pip = True
 sanity_pip_check = True
 
 builddependencies = [
-    ('Bazel', '6.1.0'),
+    ('Bazel', '6.3.1'),
     # git 2.x required, see also https://github.com/tensorflow/tensorflow/issues/29053
-    ('git', '2.41.0', '-nodocs'),
+    ('git', '2.42.0'),
     ('pybind11', '2.11.1'),
     ('UnZip', '6.0'),
     # Required to build some of the extensions
-    ('poetry', '1.5.1'),
+    ('poetry', '1.6.1'),
     # Protobuf disabled since 2.13.0 easyconfigs:
     # Compiling with system protobuf don't seem to work, see:
     # https://github.com/tensorflow/tensorflow/issues/61593
@@ -28,30 +27,27 @@ builddependencies = [
 ]
 
 dependencies = [
-    ('CUDA', '12.1.1', '', SYSTEM),
-    ('cuDNN', '8.9.2.26', versionsuffix, SYSTEM),
-    ('NCCL', '2.18.3', versionsuffix),
-    ('Python', '3.11.3'),
-    ('h5py', '3.9.0'),
-    ('cURL', '8.0.1'),
-    ('dill', '0.3.7'),
+    ('Python', '3.11.5'),
+    ('h5py', '3.11.0'),
+    ('cURL', '8.3.0'),
+    ('dill', '0.3.8'),
     ('double-conversion', '3.3.0'),
     ('flatbuffers', '23.5.26'),
     ('flatbuffers-python', '23.5.26'),
     ('giflib', '5.2.1'),
-    ('hwloc', '2.9.1'),
-    ('ICU', '73.2'),
+    ('hwloc', '2.9.2'),
+    ('ICU', '74.1'),
     ('JsonCpp', '1.9.5'),
-    ('libjpeg-turbo', '2.1.5.1'),
-    ('ml_dtypes', '0.3.2'),
+    ('libjpeg-turbo', '3.0.1'),
+    ('ml_dtypes', '0.4.0'),
     ('NASM', '2.16.01'),
-    ('nsync', '1.26.0'),
-    ('SQLite', '3.42.0'),
+    ('nsync', '1.29.2'),
+    ('SQLite', '3.43.1'),
     ('patchelf', '0.18.0'),
-    ('libpng', '1.6.39'),
+    ('libpng', '1.6.40'),
     ('snappy', '1.1.10'),
     ('zlib', '1.2.13'),
-    ('tensorboard', '2.15.1'),
+    ('grpcio', '1.57.0'),
 ]
 
 # Dependencies created and updated using findPythonDeps, see:
@@ -71,6 +67,48 @@ exts_list = [
         'source_tmpl': 'tensorflow_estimator-%(version)s-py2.py3-none-any.whl',
         'checksums': ['aedf21eec7fb2dc91150fc91a1ce12bc44dbb72278a08b58e79ff87c9e28f153'],
     }),
+    ('Werkzeug', '3.0.2', {
+        'source_tmpl': '%(namelower)s-%(version)s.tar.gz',
+        'checksums': ['e39b645a6ac92822588e7b39a692e7828724ceae0b0d702ef96701f90e70128d'],
+    }),
+    ('tensorboard-data-server', '0.7.2', {
+        'source_tmpl': 'tensorboard_data_server-%(version)s-py3-none-any.whl',
+        'checksums': ['7e0610d205889588983836ec05dc098e80f97b7e7bbff7e994ebb78f578d0ddb'],
+    }),
+    ('Markdown', '3.6', {
+        'checksums': ['ed4f41f6daecbeeb96e576ce414c41d2d876daa9a16cb35fa8ed8c2ddfad0224'],
+    }),
+    ('oauthlib', '3.2.2', {
+        'checksums': ['9859c40929662bec5d64f34d01c99e093149682a3f38915dc0655d5a633dd918'],
+    }),
+    ('requests-oauthlib', '2.0.0', {
+        'checksums': ['b3dffaebd884d8cd778494369603a9e7b58d29111bf6b41bdc2dcd87203af4e9'],
+    }),
+    ('rsa', '4.9', {
+        'checksums': ['e38464a49c6c85d7f1351b0126661487a7e0a14a50f1675ec50eb34d4f20ef21'],
+    }),
+    ('pyasn1-modules', '0.4.0', {
+        'source_tmpl': 'pyasn1_modules-%(version)s.tar.gz',
+        'checksums': ['831dbcea1b177b28c9baddf4c6d1013c24c3accd14a1873fffaa6a2e905f17b6'],
+    }),
+    ('cachetools', '5.3.3', {
+        'checksums': ['ba29e2dfa0b8b556606f097407ed1aa62080ee108ab0dc5ec9d6a723a007d105'],
+    }),
+    ('google-auth', '2.29.0', {
+        'modulename': 'google.auth',
+        'checksums': ['672dff332d073227550ffc7457868ac4218d6c500b155fe6cc17d2b13602c360'],
+    }),
+    ('google-auth-oauthlib', '1.2.0', {
+        'checksums': ['292d2d3783349f2b0734a0a0207b1e1e322ac193c2c09d8f7c613fb7cc501ea8'],
+    }),
+    ('absl-py', '2.1.0', {
+        'modulename': 'absl',
+        'checksums': ['7820790efbb316739cde8b4e19357243fc3608a152024288513dd968d7d959ff'],
+    }),
+    ('tensorboard', '2.15.2', {
+        'source_tmpl': '%(name)s-%(version)s-py3-none-any.whl',
+        'checksums': ['a6f6443728064d962caea6d34653e220e34ef8df764cb06a8212c17e1a8f0622'],
+    }),
     ('keras', '2.15.0', {
         'source_tmpl': '%(name)s-%(version)s-py3-none-any.whl',
         'checksums': ['2dcc6d2e30cf9c951064b63c1f4c404b966c59caf09e01f3549138ec8ee0dd1f'],
@@ -82,41 +120,38 @@ exts_list = [
     ('astunparse', '1.6.3', {
         'checksums': ['5ad93a8456f0d084c3456d059fd9a92cce667963232cbf763eac3bc5b7940872'],
     }),
-    # Required by tests
     ('tblib', '3.0.0', {
         'checksums': ['93622790a0a29e04f0346458face1e144dc4d32f493714c6c3dff82a4adb77e6'],
     }),
     ('astor', '0.8.1', {
         'checksums': ['6a6effda93f4e1ce9f618779b2dd1d9d84f1e32812c23a29b3fff6fd7f63fa5e'],
     }),
+    ('gviz-api', '1.10.0', {
+        'source_tmpl': 'gviz_api-%(version)s.tar.gz',
+        'checksums': ['846692dd8cc73224fc31b18e41589bd934e1cc05090c6576af4b4b26c2e71b90'],
+    }),
+    ('tensorboard-plugin-profile', version, {
+        'source_tmpl': 'tensorboard_plugin_profile-%(version)s.tar.gz',
+        'checksums': ['84bb33e446eb4a9c0616f669fc6a42cdd40eadd9ae1d74bf756f4f0479993273'],
+    }),
     (name, version, {
         'patches': [
-            'TensorFlow-2.1.0_fix-cuda-build.patch',
-            'TensorFlow-2.4.0_dont-use-var-lock.patch',
             'TensorFlow-2.13.0_add-missing-system-protobuf-targets.patch',
-            'TensorFlow-2.13.0_exclude-xnnpack-on-ppc.patch',
-            'TensorFlow-2.15.1_remove-duplicate-gpu-tests.patch',
             'TensorFlow-2.15.1_remove-libclang-dep.patch',
             'TensorFlow-2.15.1_remove-io-gcs-filesystem-dep.patch',
             'TensorFlow-2.15.1_add-default-shell-env.patch',
-            'TensorFlow-2.15.1_fix-AVX512-eigen-compilation.patch',
             'TensorFlow-2.15.1_fix-flatbuffer-license.patch',
             'TensorFlow-2.15.1_fix-pybind11-build.patch',
-            'TensorFlow-2.15.1_fix-cuda_build_defs.patch',
-            'TensorFlow-2.15.1_disable-avx512-extensions.patch',
-            'TensorFlow-2.15.1_disable-tf32-in-fused-matmul-tests.patch'
+            'TensorFlow-2.15.1_fix-AVX512-eigen-compilation.patch',
+            'TensorFlow-2.15.1_fix-AVX512-eigen-compilation-gcc13.patch',
+            'TensorFlow-2.15.1_upgrade-ml_dtypes-dependency-version.patch',
         ],
         'source_tmpl': 'v%(version)s.tar.gz',
         'source_urls': ['https://github.com/tensorflow/tensorflow/archive/'],
         'test_script': 'TensorFlow-2.x_mnist-test.py',
-        'test_tag_filters_cpu': (
-            '-gpu,-tpu,-no_cuda_on_cpu_tap,'
-            '-no_pip,-no_oss,-oss_serial,-benchmark-test,-v1only'
-        ),
-        'test_tag_filters_gpu': (
-            'gpu,-no_gpu,-nogpu,-gpu_cupti,-no_cuda11,'
-            '-no_pip,-no_oss,-oss_serial,-benchmark-test,-v1only'
-        ),
+        'test_tag_filters_cpu': '-gpu,-tpu,-no_cuda_on_cpu_tap,-no_pip,-no_oss,-oss_serial,-benchmark-test,-v1only',
+        'test_tag_filters_gpu': ('gpu,-no_gpu,-nogpu,-gpu_cupti,-no_cuda11,'
+                                 '-no_pip,-no_oss,-oss_serial,-benchmark-test,-v1only'),
         'test_targets': [
             '//tensorflow/core/...',
             '-//tensorflow/core:example_java_proto',
@@ -135,44 +170,41 @@ exts_list = [
             '-//tensorflow/core/kernels/mkl:mkl_fused_batch_norm_op_test',
             '-//tensorflow/core/ir/importexport/tests/roundtrip/...',
         ],
-        'testopts': '--test_env=HOME=/tmp --test_timeout=3600 --test_size_filters=small ',
-        'testopts_gpu': (
-            '--test_env=HOME=/tmp --test_timeout=3600 --test_size_filters=small '
-            '--run_under=//tensorflow/tools/ci_build/gpu_build:parallel_gpu_execute '
-        ),
+        'testopts': "--test_env=HOME=/tmp --test_timeout=3600 --test_size_filters=small ",
+        'testopts_gpu': ('--test_env=HOME=/tmp --test_timeout=3600 --test_size_filters=small '
+                         '--run_under=//tensorflow/tools/ci_build/gpu_build:parallel_gpu_execute '),
         'with_xla': True,
         'checksums': [
             {'v2.15.1.tar.gz': 'f36416d831f06fe866e149c7cd752da410a11178b01ff5620e9f265511ed57cf'},
-            {'TensorFlow-2.1.0_fix-cuda-build.patch':
-             '78c20aeaa7784b8ceb46238a81e8c2461137d28e0b576deeba8357d23fbe1f5a'},
-            {'TensorFlow-2.4.0_dont-use-var-lock.patch':
-             'b14f2493fd2edf79abd1c4f2dde6c98a3e7d5cb9c25ab9386df874d5f072d6b5'},
             {'TensorFlow-2.13.0_add-missing-system-protobuf-targets.patch':
              '77d8c8a5627493fc7c38b4de79d49e60ff6628b05ff969f4cd3ff9857176c459'},
-            {'TensorFlow-2.13.0_exclude-xnnpack-on-ppc.patch':
-             'd0818206846911d946666ded7d3216c0546e37cee1890a2f48dc1a9d71047cad'},
-            {'TensorFlow-2.15.1_remove-duplicate-gpu-tests.patch':
-             'd8810d5b875de5be8603afd743774ce9dd8c0d4a82314c7fe2f284a080be7498'},
             {'TensorFlow-2.15.1_remove-libclang-dep.patch':
              '871b2f0221b7a150ac9f563ffad7187e052a7eedd95c20fb4524987d7edb6f21'},
             {'TensorFlow-2.15.1_remove-io-gcs-filesystem-dep.patch':
              'eba7351a4b0696c589b9c507bacb0257ebce8c39fde39ab72d5d6a69deaaec02'},
             {'TensorFlow-2.15.1_add-default-shell-env.patch':
              '3d5196b4bf2e91048dc8a18f9e8f487a223fcd973d6302e80b0d4000ea3d652b'},
-            {'TensorFlow-2.15.1_fix-AVX512-eigen-compilation.patch':
-             '761059e5f5f5eeeef8aed5517a7685a0eb0a9193d4afe8d45237527681c9c0a3'},
             {'TensorFlow-2.15.1_fix-flatbuffer-license.patch':
              '2c04d5095977a628a238dbf93c5fada7159c86752a7183e64e0cf7c7ab00caf4'},
             {'TensorFlow-2.15.1_fix-pybind11-build.patch':
              '3bb350ac92ab99c63c951c96b3b0160699f5f16822b64f72111ebfd2275cafce'},
-            {'TensorFlow-2.15.1_fix-cuda_build_defs.patch':
-             '091581a7c4fc2fc7af282cab6661632c29029d2f36eccb6695ffa5783e065f88'},
-            {'TensorFlow-2.15.1_disable-avx512-extensions.patch':
-             '506ceecff67237eed9cd9e9e114bc1461f35a343f77f83cb3dab710aa701dc0f'},
-            {'TensorFlow-2.15.1_disable-tf32-in-fused-matmul-tests.patch':
-             'f78aa0e8f814a57e8d2e6b24ff095df49e8654aadb797393fa95a9378d0aa662'},
+            {'TensorFlow-2.15.1_fix-AVX512-eigen-compilation.patch':
+             '761059e5f5f5eeeef8aed5517a7685a0eb0a9193d4afe8d45237527681c9c0a3'},
+            {'TensorFlow-2.15.1_fix-AVX512-eigen-compilation-gcc13.patch':
+             '68adc4bb726a60f2deed2d746d305960505c5cd3abbc018bad1074d95e2a3853'},
+            {'TensorFlow-2.15.1_upgrade-ml_dtypes-dependency-version.patch':
+             'da4a8e63251a7f6aca38a55f8d4ee2955278c320bd20158a78dabd4decb8c9f0'},
         ],
     }),
 ]
 
+#  Taken from tensorboard-2.15.1-gfbf-2023a.eb:
+#  Relax restriction on protobuf dependency as issue was fixed
+#  in https://github.com/protocolbuffers/upb/pull/1514
+#  see also: https://github.com/easybuilders/easybuild-easyconfigs/pull/19671
+postinstallcmds = [
+    'sed -i "s/Requires-Dist: protobuf.*/Requires-Dist: protobuf >=3.19.6/g" ' +
+    '%(installdir)s/lib/python%(pyshortver)s/site-packages/tensorboard-2.15.2.dist-info/METADATA',
+]
+
 moduleclass = 'lib'
Diff against TensorFlow-2.15.1-foss-2023a.eb

easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023a.eb

diff --git a/easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023a.eb b/easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023b.eb
index ebca59072d..04ee9e22cf 100644
--- a/easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023a.eb
+++ b/easybuild/easyconfigs/t/TensorFlow/TensorFlow-2.15.1-foss-2023b.eb
@@ -6,20 +6,20 @@ version = '2.15.1'
 homepage = 'https://www.tensorflow.org/'
 description = "An open-source software library for Machine Intelligence"
 
-toolchain = {'name': 'foss', 'version': '2023a'}
+toolchain = {'name': 'foss', 'version': '2023b'}
 toolchainopts = {'pic': True}
 
 use_pip = True
 sanity_pip_check = True
 
 builddependencies = [
-    ('Bazel', '6.1.0'),
+    ('Bazel', '6.3.1'),
     # git 2.x required, see also https://github.com/tensorflow/tensorflow/issues/29053
-    ('git', '2.41.0', '-nodocs'),
+    ('git', '2.42.0'),
     ('pybind11', '2.11.1'),
     ('UnZip', '6.0'),
     # Required to build some of the extensions
-    ('poetry', '1.5.1'),
+    ('poetry', '1.6.1'),
     # Protobuf disabled since 2.13.0 easyconfigs:
     # Compiling with system protobuf don't seem to work, see:
     # https://github.com/tensorflow/tensorflow/issues/61593
@@ -27,27 +27,27 @@ builddependencies = [
 ]
 
 dependencies = [
-    ('Python', '3.11.3'),
-    ('h5py', '3.9.0'),
-    ('cURL', '8.0.1'),
-    ('dill', '0.3.7'),
+    ('Python', '3.11.5'),
+    ('h5py', '3.11.0'),
+    ('cURL', '8.3.0'),
+    ('dill', '0.3.8'),
     ('double-conversion', '3.3.0'),
     ('flatbuffers', '23.5.26'),
     ('flatbuffers-python', '23.5.26'),
     ('giflib', '5.2.1'),
-    ('hwloc', '2.9.1'),
-    ('ICU', '73.2'),
+    ('hwloc', '2.9.2'),
+    ('ICU', '74.1'),
     ('JsonCpp', '1.9.5'),
-    ('libjpeg-turbo', '2.1.5.1'),
-    ('ml_dtypes', '0.3.2'),
+    ('libjpeg-turbo', '3.0.1'),
+    ('ml_dtypes', '0.4.0'),
     ('NASM', '2.16.01'),
-    ('nsync', '1.26.0'),
-    ('SQLite', '3.42.0'),
+    ('nsync', '1.29.2'),
+    ('SQLite', '3.43.1'),
     ('patchelf', '0.18.0'),
-    ('libpng', '1.6.39'),
+    ('libpng', '1.6.40'),
     ('snappy', '1.1.10'),
     ('zlib', '1.2.13'),
-    ('tensorboard', '2.15.1'),
+    ('grpcio', '1.57.0'),
 ]
 
 # Dependencies created and updated using findPythonDeps, see:
@@ -67,6 +67,48 @@ exts_list = [
         'source_tmpl': 'tensorflow_estimator-%(version)s-py2.py3-none-any.whl',
         'checksums': ['aedf21eec7fb2dc91150fc91a1ce12bc44dbb72278a08b58e79ff87c9e28f153'],
     }),
+    ('Werkzeug', '3.0.2', {
+        'source_tmpl': '%(namelower)s-%(version)s.tar.gz',
+        'checksums': ['e39b645a6ac92822588e7b39a692e7828724ceae0b0d702ef96701f90e70128d'],
+    }),
+    ('tensorboard-data-server', '0.7.2', {
+        'source_tmpl': 'tensorboard_data_server-%(version)s-py3-none-any.whl',
+        'checksums': ['7e0610d205889588983836ec05dc098e80f97b7e7bbff7e994ebb78f578d0ddb'],
+    }),
+    ('Markdown', '3.6', {
+        'checksums': ['ed4f41f6daecbeeb96e576ce414c41d2d876daa9a16cb35fa8ed8c2ddfad0224'],
+    }),
+    ('oauthlib', '3.2.2', {
+        'checksums': ['9859c40929662bec5d64f34d01c99e093149682a3f38915dc0655d5a633dd918'],
+    }),
+    ('requests-oauthlib', '2.0.0', {
+        'checksums': ['b3dffaebd884d8cd778494369603a9e7b58d29111bf6b41bdc2dcd87203af4e9'],
+    }),
+    ('rsa', '4.9', {
+        'checksums': ['e38464a49c6c85d7f1351b0126661487a7e0a14a50f1675ec50eb34d4f20ef21'],
+    }),
+    ('pyasn1-modules', '0.4.0', {
+        'source_tmpl': 'pyasn1_modules-%(version)s.tar.gz',
+        'checksums': ['831dbcea1b177b28c9baddf4c6d1013c24c3accd14a1873fffaa6a2e905f17b6'],
+    }),
+    ('cachetools', '5.3.3', {
+        'checksums': ['ba29e2dfa0b8b556606f097407ed1aa62080ee108ab0dc5ec9d6a723a007d105'],
+    }),
+    ('google-auth', '2.29.0', {
+        'modulename': 'google.auth',
+        'checksums': ['672dff332d073227550ffc7457868ac4218d6c500b155fe6cc17d2b13602c360'],
+    }),
+    ('google-auth-oauthlib', '1.2.0', {
+        'checksums': ['292d2d3783349f2b0734a0a0207b1e1e322ac193c2c09d8f7c613fb7cc501ea8'],
+    }),
+    ('absl-py', '2.1.0', {
+        'modulename': 'absl',
+        'checksums': ['7820790efbb316739cde8b4e19357243fc3608a152024288513dd968d7d959ff'],
+    }),
+    ('tensorboard', '2.15.2', {
+        'source_tmpl': '%(name)s-%(version)s-py3-none-any.whl',
+        'checksums': ['a6f6443728064d962caea6d34653e220e34ef8df764cb06a8212c17e1a8f0622'],
+    }),
     ('keras', '2.15.0', {
         'source_tmpl': '%(name)s-%(version)s-py3-none-any.whl',
         'checksums': ['2dcc6d2e30cf9c951064b63c1f4c404b966c59caf09e01f3549138ec8ee0dd1f'],
@@ -78,36 +120,38 @@ exts_list = [
     ('astunparse', '1.6.3', {
         'checksums': ['5ad93a8456f0d084c3456d059fd9a92cce667963232cbf763eac3bc5b7940872'],
     }),
-    # Required by tests
     ('tblib', '3.0.0', {
         'checksums': ['93622790a0a29e04f0346458face1e144dc4d32f493714c6c3dff82a4adb77e6'],
     }),
     ('astor', '0.8.1', {
         'checksums': ['6a6effda93f4e1ce9f618779b2dd1d9d84f1e32812c23a29b3fff6fd7f63fa5e'],
     }),
+    ('gviz-api', '1.10.0', {
+        'source_tmpl': 'gviz_api-%(version)s.tar.gz',
+        'checksums': ['846692dd8cc73224fc31b18e41589bd934e1cc05090c6576af4b4b26c2e71b90'],
+    }),
+    ('tensorboard-plugin-profile', version, {
+        'source_tmpl': 'tensorboard_plugin_profile-%(version)s.tar.gz',
+        'checksums': ['84bb33e446eb4a9c0616f669fc6a42cdd40eadd9ae1d74bf756f4f0479993273'],
+    }),
     (name, version, {
         'patches': [
             'TensorFlow-2.13.0_add-missing-system-protobuf-targets.patch',
-            'TensorFlow-2.13.0_exclude-xnnpack-on-ppc.patch',
             'TensorFlow-2.15.1_remove-libclang-dep.patch',
             'TensorFlow-2.15.1_remove-io-gcs-filesystem-dep.patch',
             'TensorFlow-2.15.1_add-default-shell-env.patch',
-            'TensorFlow-2.15.1_fix-AVX512-eigen-compilation.patch',
             'TensorFlow-2.15.1_fix-flatbuffer-license.patch',
             'TensorFlow-2.15.1_fix-pybind11-build.patch',
-            'TensorFlow-2.15.1_disable-avx512-extensions.patch',
+            'TensorFlow-2.15.1_fix-AVX512-eigen-compilation.patch',
+            'TensorFlow-2.15.1_fix-AVX512-eigen-compilation-gcc13.patch',
+            'TensorFlow-2.15.1_upgrade-ml_dtypes-dependency-version.patch',
         ],
         'source_tmpl': 'v%(version)s.tar.gz',
         'source_urls': ['https://github.com/tensorflow/tensorflow/archive/'],
         'test_script': 'TensorFlow-2.x_mnist-test.py',
-        'test_tag_filters_cpu': (
-            '-gpu,-tpu,-no_cuda_on_cpu_tap,'
-            '-no_pip,-no_oss,-oss_serial,-benchmark-test,-v1only'
-        ),
-        'test_tag_filters_gpu': (
-            'gpu,-no_gpu,-nogpu,-gpu_cupti,-no_cuda11,'
-            '-no_pip,-no_oss,-oss_serial,-benchmark-test,-v1only'
-        ),
+        'test_tag_filters_cpu': '-gpu,-tpu,-no_cuda_on_cpu_tap,-no_pip,-no_oss,-oss_serial,-benchmark-test,-v1only',
+        'test_tag_filters_gpu': ('gpu,-no_gpu,-nogpu,-gpu_cupti,-no_cuda11,'
+                                 '-no_pip,-no_oss,-oss_serial,-benchmark-test,-v1only'),
         'test_targets': [
             '//tensorflow/core/...',
             '-//tensorflow/core:example_java_proto',
@@ -126,34 +170,41 @@ exts_list = [
             '-//tensorflow/core/kernels/mkl:mkl_fused_batch_norm_op_test',
             '-//tensorflow/core/ir/importexport/tests/roundtrip/...',
         ],
-        'testopts': '--test_env=HOME=/tmp --test_timeout=3600 --test_size_filters=small ',
-        'testopts_gpu': (
-            '--test_env=HOME=/tmp --test_timeout=3600 --test_size_filters=small '
-            '--run_under=//tensorflow/tools/ci_build/gpu_build:parallel_gpu_execute '
-        ),
+        'testopts': "--test_env=HOME=/tmp --test_timeout=3600 --test_size_filters=small ",
+        'testopts_gpu': ('--test_env=HOME=/tmp --test_timeout=3600 --test_size_filters=small '
+                         '--run_under=//tensorflow/tools/ci_build/gpu_build:parallel_gpu_execute '),
         'with_xla': True,
         'checksums': [
             {'v2.15.1.tar.gz': 'f36416d831f06fe866e149c7cd752da410a11178b01ff5620e9f265511ed57cf'},
             {'TensorFlow-2.13.0_add-missing-system-protobuf-targets.patch':
              '77d8c8a5627493fc7c38b4de79d49e60ff6628b05ff969f4cd3ff9857176c459'},
-            {'TensorFlow-2.13.0_exclude-xnnpack-on-ppc.patch':
-             'd0818206846911d946666ded7d3216c0546e37cee1890a2f48dc1a9d71047cad'},
             {'TensorFlow-2.15.1_remove-libclang-dep.patch':
              '871b2f0221b7a150ac9f563ffad7187e052a7eedd95c20fb4524987d7edb6f21'},
             {'TensorFlow-2.15.1_remove-io-gcs-filesystem-dep.patch':
              'eba7351a4b0696c589b9c507bacb0257ebce8c39fde39ab72d5d6a69deaaec02'},
             {'TensorFlow-2.15.1_add-default-shell-env.patch':
              '3d5196b4bf2e91048dc8a18f9e8f487a223fcd973d6302e80b0d4000ea3d652b'},
-            {'TensorFlow-2.15.1_fix-AVX512-eigen-compilation.patch':
-             '761059e5f5f5eeeef8aed5517a7685a0eb0a9193d4afe8d45237527681c9c0a3'},
             {'TensorFlow-2.15.1_fix-flatbuffer-license.patch':
              '2c04d5095977a628a238dbf93c5fada7159c86752a7183e64e0cf7c7ab00caf4'},
             {'TensorFlow-2.15.1_fix-pybind11-build.patch':
              '3bb350ac92ab99c63c951c96b3b0160699f5f16822b64f72111ebfd2275cafce'},
-            {'TensorFlow-2.15.1_disable-avx512-extensions.patch':
-             '506ceecff67237eed9cd9e9e114bc1461f35a343f77f83cb3dab710aa701dc0f'},
+            {'TensorFlow-2.15.1_fix-AVX512-eigen-compilation.patch':
+             '761059e5f5f5eeeef8aed5517a7685a0eb0a9193d4afe8d45237527681c9c0a3'},
+            {'TensorFlow-2.15.1_fix-AVX512-eigen-compilation-gcc13.patch':
+             '68adc4bb726a60f2deed2d746d305960505c5cd3abbc018bad1074d95e2a3853'},
+            {'TensorFlow-2.15.1_upgrade-ml_dtypes-dependency-version.patch':
+             'da4a8e63251a7f6aca38a55f8d4ee2955278c320bd20158a78dabd4decb8c9f0'},
         ],
     }),
 ]
 
+#  Taken from tensorboard-2.15.1-gfbf-2023a.eb:
+#  Relax restriction on protobuf dependency as issue was fixed
+#  in https://github.com/protocolbuffers/upb/pull/1514
+#  see also: https://github.com/easybuilders/easybuild-easyconfigs/pull/19671
+postinstallcmds = [
+    'sed -i "s/Requires-Dist: protobuf.*/Requires-Dist: protobuf >=3.19.6/g" ' +
+    '%(installdir)s/lib/python%(pyshortver)s/site-packages/tensorboard-2.15.2.dist-info/METADATA',
+]
+
 moduleclass = 'lib'

Copy link
Member

@verdurin verdurin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks fine.

of the built-in python types. Serialization is the process of converting an object to a byte stream, and the inverse
of which is converting a byte stream back to on python object hierarchy."""

toolchain = {'name': 'GCCcore', 'version': '13.2.0'}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've opened a separate PR for this exact easyconfig, since it's required by other PRs as a dependency (see #21783 for example):

No action needed in this PR here because of that, just wanted to mention it.

Co-authored-by: Kenneth Hoste <kenneth.hoste@ugent.be>
@pavelToman
Copy link
Collaborator

@boegelbot please test @ jsc-zen3

@boegelbot
Copy link
Collaborator

@pavelToman: Request for testing this PR well received on jsczen3l1.int.jsc-zen3.fz-juelich.de

PR test command 'if [[ develop != 'develop' ]]; then EB_BRANCH=develop ./easybuild_develop.sh 2> /dev/null 1>&2; EB_PREFIX=/home/boegelbot/easybuild/develop source init_env_easybuild_develop.sh; fi; EB_PR=21169 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs EB_BRANCH=develop /opt/software/slurm/bin/sbatch --job-name test_PR_21169 --ntasks=8 ~/boegelbot/eb_from_pr_upload_jsc-zen3.sh' executed!

  • exit code: 0
  • output:
Submitted batch job 5229

Test results coming soon (I hope)...

- notification for comment with ID 2464645553 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

@boegel boegel changed the title {devel}[foss/2023b] TensorFlow v2.15.1, Bazel v6.3.1, dill v0.3.8, ... {devel}[foss/2023b] TensorFlow v2.15.1, Bazel v6.3.1, dill v0.3.8, flatbuffers-python v23.5.26, grpcio v1.57.0, ml_dtypes v0.4.0, nsync v1.29.2 Nov 8, 2024
@boegelbot
Copy link
Collaborator

Test report by @boegelbot
SUCCESS
Build succeeded for 7 out of 7 (7 easyconfigs in total)
jsczen3c1.int.jsc-zen3.fz-juelich.de - Linux Rocky Linux 9.4, x86_64, AMD EPYC-Milan Processor (zen3), Python 3.9.18
See https://gist.github.com/boegelbot/2d791668cb7d4a62f203cb4ba061bf41 for a full test report.

@boegel
Copy link
Member

boegel commented Nov 8, 2024

@tanmoy1989 I'm not saying we can't merge this, but I'm wondering why you're sticking to TensorFlow v2.15.1 here, and not jumping to a newer release (2.18.0 was released ~3 weeks ago).

Did you try, and if so, did you run into particular issues?

@tanmoy1989
Copy link
Contributor Author

@boegel: I think I tried TensorFlow2.17.0 against foss-2023b but that had many issues which I can't remember off the the head atm. Since we were trying to have a TensorFlow version for GCC/13.2.0, I stick to TensorFlow/2.15.1 for which we got all the patches available and also the updated easyblock mentioned above in the PR description. I would really appreciate it this PR gets merged (we put together with EasyBuild members quite a bit of time on this). I am more than happy to try TensorFlow/2.18 for foss/2023b for another PR.

@boegel
Copy link
Member

boegel commented Nov 9, 2024

Test report by @boegel
SUCCESS
Build succeeded for 7 out of 7 (7 easyconfigs in total)
node3124.skitty.os - Linux RHEL 9.4, x86_64, Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz (skylake_avx512), Python 3.9.18
See https://gist.github.com/boegel/6b9820a361930eb1061eb46bf7f19112 for a full test report.

@tanmoy1989
Copy link
Contributor Author

@boegel Just to add in: I tried TensorFlow/2.18.0 and specifically I am getting error related to Bazel build (although I am using the same Bazel as used in this PR):

Starting local Bazel server and connecting to it...
ERROR: Config value 'noaws' is not defined in any .rc file

@boegel
Copy link
Member

boegel commented Nov 12, 2024

@Flamefire What are your thoughts on sticking to TensorFlow 2.15.1 for 2023b?

@Flamefire
Copy link
Contributor

@Flamefire What are your thoughts on sticking to TensorFlow 2.15.1 for 2023b?

Adding 2.15.1 doesn't mean not adding 2.18.0. We have multiple TF versions in other toolchains too. The trouble with those ML stuff where people require the latest versions of the time.

Also in my experience it was always easier to either update the TF version OR the toolchain, not both at the same time. This is what I used to do to avoid having to check too many differences when errors occur.

-> Take this and start working on 2.18.0 for 2023b too.

@verdurin
Copy link
Member

Yes, I'd be happy to test a 2.18.0 build - we have a request for keras >= 3.0.0 and nothing else has that yet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants