Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add default moduleclass for AI/ML software? #815

Closed
migueldiascosta opened this issue Aug 3, 2022 · 3 comments
Closed

add default moduleclass for AI/ML software? #815

migueldiascosta opened this issue Aug 3, 2022 · 3 comments
Labels
Milestone

Comments

@migueldiascosta
Copy link
Member

migueldiascosta commented Aug 3, 2022

currently, AI/ML software is categorized rather loosely: scikit-learn is data, pytorch is devel, tensorflow is lib, keras is math...

there's nothing about AI/ML in the list of default moduleclasses, https://github.com/easybuilders/easybuild-framework/blob/454fe5e024b443b189f8e0f9f8727ed54c28ff56/easybuild/tools/config.py#L400-L424 (but it's not that they are not specific, there's even quantum :) )

should we do something about this?

@migueldiascosta migueldiascosta added this to the 4.x milestone Aug 3, 2022
@boegel
Copy link
Member

boegel commented Aug 3, 2022

Yeah, the time is right to add a new default module class and start using it. Do we want to go with ai, or ai_ml, etc.?

I guess ai is broad enough to also cover machine learning?

@migueldiascosta
Copy link
Member Author

Another question is if we would reclassify existing easyconfigs or just new ones

@boegel
Copy link
Member

boegel commented Aug 5, 2022

I think re-classifying makes sense. PRs like that are trivial enough to merge without requiring test reports for all easyconfigs we touch (which can be brutally expensive for software like TensorFlow and PyTorch...).

The downside of that would be that trying to use an easyconfig that has been updated to use ai as module class would result in the following unless a sufficiently recent version of EasyBuild framework (develop branch or the to-be-released EasyBuild v4.6.1) is used:

ERROR: Failed to process easyconfig /tmp/example.eb: moduleclass provided 'ai' is not valid: ['base', 'astro', 'bio', 'cae', 'chem', 'compiler', 'data', 'debugger', 'devel', 'geo', 'ide', 'lang', 'lib', 'math', 'mpi', 'numlib', 'perf', 'quantum', 'phys', 'system', 'toolchain', 'tools', 'vis']

@jfgrimm jfgrimm closed this as completed Jun 8, 2023
@boegel boegel modified the milestones: 4.x, 4.6.1 Jun 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants