Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update software #210

Merged
merged 41 commits into from
Mar 4, 2024
Merged

Update software #210

merged 41 commits into from
Mar 4, 2024

Conversation

jychoi-hpc
Copy link
Member

WIP: upgrading software

@jychoi-hpc jychoi-hpc marked this pull request as ready for review February 25, 2024 16:50
@jychoi-hpc
Copy link
Member Author

I think I found an issue with pyg 2.5.0: pyg-team/pytorch_geometric#8994
I am downgrading to pyg 2.3.1.

@jychoi-hpc
Copy link
Member Author

I think it is working now. @allaffa and @pzhanggit, can you look?

Copy link
Collaborator

@allaffa allaffa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Clarification needed for Python 3.10

.github/workflows/CI.yml Outdated Show resolved Hide resolved
@allaffa
Copy link
Collaborator

allaffa commented Feb 29, 2024

I am still puzzeled by the following error. I often get this error not always but from time to time:

  File "/workspace/hydragnn/run_training.py", line 75, in _
    model = create_model_config(
  File "/workspace/hydragnn/models/create.py", line 36, in create_model_config
    return create_model(
  File "/workspace/hydragnn/models/create.py", line 189, in create_model
    model = CGCNNStack(
  File "/workspace/hydragnn/models/CGCNNStack.py", line 34, in __init__
    super().__init__(
  File "/workspace/hydragnn/models/Base.py", line 102, in __init__
    self._init_conv()
  File "/workspace/hydragnn/models/Base.py", line 110, in _init_conv
    self.graph_convs.append(self.get_conv(self.input_dim, self.hidden_dim))
  File "/workspace/hydragnn/models/CGCNNStack.py", line 43, in get_conv
    cgcnn = CGConv(
  File "/usr/local/lib/python3.8/dist-packages/torch_geometric/nn/conv/cg_conv.py", line 57, in __init__
    super().__init__(aggr=aggr, **kwargs)
  File "/usr/local/lib/python3.8/dist-packages/torch_geometric/nn/conv/message_passing.py", line 190, in __init__
    self.__class__._jinja_propagate = module.propagate
AttributeError: module 'torch_geometric.nn.conv.cg_conv_CGConv_propagate' has no attribute 'propagate'

@pzhanggit @allaffa have you seen such error before?

@jychoi-hpc
Yesterday, inspecting the output of the CI workflow tests, I noticed that you were obtaining this error when you were trying to use Python 3.10. However, it seems weird that the version of Python causes this error. This seems more of an error due to the fact that the function method is not found in the implementation of the class, and this should not change with the version of Python used.

@jychoi-hpc
Copy link
Member Author

I found the error can happen for any python version. It is from pyg 2.5.0 (pyg-team/pytorch_geometric#8994). After using pyg 2.3.0, it works now. I put back "3.10" python. Let's test with python 3.8 and 3.10. We can add more but it will slow down the ci test workflow.

Copy link
Collaborator

@pzhanggit pzhanggit left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me.

requirements-torch.txt Outdated Show resolved Hide resolved
hydragnn/utils/distributed.py Show resolved Hide resolved
@allaffa allaffa self-requested a review February 29, 2024 22:28
Copy link
Collaborator

@allaffa allaffa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@pzhanggit @jychoi-hpc
Let's discuss about the versions of python to use.
Please see comments that I added with my last review.

.github/workflows/CI.yml Outdated Show resolved Hide resolved
Copy link
Collaborator

@allaffa allaffa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes. Let’s use Python 3.9 and 3.11

Copy link
Collaborator

@allaffa allaffa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pickle is not needed anymore for Python versions >= 3.9

requirements.txt Outdated Show resolved Hide resolved
Copy link
Collaborator

@allaffa allaffa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks fine to me.

Copy link
Collaborator

@pzhanggit pzhanggit left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me too

@allaffa allaffa merged commit c832f7d into ORNL:main Mar 4, 2024
2 checks passed
RylieWeaver pushed a commit to RylieWeaver/HydraGNN that referenced this pull request Oct 17, 2024
* fix for pypi upload

* upgrading software

* add pyg versions

* wip: ci debugging

* wip: ci debugging

* wip: pyg

* wip: adding python 3.9

* wip: add -x option

* add index url

* update on ci

* update on ci

* try single only

* ci debugging

* fix for logger

* fix for logger

* change order

* pip install testing

* move torch

* move torch

* move torch

* move torch

* update

* update on python version

* update on python version

* update on python version

* update on python version

* add -n0

* debug

* ignore warning

* add mpi4py

* fix filename

* downgrade pyg

* full test

* use original option

* minor fix

* add python 3.10

* rearrange index

* update on README

* python version

* remove pickle
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants