Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding Action Chunking with Transformers (ACT) to baselines #640

Open
wants to merge 26 commits into
base: main
Choose a base branch
from

Conversation

ywchoi02
Copy link

@ywchoi02 ywchoi02 commented Oct 20, 2024

@StoneT2000
Copy link
Member

before I review code, make sure to add a README.md similar to the other baselines, just use DP as a reference (how to setup the conda/mamba env, citation etc.)

from torchvision.models._utils import IntermediateLayerGetter
from typing import Dict, List

from ..utils import NestedTensor, is_main_process
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

use absolute imports when possible, it is just the style choice this repo uses.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I changed them to absolute imports, but I'm not sure if they are correct. please let me know if they need to be fixed. I also added a README file.


```bash
conda create -n act-ms python=3.9
conda activate act-ms
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

so the conda env act-ms is created and you do a local pip install. However a simple setup.py file is still missing, can you create that?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I created a simple setup.py.

from torchvision.models._utils import IntermediateLayerGetter
from typing import Dict, List

from examples.baselines.act.act.utils import NestedTensor, is_main_process
Copy link
Member

@StoneT2000 StoneT2000 Oct 22, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

imports should be absolute and relative to act (which you pip install -e .)

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated my code.

import torch
from torch import nn

from examples.baselines.act.act.utils import NestedTensor
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same issue as above

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated my code.

@StoneT2000
Copy link
Member

Final thing probably, can you create an examples.sh script for users to run? Should contain 2 scripts for a few envs, 1 for demonstration loading/replaying and 1 for training. Maybe just 2 for state based and 2 exampls for RGBD that work okay is fine.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants