Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Tx2 install dev #384

Merged
merged 90 commits into from
Dec 23, 2022
Merged

Tx2 install dev #384

merged 90 commits into from
Dec 23, 2022

Conversation

Pavlos-Tosidis
Copy link
Collaborator

This PR introduces the instructions for running OpenDR toolkit on an embedded device.
The docker images are uploaded on dockerhub and are thoroughly tested.
A Dockerfile-embedded is also included for future reference/baseline to build the docker image as well as the install_nvidia.sh which installs all dependencies correctly.
#195 should also be closed since this PR is the improved version.

Pavlos-Tosidis and others added 30 commits January 10, 2022 11:22
@Pavlos-Tosidis
Installation script for TX2.
082d72e 
Updated installation.md and changed import statements in object_detection_2d gem and detr.
@Pavlos-Tosidis
Update installation.md
d6aedf6
@Pavlos-Tosidis
Updated tx2 installation script
ec119a9 
Tested it twice on two different TX2 boards successfully.
@Pavlos-Tosidis
Update install_tx2.sh
24b5a57
@Pavlos-Tosidis
Update installation.md
43ff351
@Pavlos-Tosidis
Update installation.md
01da64a
@Pavlos-Tosidis
Update installation.md
080a2f3
@ad-daniel
Merge branch 'develop' into tx2_install
c75514f
@ad-daniel
Merge branch 'develop' into tx2_install
4bb4450
@ad-daniel
Merge branch 'develop' into tx2_install
79703b2
@Pavlos-Tosidis @ad-daniel
Update docs/reference/installation.md
e4ac47a 
Co-authored-by: ad-daniel <44834743+ad-daniel@users.noreply.github.com>
@Pavlos-Tosidis @ad-daniel
Update bin/install_tx2.sh
7b6db33 
Co-authored-by: ad-daniel <44834743+ad-daniel@users.noreply.github.com>
@Pavlos-Tosidis @ad-daniel
Update bin/install_tx2.sh
ec9d183 
Co-authored-by: ad-daniel <44834743+ad-daniel@users.noreply.github.com>
@Pavlos-Tosidis @ad-daniel
Update bin/install_tx2.sh
37940da 
Co-authored-by: ad-daniel <44834743+ad-daniel@users.noreply.github.com>
@Pavlos-Tosidis
Update install_tx2.sh
7ce782d
@Pavlos-Tosidis
Update install_tx2.sh
356f597
@Pavlos-Tosidis
Update install_tx2.sh
db4b5a5
@Pavlos-Tosidis
Update install_tx2.sh
5b7cd85
@Pavlos-Tosidis
Update install_tx2.sh
002e858
@Pavlos-Tosidis
Update edgespeechnets_learner.py
0345ba0
@Pavlos-Tosidis
Update install_tx2.sh
fa9cd40
@Pavlos-Tosidis
This PR includes the docker file for tx-2.
4971db9 
Tools that were tested under opendr/projects/perception and work:
- [x] Activity recognition
- [x] Face recognition
- [x] Lightweight Open Pose
- [x] Multimodal human centric
- [x] Object Detection 2D
   - [x] CenterNet
   - [x] Detr
   - [x] Gem
   - [x] RetinaFace
   - [x] SSD
   - [x] YOLOv3
- [x] Object tracking 2d
- [x] Semantic segmentation - Bisenet
- [x] Speech command recognition

The rest of the demos are not complete, i.e. missing an inference demo and/or data to run it.
@Pavlos-Tosidis
This PR includes the docker file for tx-2.
e1dbf0b 
Tools that were tested under opendr/projects/perception and work:
- [x] Activity recognition
- [x] Face recognition
- [x] Lightweight Open Pose
- [x] Multimodal human centric
- [x] Object Detection 2D
   - [x] CenterNet
   - [x] Detr
   - [x] Gem
   - [x] RetinaFace
   - [x] SSD
   - [x] YOLOv3
- [x] Object tracking 2d
- [x] Semantic segmentation - Bisenet
- [x] Speech command recognition

The rest of the demos are not complete, i.e. missing an inference demo and/or data to run it.
@Pavlos-Tosidis
This PR includes the docker file for tx-2.
c7a69cf 
Tools that were tested under opendr/projects/perception and work:
- [x] Activity recognition
- [x] Face recognition
- [x] Lightweight Open Pose
- [x] Multimodal human centric
- [x] Object Detection 2D
   - [x] CenterNet
   - [x] Detr
   - [x] Gem
   - [x] RetinaFace
   - [x] SSD
   - [x] YOLOv3
- [x] Object tracking 2d
- [x] Semantic segmentation - Bisenet
- [x] Speech command recognition

The rest of the demos are not complete, i.e. missing an inference demo and/or data to run it.
@Pavlos-Tosidis
Added argument for tx2, agx and nx support.
16993c5 
Added instructions on installation.md
@Pavlos-Tosidis
Added argument for tx2, agx and nx support.
52e7604 
Added instructions on installation.md
@Pavlos-Tosidis
Added argument for tx2, agx and nx support.
8a6154a 
Added instructions on installation.md
@ad-daniel
Merge branch 'develop' into tx2_install
283fefd
@ad-daniel
Merge branch 'develop' into tx2_install
5f28970
@ad-daniel
Merge branch 'develop' into tx2_install
5bf953d
@Pavlos-Tosidis Pavlos-Tosidis added documentation Improvements or additions to documentation enhancement New feature or request test sources Run style checks labels Dec 20, 2022
@tsampazk tsampazk mentioned this pull request Dec 20, 2022
Closed
passalis
passalis requested changes Dec 21, 2022
View reviewed changes
Copy link
Collaborator

@passalis passalis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you! I have added a few comments regarding the documentation. develop has a separate documentation file where instructions for customization/building docker images is described, so the relevant instructions should be added there instead.

Dockerfile-embedded Outdated Show resolved Hide resolved
Dockerfile-embedded Outdated Show resolved Hide resolved
Dockerfile-embedded Outdated Show resolved Hide resolved
Dockerfile-embedded Outdated Show resolved Hide resolved
Dockerfile-embedded Outdated Show resolved Hide resolved
Dockerfile-embedded Outdated Show resolved Hide resolved
docs/reference/installation.md Outdated Show resolved Hide resolved
docs/reference/installation.md Outdated Show resolved Hide resolved
@passalis
Copy link
Collaborator

Please also update CHANGELOG.md to indicate that we have included instructions, an improved embedded dockerfile and changes to support these devices.

@ad-daniel ad-daniel added the test tools Test the toolkit methods label Dec 22, 2022
ad-daniel
ad-daniel approved these changes Dec 23, 2022
View reviewed changes
Copy link
Collaborator

@ad-daniel ad-daniel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you!

passalis
passalis approved these changes Dec 23, 2022
View reviewed changes
Copy link
Collaborator

@passalis passalis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you!

@Pavlos-Tosidis Pavlos-Tosidis merged commit 381e1f5 into develop Dec 23, 2022
@Pavlos-Tosidis Pavlos-Tosidis deleted the tx2_install_dev branch December 23, 2022 10:36
lucamarchionni pushed a commit to lucamarchionni/opendr that referenced this pull request Jun 10, 2024
@Pavlos-Tosidis @ad-daniel
@passalis @tsampazk
Tx2 install dev (opendr-eu#384)
6ee9591 
* Installation script for TX2.
Updated installation.md and changed import statements in object_detection_2d gem and detr.

* Update installation.md

* Updated tx2 installation script

Tested it twice on two different TX2 boards successfully.

* Update install_tx2.sh

* Update installation.md

* Update installation.md

* Update installation.md

* Update docs/reference/installation.md

Co-authored-by: ad-daniel <44834743+ad-daniel@users.noreply.github.com>

* Update bin/install_tx2.sh

Co-authored-by: ad-daniel <44834743+ad-daniel@users.noreply.github.com>

* Update bin/install_tx2.sh

Co-authored-by: ad-daniel <44834743+ad-daniel@users.noreply.github.com>

* Update bin/install_tx2.sh

Co-authored-by: ad-daniel <44834743+ad-daniel@users.noreply.github.com>

* Update install_tx2.sh

* Update install_tx2.sh

* Update install_tx2.sh

* Update install_tx2.sh

* Update install_tx2.sh

* Update edgespeechnets_learner.py

* Update install_tx2.sh

* This PR includes the docker file for tx-2.

Tools that were tested under opendr/projects/perception and work:
- [x] Activity recognition
- [x] Face recognition
- [x] Lightweight Open Pose
- [x] Multimodal human centric
- [x] Object Detection 2D
   - [x] CenterNet
   - [x] Detr
   - [x] Gem
   - [x] RetinaFace
   - [x] SSD
   - [x] YOLOv3
- [x] Object tracking 2d
- [x] Semantic segmentation - Bisenet
- [x] Speech command recognition

The rest of the demos are not complete, i.e. missing an inference demo and/or data to run it.

* This PR includes the docker file for tx-2.

Tools that were tested under opendr/projects/perception and work:
- [x] Activity recognition
- [x] Face recognition
- [x] Lightweight Open Pose
- [x] Multimodal human centric
- [x] Object Detection 2D
   - [x] CenterNet
   - [x] Detr
   - [x] Gem
   - [x] RetinaFace
   - [x] SSD
   - [x] YOLOv3
- [x] Object tracking 2d
- [x] Semantic segmentation - Bisenet
- [x] Speech command recognition

The rest of the demos are not complete, i.e. missing an inference demo and/or data to run it.

* This PR includes the docker file for tx-2.

Tools that were tested under opendr/projects/perception and work:
- [x] Activity recognition
- [x] Face recognition
- [x] Lightweight Open Pose
- [x] Multimodal human centric
- [x] Object Detection 2D
   - [x] CenterNet
   - [x] Detr
   - [x] Gem
   - [x] RetinaFace
   - [x] SSD
   - [x] YOLOv3
- [x] Object tracking 2d
- [x] Semantic segmentation - Bisenet
- [x] Speech command recognition

The rest of the demos are not complete, i.e. missing an inference demo and/or data to run it.

* Added argument for tx2, agx and nx support.
Added instructions on installation.md

* Added argument for tx2, agx and nx support.
Added instructions on installation.md

* Added argument for tx2, agx and nx support.
Added instructions on installation.md

* Update installation.md

* Update activate_nvidia.sh

Corrected python to point to python3 on Nvidia

* Working ROS and correct export of Python version

* Working ROS and correct export of Python version

* Working ROS and correct export of Python version

* Update Dockerfile-embedded

* Update Dockerfile-embedded

* Update Dockerfile-embedded

* Working ROS and correct export of Python version

* Fixed catkin_make, added it to dockerfile.

* Added missing HINT from installation.md

* Updates on default values for FairMOT ros node class ctor

* Fixed duplicate shortcut on deepsort ros node argparse

* Fixed missing shortcut on rgbd hand gesture reco ros node argparse

* Added "opendr_" to data gen package and "_node" to the node file name

* Renamed package to "opendr_perception" and added "_node" to scripts

* Applied fixes to yolov5

* Added "opendr_" to planning package

* Added "opendr_" to bridge package

* Added "opendr_" to simulation package

* Fixed old version of torch in pip_requirements.txt

* Renamed ros bridge package doc

* Renamed dirs, etc. from opendr_ros_bridge to opendr_bridge to match the actual package name

* Fixed ros readme link from customize.md

* Fixed index.md link for opendr-ros-bridge.md

* Minor typo fix in issues.md

* Fixed bridge package name in its doc

* Fixed bridge imports

* Updated for dev_branch

Fixed some missing dependencies

* Fixed some missing dependencies

* add detectron2 (test with new p3.8 Dockerfile)

* Detectron2 issues

* Update install_nvidia.sh

* python3.8 test

* Rolling back to Python3.6.9

* Update install_nvidia.sh

* Updated Dockerfile and dependencies for embedded devices
Changed python to python3 on all ROS nodes
Fixed a couple of issues
Added some exports in activate_nvidia.sh

* Various Fixes

* Removed torch import on data.py and the corresponding reference in Video class.
Added some docker run instructions

* Remove unused import

* Remove Typehint for pyhton compatibilty

* Apply suggestions from code review

Dockerfile-embedded suggested changes

Co-authored-by: Nikolaos Passalis <passalis@users.noreply.github.com>

* Fixed suggested changes

* Format

Co-authored-by: ad-daniel <44834743+ad-daniel@users.noreply.github.com>
Co-authored-by: ad-daniel <daniel.dias@epfl.ch>
Co-authored-by: Nikolaos Passalis <passalis@users.noreply.github.com>
Co-authored-by: tsampazk <tsampaka@csd.auth.gr>
Co-authored-by: Kostas Tsampazis <27914645+tsampazk@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ad-daniel ad-daniel ad-daniel approved these changes

@passalis passalis passalis approved these changes

@omichel omichel Awaiting requested review from omichel omichel is a code owner

@stefaniapedrazzi stefaniapedrazzi Awaiting requested review from stefaniapedrazzi stefaniapedrazzi is a code owner

Assignees
No one assigned
Labels
documentation Improvements or additions to documentation enhancement New feature or request test sources Run style checks test tools Test the toolkit methods
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@Pavlos-Tosidis @passalis @ad-daniel @tsampazk