Skip to content

Milestone M1 - 3.07 - 14.07.2024

Past due by 4 months 94% complete

Rai:

core:

  • migrate to native ros function calling - topics, actions, services, message interface
  • migration of scenarios to langgraph
  • task queue PoC
  • multiagent PoC
  • caching

interaction:

  • ASR integration
  • HRI Node PoC

nodes:

  • flexible knowledge database / semantic map node PoC: RFC
  • grounding DINO node

ui:

  • GUI requirements: RFC

prompts/configuration:

  • ro…

Rai:

core:

  • migrate to native ros function calling - topics, actions, services, message interface
  • migration of scenarios to langgraph
  • task queue PoC
  • multiagent PoC
  • caching

interaction:

  • ASR integration
  • HRI Node PoC

nodes:

  • flexible knowledge database / semantic map node PoC: RFC
  • grounding DINO node

ui:

  • GUI requirements: RFC

prompts/configuration:

  • robot identity
  • define user input to RAI

Sim/robotics:

General:

  • documentation node design/PoC
  • 1 benchmark environment
    • example custom ros2 message - for robustness testing w/ unknown ros2 interfaces
  • high level diagnostics requirements definition

Husarion demo:

  • release o3de husarion project w/ hosted docker image to Open Source
  • exploration w/ NoMaD on Husarion

Agri demo:
(not to be finalized in M1)

  • agri demo improvements
    • assets cleanup
    • new repo
    • initial nav2 work

Manipulation demo
(not to be finalized in M1)

  • PoC of OpenVLA integration with Manipulation Demo
    • connect model to moveit
  • demo task definition
Loading