Skip to content

Commit

Permalink
document experiments
Browse files Browse the repository at this point in the history
  • Loading branch information
Sohojoe authored Aug 15, 2018
1 parent 932166d commit de95928
Showing 1 changed file with 25 additions and 0 deletions.
25 changes: 25 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,10 +1,31 @@
# ActiveRagdollControllers
Research into controllers for 2d and 3d Active Ragdolls (using MujocoUnity+ml_agents)

----

#### Contributors
* Joe Booth ([SohoJoe](https://github.com/Sohojoe))

----
#### Download builds (Mac, Windows): [see Releases](https://github.com/Sohojoe/ActiveRagdollControllers/releases)
---
### Controller004
![Controller004](images/Controller004.13-10m.gif)
* **Type:** Discrete 2D
* **Build (MacOS)** TODO [v0.004](https://github.com/Sohojoe/ActiveRagdollControllers/releases/tag/v0.003) **Playable**
* **Actions:** No-op, Forward, Backwards, Jump, Jump+Forward, Jump+Backwards
* **Controls:** Left arrow, Right arrow, Spacebar
* **Mujoco Model:** DeepMindHopper
* **Hypostheis**: Use discreate + random trainer to create human controller.
* **Outcome:**
* **SUCCESS** - contriol feels responsive
* ... Has emerging functionality - i.e. tap left for small step, swap direction in air


### Controller003
![Controller003](images/Controller003.gif)
* **Type:** Continuous 2D
* **Build (MacOS)** [v0.003](https://github.com/Sohojoe/ActiveRagdollControllers/releases/tag/v0.003)
* **Actions:** Forward / Backwards
* **Mujoco Model:** DeepMindHopper
* **Hypostheis**: Use an adversarial hierarchical trained agent as the controller which gets the inverse reward of the locomation agent on a slower time step. The idea is that it will push the locomoation agent to focus on its weakest areas.
Expand All @@ -15,7 +36,9 @@ Research into controllers for 2d and 3d Active Ragdolls (using MujocoUnity+ml_ag


### Controller002
![Controller002](images/Controller002.gif)
* **Type:** Continuous 2D
* **Build (MacOS, Windows)** [v0.002](https://github.com/Sohojoe/ActiveRagdollControllers/releases/tag/v0.002)
* **Actions:** Forward / Backwards
* **Input:** Unity Axis input (left/right or a/d or joystick)
* **Mujoco Model:** DeepMindHopper
Expand All @@ -35,7 +58,9 @@ Research into controllers for 2d and 3d Active Ragdolls (using MujocoUnity+ml_ag
* Controller002InputAgent.cs -

### Controller001
![Controller001](images/Controller001.gif)
* **Type:** Discrete 2D
* **Build (MacOS)** [v0.001](https://github.com/Sohojoe/ActiveRagdollControllers/releases/tag/v0.001)
* **Actions:** Forward / Backwards
* **Mujoco Model:** DeepMindHopper
* **Hypostheis**: It should be simple to train a backwards / forwards by giving the agent a +1 / 1 velocity target which feeds the reward function.
Expand Down

0 comments on commit de95928

Please sign in to comment.