why aren't obstacles considered during the rollout testing

[parshakova]

Hi,

Could you please let me know why the obstacles are not contained in the rollout testing phase?
Since the code only considers the transitions to free cells not the valid transition under a particular action

Thanks

[avivt]

In the rollout testing, e.g., line 22 in https://github.com/avivt/VIN/blob/master/MDPs/%40Gridworld_Graph8/Gridworld_Graph8.m a transition into an obstacle keeps the agent in the same place. So if the network predicts going into an obstacle the agent will never reach its goal.

…

On Mon, Jun 18, 2018 at 11:48 PM, digitnumber ***@***.***> wrote: Hi, Could you please let me know why the obstacles are not contained in the rollout testing phase? Since the code only considers the transitions to free cells not the valid transition under a particular action Thanks — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#14>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AOeQNWbcBA29udn5ybu7R-8VcOxu2LnFks5t-J6zgaJpZM4Us7wP> .

[parshakova]

Thanks for the reply!
But in the paper (page 6, 1 passage) it is said

trajectory was said to succeed if it reached a goal without hitting obstacles

So I just assumed that whenever an agent runs into an obstacle the game is over, isn't it what you meant?

[avivt]

if the agent policy hits an obstacle then it can never reach the goal. So counting how many times it reached the goal satisfies the condition of the paper.

…

On Tue, Jun 19, 2018 at 4:04 PM, digitnumber ***@***.***> wrote: Thanks for the reply! But in the paper (page 6, 1 passage) it is said trajectory was said to succeed if it reached a goal without hitting obstacles So I just assumed that whenever an agent runs into an obstacle the game is over, isn't it what you meant? — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#14 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AOeQNZo2yVhEQZiiY9kcrOrmQMOxK5RZks5t-YNqgaJpZM4Us7wP> .