Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Utilizing Expert Data (.npz) in format of SB3. #777

Open
azafar1991 opened this issue Sep 7, 2023 · 5 comments
Open

Utilizing Expert Data (.npz) in format of SB3. #777

azafar1991 opened this issue Sep 7, 2023 · 5 comments
Labels
enhancement New feature or request

Comments

@azafar1991
Copy link

Is it possible to use the trajectories (.npz) collected as expert response which is compatible for SB3 IRL models. ? I made an env which take user input to move an object in game. I collected the trajectories by providing user input , considering it to be expert response. But i am unable to find an example with which i can utilize that dataset.

@azafar1991 azafar1991 added the enhancement New feature or request label Sep 7, 2023
@AdrianPrados
Copy link

I have the same problem, i have created a PyGame environment using also Gym to collect demonstrations by providing user input but i am not able to use that directly with the imitation implementation.

@Rajesh-Siraskar
Copy link

I too, plan to use a custom environment and generate trajectories for use as Expert data. It would be great to create a tutorial/example on these lines

@aPovidlo
Copy link

@azafar1991 @AdrianPrados @Rajesh-Siraskar Do you find the solution of the problem? Faced with a similar problem.

@Rajesh-Siraskar
Copy link

@azafar1991 @AdrianPrados @Rajesh-Siraskar Do you find the solution of the problem? Faced with a similar problem.

Hi Andrey, @aPovidlo :

This is what I have been able to achieve:

  • Use of Imitation Inverse RL Libraries (as a demo integrated with Behavior Cloning algo.)
  • Use of a custom environment that I built for predictive maintenance
  • TensorBoard integration

@rizqisubeno
Copy link

Hi, Have you tried saving and loading with .npy format?. In my project, I successfully saved and re-loaded in every different scenario saving with different_name of *.npy file

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

5 participants