Skip to content

Conversation

@jsztompka
Copy link

No description provided.

@rshtirmer
Copy link
Contributor

While I have not confirmed if this actually improves speed (i have a hunch it does), I have tested this PR with the latest codebase and can confirm it works.

@jsztompka
Copy link
Author

It's fairly easy to test, if you use MlpPolicy on the agent (it's just a bit faster and more visual) , what I've noticed is that after about 2-3 minutes of running optimization the whole thing really slows down. If you look at the code in the _next_observation it keeps adding new observations to the frame and does all recalculations on the full frame so as the list grows it becomes slower.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants