Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A3C episode length unbounded #49

Open
mkisantal opened this issue Sep 13, 2017 · 0 comments
Open

A3C episode length unbounded #49

mkisantal opened this issue Sep 13, 2017 · 0 comments

Comments

@mkisantal
Copy link

Episodes are not terminated when episode_step_count exceeds max_episode_length.

It is not necessarily a problem, but as both summary writing and model saving is dependent on episode_count, if the episodes are getting too long then these actions are less frequent.

In my case (I'm using the algorithm with a different environment, not doom), as the agent got better episodes exceeded 8000 steps, so that really influenced the model saving frequency.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant