Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How many step should i train? #25

Open
winiel559 opened this issue Jun 11, 2017 · 0 comments
Open

How many step should i train? #25

winiel559 opened this issue Jun 11, 2017 · 0 comments

Comments

@winiel559
Copy link

winiel559 commented Jun 11, 2017

You mentioned we could start testing after perplexity<=50.
I noticed you trained the example model for 220k steps with a small corpus(file size 13M).
But even with twitter_large(370M), my perplexity converges very quickly.
It gets to 50 after about 20k steps. And it gives pretty dummy answers.
Should i just train longer?

BTW is there any chance i can use the reinforcement learning?
Tks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant