-
Notifications
You must be signed in to change notification settings - Fork 1
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
High memory usage ES on 180 mio index #49
Comments
Check: High memory for ES process
|
Set "num_candidates" from 1000 to 100. Code: embeddings.cc/webservice_public/es.py Line 139 in 5908fd6
Edit: Restart:
|
|
/data/elasticsearch-8.3.1/logs/gc.log |
path.logs: /data/es8-logs configured here: non ".gz" files: |
state: for some uris, it works (see above). mem usage stays at nearly 87% (seems to increase a bit) |
Can maybe solved with Faiss, see issue #50 |
Config: New index dbpedia_wikidata_full with 179,706,494 entities
Issue: The server throws an error.
The text was updated successfully, but these errors were encountered: