Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Took hours to download mainnet-beta snapshot #139

Open
lubao opened this issue Nov 7, 2024 · 4 comments
Open

Took hours to download mainnet-beta snapshot #139

lubao opened this issue Nov 7, 2024 · 4 comments
Labels
enhancement New feature or request

Comments

@lubao
Copy link
Contributor

lubao commented Nov 7, 2024

Community Note

  • Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
  • Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request
  • If you are interested in working on this issue or have submitted a pull request, please leave a comment

What is the outcome that you are trying to reach?

Reducing time to download snapshot
Downloading snapshot from known validator can take hours to finish since the speed is low.

Describe the solution you would like

  1. Adding downloading snapshot in user-data script. Following is a sample script
cd /var/solana/data/ledger
wget --trust-server-names http://entrypoint3.mainnet-beta.solana.com/snapshot.tar.bz2
wget --trust-server-names http://entrypoint3.mainnet-beta.solana.com/incremental-snapshot.tar.bz2
sed -i "s/--log -/--no-snapshot-fetch --log -/g" /home/solana/bin/validator.sh
cd -
  1. leverage https://github.com/c29r3/solana-snapshot-finder
  2. TBD

Describe alternatives you have considered

Additional context

@lubao lubao changed the title Took hours to download snapshot Took hours to download mainnet-beta snapshot Nov 10, 2024
@frbrkoala
Copy link
Contributor

Thank you for suggestion! Will explore it as an add-on feature for Solana. Depending on location, snapshot download time varies. For the last couple of tests it took 1.5-2 hours to download the snapshot the default way. How long does it take to do it with the suggested script?

Copy link
Contributor

This issue has been automatically marked as stale because it has been open 30 days
with no activity. Remove stale label or comment or this issue will be closed in 10 days

@github-actions github-actions bot added the stale label Dec 15, 2024
Copy link
Contributor

Issue closed due to inactivity.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Dec 26, 2024
@frbrkoala frbrkoala added the enhancement New feature or request label Dec 27, 2024
@frbrkoala frbrkoala reopened this Dec 27, 2024
@frbrkoala frbrkoala removed the stale label Dec 27, 2024
@cex-trader
Copy link

Thank you for suggestion! Will explore it as an add-on feature for Solana. Depending on location, snapshot download time varies. For the last couple of tests it took 1.5-2 hours to download the snapshot the default way. How long does it take to do it with the suggested script?

depend on the location & bandwidth, snapshot only takes several minutes. how to support this way.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants