Code

Add fast sync algorithm.#2763

Code

Closed

shamil-gadelshin wants to merge 50 commits intomainautonomys/subspace:mainfrom add-fast-sync-algorithmautonomys/subspace:add-fast-sync-algorithmCopy head branch name to clipboard

+905-148

Commits

Commits on May 10, 2024

• Add fast-sync engine.

  shamil-gadelshin

  committed
  f2c9704

  Copy full SHA for f2c9704

• Add raw block importer.

  shamil-gadelshin

  committed
  eca1522

  Copy full SHA for eca1522

Commits on May 14, 2024

• node: Add fast-sync algorithm.

  shamil-gadelshin

  committed
  00c3d65

  Copy full SHA for 00c3d65

• node: Modify CLI configuration to support fast-sync.

  shamil-gadelshin

  committed
  8a5e758

  Copy full SHA for 8a5e758

• Integrate fast-sync algorithm into dsn-sync

  shamil-gadelshin

  committed
  011f4a5

  Copy full SHA for 011f4a5

Commits on May 16, 2024

• Apply review suggestions.

  Show description for 042ae07
  shamil-gadelshin

  committed
  042ae07

  Copy full SHA for 042ae07

Commits on May 17, 2024

• Change peer source for fast-sync.

  shamil-gadelshin

  committed
  f8c4600

  Copy full SHA for f8c4600

• Update fast sync method.

  shamil-gadelshin

  committed
  ae590ca

  Copy full SHA for ae590ca

Commits on May 21, 2024

• Only sync state from peers that have a higher best block number than block number of the state we're trying to download

  nazar-pc

  committed
  1fb2c0e

  Copy full SHA for 1fb2c0e

• Import lists of blocks together instead of individually to leverage verification concurrency and better error handling

  nazar-pc

  committed
  14408db

  Copy full SHA for 14408db

• Remove incorrect of last block from second last segment and add TODOs

  nazar-pc

  committed
  90b0ec9

  Copy full SHA for 90b0ec9

Commits on May 22, 2024

• Merge pull request #2779 from subspace/add-fast-sync-algorithm-fixes

  Show description for 9685fe9
  shamil-gadelshin

  authored
  9685fe9

  Copy full SHA for 9685fe9

• Refactor fast-sync.

  shamil-gadelshin

  committed
  9d384f5

  Copy full SHA for 9d384f5

• Move fast-sync out of DSN-sync scope.

  shamil-gadelshin

  committed
  34b5a14

  Copy full SHA for 34b5a14

• Modify sync CLI arguments.

  shamil-gadelshin

  committed
  7e71097

  Copy full SHA for 7e71097

Commits on May 23, 2024

• Simplify fast-sync-engine.

  shamil-gadelshin

  committed
  c6f0240

  Copy full SHA for c6f0240

• Merge branch 'main' into add-fast-sync-algorithm

  Show description for 08510d2
  shamil-gadelshin

  committed
  08510d2

  Copy full SHA for 08510d2

Commits on May 24, 2024

• Inline both import_raw_block and create_raw_block into the place where they are used

  nazar-pc

  committed
  f9d544f

  Copy full SHA for f9d544f

• Merge pull request #2785 from subspace/inline-import-raw-block

  Show description for 70de7e5
  shamil-gadelshin

  authored
  70de7e5

  Copy full SHA for 70de7e5

• Remove peer-management elements from fast-sync.

  shamil-gadelshin

  committed
  5938323

  Copy full SHA for 5938323

• Add some comments.

  shamil-gadelshin

  committed
  72820c2

  Copy full SHA for 72820c2

Commits on May 27, 2024

• Revert unnecessary changes to DSN sync code

  nazar-pc

  committed
  9a8778d

  Copy full SHA for 9a8778d

• Remove FastSyncResult that is no longer necessary

  nazar-pc

  committed
  81b011d

  Copy full SHA for 81b011d

• Remove unnecessary retrieval of last segment header

  nazar-pc

  committed
  17601c2

  Copy full SHA for 17601c2

• Rename download_segment_headers to sync_segment_headers and simplify its API

  nazar-pc

  committed
  f335461

  Copy full SHA for f335461

• Make fast sync not assume block size

  nazar-pc

  committed
  83228fc

  Copy full SHA for 83228fc

Commits on May 28, 2024

• Merge pull request #2795 from subspace/revert-dsn-sync-changes

  Show description for 73c0d8d
  shamil-gadelshin

  authored
  73c0d8d

  Copy full SHA for 73c0d8d

• Toggle skip_proof variable for state downloading.

  shamil-gadelshin

  committed
  ac4db9e

  Copy full SHA for ac4db9e

• Merge pull request #2796 from subspace/fast-sync-improvements

  Show description for 96c20cf
  nazar-pc

  authored
  96c20cf

  Copy full SHA for 96c20cf

• Make fast sync import block atomically, simplify code

  nazar-pc

  committed
  7e416f1

  Copy full SHA for 7e416f1

• Update Subspace block import to be better suited for custom sync mechanisms

  nazar-pc

  committed
  3771a0a

  Copy full SHA for 3771a0a

• Small corrections and cleanups

  nazar-pc

  committed
  1ad08d9

  Copy full SHA for 1ad08d9

• Merge pull request #2797 from subspace/atomic-fast-sync-block-import

  Show description for 2005b4b
  nazar-pc

  authored
  2005b4b

  Copy full SHA for 2005b4b

• Remove unnecessary Mutex and unused generics

  nazar-pc

  committed
  fa89440

  Copy full SHA for fa89440

• Simplify fast sync engine API, add support for fork_id

  nazar-pc

  committed
  350dfbc

  Copy full SHA for 350dfbc

• Simplify networking in fast sync engine, simplify generics further

  nazar-pc

  committed
  f247877

  Copy full SHA for f247877

• Merge pull request #2798 from subspace/fast-sync-cleanup

  Show description for 3b5ab82
  nazar-pc

  authored
  3b5ab82

  Copy full SHA for 3b5ab82

• Correct check for fast sync start and fix sync mode resetting after (optional) fast sync

  nazar-pc

  committed
  95d17ce

  Copy full SHA for 95d17ce

• Simplify block import without resorting to apply_block low-level API

  nazar-pc

  committed
  5b39dd1

  Copy full SHA for 5b39dd1

Commits on May 29, 2024

• Do not finalize blocks that do not exist

  nazar-pc

  committed
  0edf1f7

  Copy full SHA for 0edf1f7

• Fix condition for clearing block gap

  nazar-pc

  committed
  ae8a54c

  Copy full SHA for ae8a54c

• Print info after fast sync

  nazar-pc

  committed
  ccea056

  Copy full SHA for ccea056

• Merge pull request #2799 from subspace/simplify-fast-sync

  Show description for c14a7b2
  nazar-pc

  authored
  c14a7b2

  Copy full SHA for c14a7b2

Commits on May 30, 2024

• Merge branch 'main' into add-fast-sync-algorithm

  shamil-gadelshin

  authored
  7b39a9d

  Copy full SHA for 7b39a9d

• Merge branch 'main' into add-fast-sync-algorithm

  Show description for 0dafb27
  shamil-gadelshin

  committed
  0dafb27

  Copy full SHA for 0dafb27

• Update fast-sync after latest polkadot-sdk

  shamil-gadelshin

  committed
  c175ca8

  Copy full SHA for c175ca8

• Rename fast-sync -> snap-sync

  shamil-gadelshin

  committed
  1940fe4

  Copy full SHA for 1940fe4

• Refactor fast-sync.

  shamil-gadelshin

  committed
  677c662

  Copy full SHA for 677c662

• Remove redundant ConfigSyncMode type

  shamil-gadelshin

  committed
  2e0a3d7

  Copy full SHA for 2e0a3d7

• Remove substrate sync option.

  shamil-gadelshin

  committed
  b216a18

  Copy full SHA for b216a18