Skip to content

Dynamic chunk splitting and progress stats

Compare
Choose a tag to compare
@vcschapp vcschapp released this 22 Dec 05:15
· 64 commits to main since this release

API changes:

  • QuerySpec structure adds new SplitUntil field for requesting dynamic chunk splitting. [Issue #3]
  • Stats structure adds four new stats fields for reporting query progress data both within a single query (Stream) and within a group of queries (QueryManager). [Issue #1]

Big Features:

  • With dynamic chunk splitting, when CloudWatch Logs Insights returns the maximum possible number of results, MaxLimit (an indicator that more results may be available within the chunk), users can ask the query manager to split the chunk time range into smaller time ranges and retry them in order to capture all possible results. [Issue #3]
  • With granular progress statistics in the Stats structure, developers now have the data they need to create progress bars and user experiences to inform their application's users how much of the requested query work has been finished and how much remains. [Issue #1]

Improvements:

  • Transient network errors are now retried. [Issue #10 ]
  • Some small documentation issues are addressed.

Full Changelog: v1.1.0...v1.2.0