Skip to content
CI

Refactor parquet dataloader #1564

Sign in to view logs

Refactor parquet dataloader

Refactor parquet dataloader #1564

Triggered via pull request January 10, 2025 13:57
@zyaojzyaoj
synchronize #867
zyaoj/refactor-data-parquet-fairseq2
Status Failure
Total duration 2m 52s
Artifacts –

ci_lint_py.yaml

on: pull_request
Lint Python  /  Lint
2m 44s
Lint Python / Lint
Fit to window
Zoom out
Zoom in

Annotations

24 errors
Lint Python / Lint: tests/unit/data/parquet/test_parquet_utils.py#L1
Imports are incorrectly sorted and/or formatted.
Lint Python / Lint: tests/unit/data/parquet/conftest.py#L1
Imports are incorrectly sorted and/or formatted.
Lint Python / Lint: src/fairseq2/data/parquet/utils.py#L1
Imports are incorrectly sorted and/or formatted.
Lint Python / Lint: src/fairseq2/data/parquet/__init__.py#L1
Imports are incorrectly sorted and/or formatted.
Lint Python / Lint: src/fairseq2/data/parquet/configs.py#L1
Imports are incorrectly sorted and/or formatted.
Lint Python / Lint
Process completed with exit code 1.
Lint Python / Lint: src/fairseq2/data/parquet/arrow.py#L3
'numpy as np' imported but unused
Lint Python / Lint: src/fairseq2/data/parquet/utils.py#L527
redefinition of unused 'pyarrow_table_to_torch_dict' from line 126
Lint Python / Lint: tests/unit/data/parquet/conftest.py#L30
blank line at end of file
Lint Python / Lint: tests/unit/data/parquet/test_parquet_utils.py#L1
'fairseq2.data.parquet.utils.NestedDict' imported but unused
Lint Python / Lint
Process completed with exit code 1.
Lint Python / Lint: src/fairseq2/data/parquet/utils.py#L1
would reformat
Lint Python / Lint: tests/unit/data/parquet/conftest.py#L1
would reformat
Lint Python / Lint
Process completed with exit code 1.
Lint Python / Lint: src/fairseq2/data/parquet/arrow.py#L8
Function is missing a type annotation
Lint Python / Lint: src/fairseq2/data/parquet/arrow.py#L12
Missing type parameters for generic type "Array"
Lint Python / Lint: src/fairseq2/data/parquet/arrow.py#L22
Module has no attribute "list_flatten"
Lint Python / Lint: src/fairseq2/data/parquet/arrow.py#L23
Module has no attribute "subtract"
Lint Python / Lint: src/fairseq2/data/parquet/arrow.py#L23
"Array[Any, Any]" has no attribute "offsets"; maybe "offset"?
Lint Python / Lint: src/fairseq2/data/parquet/arrow.py#L32
Missing type parameters for generic type "ChunkedArray"
Lint Python / Lint: src/fairseq2/data/parquet/arrow.py#L32
Missing type parameters for generic type "Array"
Lint Python / Lint: src/fairseq2/data/parquet/arrow.py#L38
Argument 1 to "_fix_list_offset" has incompatible type "_Weakrefable"; expected "Array[Any, Any]"
Lint Python / Lint: src/fairseq2/data/parquet_v0/tools.py#L13
Library stubs not installed for "pandas"
Lint Python / Lint: src/fairseq2/data/parquet_v0/tools.py#L49
Missing type parameters for generic type "Array"