Skip to content

Commit

Permalink
Modified README for filter and doc_quality to have links to the new r…
Browse files Browse the repository at this point in the history
…ay notebooks

Signed-off-by: SHAHROKH DAIJAVAD <[email protected]>
  • Loading branch information
shahrokhDaijavad committed Jan 9, 2025
1 parent 3b53e0c commit 2ff7ec7
Show file tree
Hide file tree
Showing 2 changed files with 8 additions and 5 deletions.
9 changes: 4 additions & 5 deletions transforms/language/doc_quality/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -91,11 +91,6 @@ To see results of the transform.

[notebook](./doc_quality.ipynb)

### Transforming data using the transform image

To use the transform image to transform your data, please refer to the
[running images quickstart](../../../doc/quick-start/run-transform-image.md),
substituting the name of this transform image and runtime as appropriate.

## Testing

Expand Down Expand Up @@ -161,6 +156,10 @@ ls output
```
To see results of the transform.

### Code example (Ray)

[notebook](./doc_quality-ray.ipynb)


#### Transforming data using the transform image

Expand Down
4 changes: 4 additions & 0 deletions transforms/universal/filter/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -276,6 +276,10 @@ In addition to those available to the transform as defined here,
the set of
[ray launcher options](../../../data-processing-lib/doc/ray-launcher-options.md) are available.

### Code example (Ray)

[notebook](filter-ray.ipynb)

# Filtering Transform for Spark

You can run the Spark filter transform [local.py](dpk_filter/spark/local.py) to filter the `test1.parquet` file in [test input data](test-data/input) to an `output` directory. The directory will contain one or several filtered parquet files and the `metadata.json` file.
Expand Down

0 comments on commit 2ff7ec7

Please sign in to comment.