Skip to content

Commit

Permalink
Do not recommend Lake Loader on AWS as a solution for Databricks (#936)
Browse files Browse the repository at this point in the history
  • Loading branch information
istreeter authored Jun 20, 2024
1 parent 45799f4 commit ff18e15
Show file tree
Hide file tree
Showing 2 changed files with 13 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,17 @@ import LakeLoaderDiagram from '@site/docs/pipeline-components-and-applications/l
<>
{props.warehouse === 'Synapse Analytics' ?
(<LakeLoaderDiagram {...props} stream="Kafka" bucket="ADLS" cloud="Azure"/>)
: props.warehouse === 'Databricks' ?
(
<Tabs groupId="cloud" queryString lazy>
<TabItem value="gcp" label="GCP">
<LakeLoaderDiagram {...props} stream="Pub/Sub" bucket="GCS" cloud="GCP"/>
</TabItem>
<TabItem value="azure" label="Azure">
<LakeLoaderDiagram {...props} stream="Kafka" bucket="ADLS" cloud="Azure"/>
</TabItem>
</Tabs>
)
: (
<Tabs groupId="cloud" queryString lazy>
<TabItem value="aws" label="AWS">
Expand Down
4 changes: 2 additions & 2 deletions docs/storing-querying/storage-options/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -63,9 +63,9 @@ All lake loaders are micro-batching.

| Lake | Format | Compatibility | Loader application | Status |
| --- | --- | --- | --- | --- |
| S3 | Delta | Athena, Databricks | [Lake Loader](/docs/pipeline-components-and-applications/loaders-storage-targets/lake-loader/index.md) | Early release |
| S3 | Delta | Athena | [Lake Loader](/docs/pipeline-components-and-applications/loaders-storage-targets/lake-loader/index.md) | Early release |
| S3 | Iceberg | Athena, Redshift | [Lake Loader](/docs/pipeline-components-and-applications/loaders-storage-targets/lake-loader/index.md) | Early release |
| S3 | TSV/JSON | Amazon Athena | [S3 Loader](/docs/pipeline-components-and-applications/loaders-storage-targets/s3-loader/index.md) | Only recommended for use with [RDB Batch Transformer](/docs/pipeline-components-and-applications/loaders-storage-targets/snowplow-rdb-loader/transforming-enriched-data/spark-transformer/index.md) or for [failed events](/docs/understanding-your-pipeline/failed-events/index.md) |
| S3 | TSV/JSON | Athena | [S3 Loader](/docs/pipeline-components-and-applications/loaders-storage-targets/s3-loader/index.md) | Only recommended for use with [RDB Batch Transformer](/docs/pipeline-components-and-applications/loaders-storage-targets/snowplow-rdb-loader/transforming-enriched-data/spark-transformer/index.md) or for [failed events](/docs/understanding-your-pipeline/failed-events/index.md) |

</TabItem>
<TabItem value="gcp" label="GCP">
Expand Down

0 comments on commit ff18e15

Please sign in to comment.