diff --git a/README.md b/README.md index 93aa165..11abcc4 100644 --- a/README.md +++ b/README.md @@ -23,6 +23,22 @@ For latest release, see [https://github.com/calogica/dbt-expectations/releases]( This package includes a reference to [**dbt-date**](https://github.com/calogica/dbt-date) which in turn references [**dbt-utils**](https://github.com/fishtown-analytics/dbt-utils) so there's no need to also import dbt-utils in your local project. +Note: we no longer include `spark_utils` in this package to avoid versioning conflicts. If you are running this package on non-core (Snowflake, BigQuery, Redshift, Postgres) platforms, you will need to use a package like `spark_utils` to shim macros. + +For example, in `packages.yml`, you will need to include the relevant package: + +```yaml + - package: fishtown-analytics/spark_utils + version: +``` + +And reference in the dispatch list for `dbt_utils` in `dbt_project.yml`: + +```yaml +vars: + dbt_utils_dispatch_list: [spark_utils] +``` + ### Variables The following variables need to be defined in your `dbt_project.yml` file: diff --git a/integration_tests/dbt_project.yml b/integration_tests/dbt_project.yml index 0f94427..f18cd26 100644 --- a/integration_tests/dbt_project.yml +++ b/integration_tests/dbt_project.yml @@ -23,7 +23,7 @@ require-dbt-version: ">=0.18.1" vars: 'dbt_date:time_zone': 'America/Los_Angeles' - dbt_utils_dispatch_list: [spark_utils, dbt_expectations_integration_tests] + dbt_utils_dispatch_list: [dbt_expectations_integration_tests] quoting: database: false diff --git a/packages.yml b/packages.yml index 8e9435c..239c023 100644 --- a/packages.yml +++ b/packages.yml @@ -1,5 +1,3 @@ packages: - package: calogica/dbt_date version: [">=0.2.0", "<0.3.0"] - - package: fishtown-analytics/spark_utils - version: [">=0.1.0", "<0.2.0"]