- Fix regression in 1.4.0 when adding to existing PYSPARK_SUBMIT_ARGS. New args are now added to the front.
- Avoid setting empty PYSPARK_SUBMIT_ARGS
- Add /usr/local/spark, /opt/spark to common search path
- Fix add_packages, add_jar when PYSPARK_SUBMIT_ARGS is undefined or or both are called
- Add /usr/lib/spark to common search path (Amazon EMR)
- Add
findspark.add_jars
- Preserve PYSPARK_PYTHON env, if specified
- Add
findspark.add_packages
First release