Spring Cloud Data Flow 2.10.0-RC2

Notable changes

Spring updates

Updates to the following versions:

• Spring Boot 2.7.5
• Spring Framework 5.3.23
• Spring Cloud 2021.0.5

NOTE: The 2.10.0-RC1 release was a partial release of the Spring Cloud Deployer artifacts only.

Dependent Projects and Compatibility

Component	Version
Spring Cloud Dataflow Build	2.10.0-RC2
Spring Cloud Dataflow Common	2.10.0-RC2
Spring Cloud Deployer	2.8.0-RC2
Spring Cloud Deployer Local	2.8.0-RC2
Spring Cloud Deployer CF	2.8.0-RC2
Spring Cloud Deployer K8S	2.8.0-RC2
Spring Cloud Common Security Config	1.8.0-RC2
Spring Cloud Skipper	2.9.0-RC2
Spring Cloud Dataflow UI	3.3.0-RC2
Spring Cloud Dataflow	2.10.0-RC2

Issues

spring-cloud/spring-cloud-deployer-kubernetes#511 Fabric8 version misalignment
#5125 Update Spring Boot 2.7.5 and Spring Cloud 2021.0.5
#5122 Adding index to TASK_EXECUTION_PARAMS table
#5111 Colon (port) in docker registry URI brokes detection of WWW-Authorization URL in DockerConfigJsonSecretToRegistryConfigurationConverter
#5077 Support for launching Boot 3.0 apps
#5043 The Rest API does not allow you to specify deployment variables
#4753 Set proper boot actuator endpoint configuration when deploying apps.
#4617 Error handling enhancement: StringIndexOutOfBoundsException when executing task in k8s for malformed task arguments

Spring Cloud Data Flow 2.10.0-M2

Notable changes

Spring updates

Updates to the following versions:

• Spring Boot 2.7.3
• Spring Framework 5.3.22
• Spring Cloud 2021.0.3

Spring Shell

Spring Shell has been updated to 2.1.0-M5.

Add back mysql Support

In M1 we removed support for mysql. This milestone restores support for MySQL 5.7+ using the MariaDB JDBC driver. See the reference docs for more details.

Dependent Projects and Compatibility

Component	Version
Spring Cloud Dataflow Build	2.10.0-M2
Spring Cloud Dataflow Common	2.10.0-M2
Spring Cloud Deployer	2.8.0-M2
Spring Cloud Deployer Local	2.8.0-M2
Spring Cloud Deployer CF	2.8.0-M2
Spring Cloud Deployer K8S	2.8.0-M2
Spring Cloud Common Security Config	1.8.0-M2
Spring Cloud Skipper	2.9.0-M2
Spring Cloud Dataflow UI	3.3.0-M2
Spring Cloud Dataflow	2.10.0-M2

Issues

spring-cloud/spring-cloud-dataflow-build#78 Update spring-shell 2.1.0-M5
spring-cloud/spring-cloud-dataflow-build#77 Manage db2 jdbc driver
spring-cloud/spring-cloud-dataflow-build#75 Update Boot 2.7.0
spring-cloud/spring-cloud-dataflow-build#73 Update boot 2.7.0-RC1
spring-cloud/spring-cloud-dataflow-build#68 Update Boot 2.6.6
spring-cloud/spring-cloud-dataflow-common#20 Add custom MySQL database type
spring-cloud/spring-cloud-dataflow-common#18 Spring Boot 2.7.0-RC1 / Flyway 8.5.9 broke MariaDB/MySQL on SCDF
spring-cloud/spring-cloud-deployer#356 Manage commons-io dependency
spring-cloud/spring-cloud-deployer#355 Update maven-wagon 3.5.2
spring-cloud/spring-cloud-deployer-kubernetes#491 NPE in instance status
spring-cloud/spring-cloud-common-security-config#93 Remove deprecated spring-security-oauth2
spring-cloud/spring-cloud-skipper#1057 Use SafeConstructor with SnakeYaml (PORT from 2.8.x)
spring-cloud/spring-cloud-skipper#1049 Package db2 jdbc driver
spring-cloud/spring-cloud-skipper#1047 Update boot 2.7.0-RC1
spring-cloud/spring-cloud-skipper#1044 Update pack 0.24.1
spring-cloud/spring-cloud-skipper#1042 Remove deprecated spring-security-oauth2.
spring-cloud/spring-cloud-skipper#1036 Skipper fails with oauth config
spring-cloud/spring-cloud-skipper#1034 Tests fail under Windows
spring-cloud/spring-cloud-dataflow-ui#1838 Enable e2e tests on CI pipeline
spring-cloud/spring-cloud-dataflow-ui#1826 Add status on task execution
spring-cloud/spring-cloud-dataflow-ui#1815 Not showing JOB details (batch Jobs, Job execution id) in Latest task execution
spring-cloud/spring-cloud-dataflow-ui#1798 Color status on import streams/tasks
spring-cloud/spring-cloud-dataflow-ui#1730 Can't remove a task app property
#5080 Ensure ATs are covering the proper databases/drivers
#5079 Update ref docs on supported DB and drivers
#5062 CVE-2022-31197 in pgjdbc transitive dependency (requires manual dependency override)
#5060 cannot set container name as task name when task launch/execution
#5057 Remove db2 and oracle drivers
#5056 Update to Boot 2.7.3
#5054 Upgrade mariadb driver to the 3.0.x series
#5052 Update Spring Boot 2.7.3 + Spring Cloud 2021.0.3
#5050 Use SafeConstructor with SnakeYaml (PORT from 2.9.x)
#5026 Increase Security with CSP Settings
#4926 Package db2 jdbc driver
#4918 Update Boot 2.7.0
#4915 Please don't update ubuntu packages within the docker-compose
#4914 Move DataFlowIT to spring-cloud-dataflow-acceptance-tests.
#4909 Shell fails with app info
#4908 Security issues in transitive dependency of jackson-databind-2.11.4 (SPRING-CLOUD-DATAFLOW 2.9.4)
#4907 security issues in transitive dependency of posgresql 42.2.25 (SPRING-CLOUD-DATAFLOW 2.9.4)
#4904 Update boot 2.7.0-RC1
#4888 Update pack 0.24.1
#4887 Add support for MySQL 8 in OSS
#4879 Add Back support for mysql 5.7
#4875 Remove deprecated spring-security-oauth2
#4869 Reference guide on launching a task from a stream is out of date.
#4863 Update reference guides to include new team members
#4861 NullPointer throw when authenticate via Bearer Token to active endpoint i.e. register application
#4854 Proposal for documenting client-server compatibility on documentation
#4795 Update spring-shell 2.1.x
#4744 Experiment with App SSO (for K8s) + Spring Authorization Server
#4682 Allow RestTemplate configure with DataFlowClientAutoConfiguration
#4603 Retest Azure AD configuration

Spring Cloud Data Flow 2.9.6

Notable Changes

This release updates to Postgres SQL driver 42.2.26 to address CVE-2022-31197 .

Dependent Projects and Compatibility

Component	Version
Spring Cloud Dataflow Build	2.9.6
Spring Cloud Dataflow Common	2.9.6
Spring Cloud Deployer	2.7.6
Spring Cloud Deployer Local	2.7.6
Spring Cloud Deployer CF	2.7.6
Spring Cloud Deployer K8S	2.7.6
Spring Cloud Common Security Config	1.7.6
Spring Cloud Skipper	2.8.6
Spring Cloud Dataflow UI	3.2.6
Spring Cloud Dataflow	2.9.6

Issues

#5072 Cannot launch composed tasks
#5063 Consider backport CVE-2022-31197 for postgres jdbc driver

Spring Cloud Data Flow 2.9.5

Dependent Projects and Compatibility

Component	Version
Spring Cloud Dataflow Build	2.9.5
Spring Cloud Dataflow Common	2.9.5
Spring Cloud Deployer	2.7.5
Spring Cloud Deployer Local	2.7.5
Spring Cloud Deployer CF	2.7.5
Spring Cloud Deployer K8S	2.7.5
Spring Cloud Common Security Config	1.7.5
Spring Cloud Skipper	2.8.5
Spring Cloud Dataflow UI	3.2.5
Spring Cloud Dataflow	2.9.5

Issues

spring-cloud/spring-cloud-dataflow-build#79 Update Boot 2.5.14
spring-cloud/spring-cloud-skipper#1055 Use SafeConstructor with SnakeYaml
spring-cloud/spring-cloud-skipper#1045 backport(1044): Update pack 0.24.1
spring-cloud/spring-cloud-dataflow-ui#1871 Backport the changes for removing bootstrap loading from logout page.
spring-cloud/spring-cloud-dataflow-ui#1866 Issue styling on Add application(s)
#5048 Use SafeConstructor with SnakeYaml
#4964 Sanitize the history and exposed configuration
#4947 Hide sensitive data from audit dashboard after updating a stream
#4945 Step execution history is not showing the correct values
#4912 failed to create stream with multiple input and output bindings on scdf for vmware tanzu 1.12.2
#4889 backport(4888): Update pack 0.24.1

Spring Cloud Data Flow 2.9.4

Notable Changes

This release updates to Spring Boot 2.5.12 which in turn resolves CVE-2022-22965.

Dependent Projects and Compatibility

Component	Version
Spring Cloud Dataflow Build	2.9.4
Spring Cloud Dataflow Common	2.9.4
Spring Cloud Deployer	2.7.4
Spring Cloud Deployer Local	2.7.4
Spring Cloud Deployer CF	2.7.4
Spring Cloud Deployer K8S	2.7.4
Spring Cloud Common Security Config	1.7.4
Spring Cloud Skipper	2.8.4
Spring Cloud Dataflow UI	3.2.4
Spring Cloud Dataflow	2.9.4

Issues

spring-cloud/spring-cloud-dataflow-build#66 Update Boot 2.5.12

Spring Cloud Data Flow 2.9.3

Notable Changes

This release updates to Spring Boot 2.5.10 and also resolves CVE-2021-29425.

Dependent Projects and Compatibility

Component	Version
Spring Cloud Dataflow Build	2.9.3
Spring Cloud Dataflow Common	2.9.3
Spring Cloud Deployer	2.7.3
Spring Cloud Deployer Local	2.7.3
Spring Cloud Deployer CF	2.7.3
Spring Cloud Deployer K8S	2.7.3
Spring Cloud Common Security Config	1.7.3
Spring Cloud Skipper	2.8.3
Spring Cloud Dataflow UI	3.2.3
Spring Cloud Dataflow	2.9.3

Issues

spring-cloud/spring-cloud-dataflow-build#63 Update Boot 2.5.10
spring-cloud/spring-cloud-deployer#358 backport(356): Manage commons-io dependency

Spring Cloud Data Flow 2.10.0-M1

Generic Notes

Notable Changes

Carvel Support

We're now creating a Carvel package for easy installation into k8s. Documentation is not yet integrated but sources can be found from a repo Docs.

Drop mysql Support

Starting from 2.10 we're dropping support for mysql database in favour of MariaDB.

• We use flyway for schema management and support for older mysql versions(5.x) has been dropped.
• We unable to use mysql 8.x as we can only bundle MariaDB driver which is not recommended with newer mysql versions.
• Spring Boot 2.6.x is treating mysql and MariaDB as a same database id.

We're hoping to get feedback on this issue and possibly try to support mysql again with future versions with Spring Boot 2.7.x which fully separates these two as a separate databases.

Dependent Projects and Compatibility

Component	Version
Spring Cloud Dataflow Build	2.10.0-M1
Spring Cloud Dataflow Common	2.10.0-M1
Spring Cloud Deployer	2.8.0-M1
Spring Cloud Deployer Local	2.8.0-M1
Spring Cloud Deployer CF	2.8.0-M1
Spring Cloud Deployer K8S	2.8.0-M1
Spring Cloud Common Security Config	1.8.0-M1
Spring Cloud Skipper	2.9.0-M1
Spring Cloud Dataflow UI	3.3.0-M1
Spring Cloud Dataflow	2.10.0-M1

Issues

spring-cloud/spring-cloud-dataflow-build#64 Manage spring-shell
spring-cloud/spring-cloud-dataflow-build#62 Update boot 2.6.3
spring-cloud/spring-cloud-dataflow-build#60 Update boot 2.6.2
spring-cloud/spring-cloud-dataflow-build#55 Update boot 2.6.1
spring-cloud/spring-cloud-dataflow-build#54 Update cloud 2021.0.0
spring-cloud/spring-cloud-dataflow-build#52 Update boot 2.6.0
spring-cloud/spring-cloud-dataflow-build#51 Update boot 2.6.0-RC1
spring-cloud/spring-cloud-dataflow-build#50 Update cloud 2021.0.0-RC1
spring-cloud/spring-cloud-deployer-cloudfoundry#381 GUID attribute of deployed application is incorrect
spring-cloud/spring-cloud-deployer-kubernetes#463 Error getting task logs for multiple containers
spring-cloud/spring-cloud-common-security-config#88 JWT bearer always set user from subject
spring-cloud/spring-cloud-common-security-config#86 OAuth group claim mapping
spring-cloud/spring-cloud-skipper#1022 Add scale api to security config
spring-cloud/spring-cloud-skipper#1021 Update spring-shell 2.1.x
spring-cloud/spring-cloud-skipper#1020 Shell breaks with circular dependency
spring-cloud/spring-cloud-skipper#1018 Add proper mariadb support
spring-cloud/spring-cloud-dataflow-ui#1821 Update scale instance limit
spring-cloud/spring-cloud-dataflow-ui#1820 Revisit e2e stack
spring-cloud/spring-cloud-dataflow-ui#1818 Scale a deployed stream
spring-cloud/spring-cloud-dataflow-ui#1817 Missing translations
spring-cloud/spring-cloud-dataflow-ui#1814 Button "View log" not available when task not finished
spring-cloud/spring-cloud-dataflow-ui#1788 Logos missing in about dialog
spring-cloud/spring-cloud-dataflow-ui#1784 Update to Angular 13
spring-cloud/spring-cloud-dataflow-ui#1780 Fix eslint with prettier
spring-cloud/spring-cloud-dataflow-ui#1778 Make maven build to use package lock
spring-cloud/spring-cloud-dataflow-ui#1777 Fix npm lint
spring-cloud/spring-cloud-dataflow-ui#1764 Update dependencies
spring-cloud/spring-cloud-dataflow-ui#747 Setting server context-path breaks dashboard
#4785 Failures in DefaultTaskExecutionServiceTests
#4783 Shell breaks with circular dependency
#4782 Task arguments not parsing correctly
#4776 Secret for dockerhub not working with metadata
#4775 Remove default maven repository
#4774 Change mounts to non root
#4771 Add carvel package releasedAt field
#4769 Carvel monitoring features fail with airgapped repo
#4766 Support adding container env variables for servers
#4765 Add validation for carvel db and binder
#4761 Add proper mariadb support
#4759 Drop support for mysql
#4757 Upgrade to Boot 2.6.x / Spring Cloud 2021.0.0
#4755 Make carvel package and repo templating more generic
#4752 Let ConfigMap changes restart servers
#4751 Document oauth group claim changes
#4749 Make resources configurable for dataflow/skipper servers
#4743 Support switching server context path in package
#4737 Update Rolebinding v1
#4736 Add Delete Task Execution Acceptance Tests
#4735 Add Task Version Acceptance Tests
#4733 Add logo to carvel packages
#4732 Add image pull secrets to platform configs
#4731 Make carvel secretgen controller work on default
#4730 Initial carvel docs
#4687 Show only relevant logs for each task execution
#4629 Generate carvel package repo
#4628 Generate carvel package bundle
#4619 Service account is not getting set
#4527 Initial ytt templating for k8s files
#4437 dataflow task metrics "task_external_execution_id" label doesn't have value
#2874 Need to add feature for ignore-exit-message

Spring Cloud Data Flow 2.9.2

This release updates to boot 2.5.8 and cloud 2020.0.5. While there's been no log4j issues in dataflow as it uses logback, dependency updates will help with cve scanning tools.

Dependent Projects and Compatibility

Component	Version
Spring Cloud Dataflow Build	2.9.2
Spring Cloud Dataflow Common	2.9.2
Spring Cloud Deployer	2.7.2
Spring Cloud Deployer Local	2.7.2
Spring Cloud Deployer CF	2.7.2
Spring Cloud Deployer K8S	2.7.2
Spring Cloud Common Security Config	1.7.2
Spring Cloud Skipper	2.8.2
Spring Cloud Dataflow UI	3.2.2
Spring Cloud Dataflow	2.9.2

Issues

spring-cloud/spring-cloud-dataflow-build#61 Update cloud 2020.0.5
spring-cloud/spring-cloud-dataflow-build#59 Update boot 2.5.8
spring-cloud/spring-cloud-dataflow-build#58 Update cloud 2020.0.4
spring-cloud/spring-cloud-dataflow-build#53 Update boot 2.5.7
spring-cloud/spring-cloud-deployer-kubernetes#470 backport(463): Error getting task logs for multiple containers
spring-cloud/spring-cloud-skipper#1023 backport(1022): Add scale api to security config
#4798 RL Notes Header
#4789 backport(4785): Failures in DefaultTaskExecutionServiceTests

Spring Cloud Data Flow 2.9.1

Dependent Projects and Compatibility

Component	Version
Spring Cloud Dataflow Build	2.9.1
Spring Cloud Dataflow Common	2.9.1
Spring Cloud Deployer	2.7.1
Spring Cloud Deployer Local	2.7.1
Spring Cloud Deployer CF	2.7.1
Spring Cloud Deployer K8S	2.7.1
Spring Cloud Common Security Config	1.7.1
Spring Cloud Skipper	2.8.1
Spring Cloud Dataflow UI	3.2.1
Spring Cloud Dataflow	2.9.1

Issues

#4722 Support chunking of large task execution deletes

Spring Cloud Data Flow 2.8.4

Dependent Projects and Compatibility

Component	Version
Spring Cloud Dataflow Build	2.8.4
Spring Cloud Dataflow Common	2.8.4
Spring Cloud Deployer	2.6.4
Spring Cloud Deployer Local	2.6.4
Spring Cloud Deployer CF	2.6.4
Spring Cloud Deployer K8S	2.6.4
Spring Cloud Common Security Config	1.6.4
Spring Cloud Skipper	2.7.4
Spring Cloud Dataflow UI	3.1.4
Spring Cloud Dataflow	2.8.4

Issues

#4726 backport(4722): Support chunking of large task execution deletes