Jenkins-ci upgrade

[jburel]

PHASE I (Jan 2022)
Current build is failing due to old version of Jenkins docker image. Main goal of this work is to have an updated working environment to test scl python 3.8 on CentOS 7

Several repositories need to be updated/adjusted in order to get things to work. Below is the list of repositories with changes:

Infra/Build

• Update devspace to work with jenkins lts and bump versions see Jenkins #190
• Update devslave-c7-docker see Update devagent-docker#21 merged
• Fix issue in omero-install Check for omero-server user omero-install#261

DNS assumptions

• python-superbuild See
  • handle variable omero-py#316
  • Jenkins omero-python-superbuild#135
• omero-build See Use the copy openmicroscopy#6301

Jobs

• OMERO-gradle-plugins-build submodule init submodule omero-gradle-plugins#28
• OMERO-Build: Fix build Build openmicroscopy#6302

Three jobs were green in merge-ci and failed on a fresh installation, giving us possible false positives.

• BIOFORMATS-image: PR skipping test for now Update base image bio-formats-build#241. Failing tests due to upgrade in Java 8 docker base image. Re-added flag preventing the failures
• BIOFORMATS-linkcheck (no work done)
• OMERO-training: See PR delete the roi openmicroscopy#6303 merged

Others
Other changes in BioFormats related repositories will also be required.

• The usage of older plugin prevents us from using the new way to push to nexus when using mvn deploy.
• ZarrReader prevents the usage of the more suitable flag altSnapshotDeploymentRepository.

PHASE II (Jan 2023)

Upgrade of Jenkins. Upgrade to 2.375.

• Upgrade to Java 11 (impact)
• Upgrade to Gradle 6 (impact)
• Upgrade to nodejs 1 (no impact)
• Postgresql 13

Infrastructure

• Java 11 + Gradle 6: Jenkins LTS Java 11 #199
• Node 16: use node 16 #200
• nginx 1.23: bump nginx version to 1.23 #202
• Postgresql 13: Pg 13 #201

Java 11 related issues:
The following PRs fails the build due to a Javadoc related flag.

• remove deprecated html flag removed in newer version of Java omero-artifact-plugin#21 included in https://github.com/ome/omero-artifact-plugin/releases/tag/v5.6.0
• bump org.openmicroscopy.project 5.6.0 omero-model#90
• bump org.openmicroscopy.project 5.6.0 omero-common#39
• bump org.openmicroscopy.project 5.6.0 omero-renderer#23
• bump org.openmicroscopy.project 5.6.0 omero-romio#41
• bump org.openmicroscopy.project 5.6.0 omero-blitz#131
• bump org.openmicroscopy.project 5.6.0 omero-server#151
• bump org.openmicroscopy.project 5.6.0 omero-gateway-java#69

Gradle related issues:

• set classifier omero-common#40

[jburel]

Python test failures with Scl Python 3.8 ome/openmicroscopy#6340

[jburel]

Second upgrade of Jenkins. Upgrade to 2.375. This version of Jenkins uses Java 11

Java 11 related issue:

• remove deprecated html flag removed in newer version of Java omero-artifact-plugin#21 included in https://github.com/ome/omero-artifact-plugin/releases/tag/v5.6.0

[sbesson]

Bio-Formats repository

The following minimal changes were made in order to run the repository tests in the staging devspace:

• the environment variables

  devspace/.env

  Lines 22 to 24 in a732e08

  	# Variables for changing what Bio-Formats tests
  	REPO_CURATED=/tmp/curated
  	REPO_CONFIG=/tmp/config

  were set to production values, respectively /uod/idr/repos/curated and /uod/idr-scratch/devspace-jm/config
• the DATA_REPO_CONFIG-merge job was copied from https://merge-ci.openmicroscopy.org/jenkins/ to create a copy of the private configuration folder under REPO_CONFIG which can be re-used from the job and executed
• the volumes of the testintegration service in docker-compose.yml were reviewed to include /uod/idr-scratch:/uod/idr-scratch (and /uod/idr:/uod/idr:ro) and the services restarted

With this set of changes, a full execution of BIOFORMATS-test-repo is close to completion and matches the results of https://merge-ci.openmicroscopy.org/jenkins/.

The steps above expose a few elements which are currently absent from this repository:

• the configuration of the jobs working against private repositories. While this is not a requirement for building Bio-Formats/OMERO components, it is critical for executing the repository tests against the curated QA repository
• the convergence towards separating the application, under /scratch/<devspace_name> from the persistent/shared data under /uod/idr-scratch/<devspace_name>. This was initially explored in the context of merge-ci and the binary repository of the CI OMERO server currently lives there. The steps above would also proposal to migrate the shared configuration repository and there were some attempts to migrate nexus-data there, unsuccessful so far. At the administration level, this has the advantage of separating components which are growing at different rates and making the application way less sensible to out of disk errors. Doing so requires additional configuration steps, including symlinks as well as volume mounting as appropriate

More generally, the two points above raise the question of whether this repository should remain generic and act as a re-usable template or whether we should move towards capturing the state of the production deployment on the OME hardware.

[jburel]

mv ~/.ssh/known_hosts ~/.ssh/known_hosts.bak
ssh -T [email protected]

[sbesson]

A more programmatic option might be to set up the public SSH key fingerprints documented in https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/githubs-ssh-key-fingerprints.