Diagram view of first stage pipeline (from sampling instrument to shared storage)

[metazool]

Addresses part, but not all of #9

• Adds some rudimentary graphviz diagrams that outline the workflow from instrument through the SAN to cloud storage - both the "as is" situation (with data gaps, manually run stages and personal credentials) and the "could be" (more of an outline with choice of options)
• Adds a Github Action for publishing a basic Jekyll static site which includes a step that renders SVG output for anything underneath the docs/diagrams/ directory (lifted from the pages action in the discoverability project)

Publishes to here: https://nerc-ceh.github.io/plankton_ml/

Created to help initiate a discussion in the Science Computing user group internal forum, discover how other research groups solve the same issues and what the configuration differences are across the various physical sites. The "could be" view remains sketchy until more information is available.

The intention is to add more to this - a second phase showing the catalogue-to-analysis view, and some detail views in areas that are skimmed over, like the pipeline task graph which should include a binary classifier that sifts for interesting data so we're not filling the cloud storage with obvious detritus) but in the interests of reviewing less material, more frequently, left this as a starting point.

I'll also go back and add the publishing / rendering action to the process diagram PR to make those easier to share

[github-actions]

☂️ Python Coverage

current status: ✅

Overall Coverage

Lines	Covered	Coverage	Threshold	Status
98	83	85%	0%	🟢

New Files

No new covered files...

Modified Files

No covered modified files...

updated for commit: 830a4fb by action🐍