diff --git a/notes-OS/containerization/Docker.md b/notes-OS/containerization/Docker.md index 0c6faa9..ae562ac 100644 --- a/notes-OS/containerization/Docker.md +++ b/notes-OS/containerization/Docker.md @@ -1,23 +1,24 @@ --- sitemap: - lastmod: 2024-04-25 +0000 + lastmod: 2024-08-07 +0000 priority: 1.0 --- # Docker Operations -Last modified: 2024-04-25 +0000 +Last modified: 2024-08-07 +0000 - [Installation](#installation) - [Interesting posts](#interesting-posts) - [Manage Docker as a non-root user (less secure)](#manage-docker-as-a-non-root-user-less-secure) - [Rootless mode (more secure)](#rootless-mode-more-secure) +- [`docker save` \& `docker export`](#docker-save--docker-export) +- [Run a local registry server (image server)](#run-a-local-registry-server-image-server) - [Configure automatically start behavior](#configure-automatically-start-behavior) - [Stop all containers](#stop-all-containers) +- [View container logs](#view-container-logs) - [Access containers' ports from the host](#access-containers-ports-from-the-host) - [Access host's ports in containers](#access-hosts-ports-in-containers) -- [`docker save` \& `docker export`](#docker-save--docker-export) -- [Run a local registry server (image server)](#run-a-local-registry-server-image-server) - [Container networking](#container-networking) - [Default (bridge) network](#default-bridge-network) - [Custom bridge network](#custom-bridge-network) @@ -31,6 +32,7 @@ Last modified: 2024-04-25 +0000 ## Installation - openSUSE: [[openSUSE/dev-env#Docker]] +- Ubuntu: [Install Docker Engine on Ubuntu \| Docker Docs](https://docs.docker.com/engine/install/ubuntu/) ## Interesting posts @@ -43,6 +45,7 @@ Last modified: 2024-04-25 +0000 - [Demystifying Containers – Part III: Container Images \| SUSE Communities](https://www.suse.com/c/demystifying-containers-part-iii-container-images/) - [Demystifying Containers – Part IV: Container Security \| SUSE Communities](https://www.suse.com/c/demystifying-containers-part-iv-container-security/) - [If Docker is not a light-weight Virtual Machine, how does it simulate a different OS? : r/docker](https://www.reddit.com/r/docker/comments/zwty5q/if_docker_is_not_a_lightweight_virtual_machine/) +- [Verify repository client with certificates \| Docker Docs](https://docs.docker.com/engine/security/certificates/) ## Manage Docker as a non-root user (less secure) @@ -66,6 +69,46 @@ Last modified: 2024-04-25 +0000 - [Run the Docker daemon as a non-root user (Rootless mode)](https://docs.docker.com/engine/security/rootless/) +## `docker save` & `docker export` + +From Phind: + +> `docker save` and `docker export` are two commands used in Docker for creating a static snapshot of a Docker image or container respectively. Here's a detailed explanation: +> +> 1. `docker save`: This command is used to create a snapshot of a Docker image. The snapshot is saved as a tar archive. The main use of `docker save` is to transport a Docker image from one machine to another without having to pull the image from a Docker registry. Here's an example: +> +> ```bash +> docker save -o my_image.tar my_image:my_tag +> ``` +> +> This command will save the Docker image named `my_image` with the tag `my_tag` to a tar file named `my_image.tar`. +> +> 2. `docker export`: This command is used to create a snapshot of a Docker container. The snapshot is saved as a tar archive. The main use of `docker export` is to create a portable version of a running or stopped container that can be imported into another Docker instance. Here's an example: +> +> ```bash +> docker export -o my_container.tar my_container_id +> ``` +> +> This command will save the Docker container with the ID `my_container_id` to a tar file named `my_container.tar`. +> +> The main difference between `docker save` and `docker export` is that `docker save` works on images while `docker export` works on containers. Another important difference is that `docker save` preserves the history of the image and its layers, while `docker export` flattens the changes into a single layer, losing the history. +> +> In summary, use `docker save` when you want to share Docker images and their history between machines, and use `docker export` when you want to share the state of a Docker container between machines. + +*References*: + +- [docker save \| Docker Docs](https://docs.docker.com/engine/reference/commandline/save/) +- [docker export \| Docker Docs](https://docs.docker.com/engine/reference/commandline/export/) + +## Run a local registry server (image server) + +Use `docker run -d -p 5000:5000 --restart=always --name registry registry:2`. + +*References*: + +- [Deploy a registry server \| Docker Docs](https://docs.docker.com/registry/deploying/#run-a-local-registry) (deprecated) +- [Deploy a registry server \| CNCF Distribution](https://distribution.github.io/distribution/about/deploying/) + ## Configure automatically start behavior {% raw %} @@ -103,6 +146,12 @@ Use `docker stop $(docker ps -a -q)`. - [Stop and remove all docker containers](https://stackoverflow.com/questions/45357771/stop-and-remove-all-docker-containers) +## View container logs + +*References*: + +- [View container logs \| Docker Docs](https://docs.docker.com/config/containers/logging/) + ## Access containers' ports from the host {% raw %} @@ -143,46 +192,6 @@ Check the `docker0` interface IP of the host via `ip addr show docker0`. - [How do I access the host port in a Docker container?](https://bright-softwares.com/blog/en/docker/how-do-i-access-the-host-port-in-a-docker-container#step-1-get-the-hosts-ip-address) -## `docker save` & `docker export` - -From Phind: - -> `docker save` and `docker export` are two commands used in Docker for creating a static snapshot of a Docker image or container respectively. Here's a detailed explanation: -> -> 1. `docker save`: This command is used to create a snapshot of a Docker image. The snapshot is saved as a tar archive. The main use of `docker save` is to transport a Docker image from one machine to another without having to pull the image from a Docker registry. Here's an example: -> -> ```bash -> docker save -o my_image.tar my_image:my_tag -> ``` -> -> This command will save the Docker image named `my_image` with the tag `my_tag` to a tar file named `my_image.tar`. -> -> 2. `docker export`: This command is used to create a snapshot of a Docker container. The snapshot is saved as a tar archive. The main use of `docker export` is to create a portable version of a running or stopped container that can be imported into another Docker instance. Here's an example: -> -> ```bash -> docker export -o my_container.tar my_container_id -> ``` -> -> This command will save the Docker container with the ID `my_container_id` to a tar file named `my_container.tar`. -> -> The main difference between `docker save` and `docker export` is that `docker save` works on images while `docker export` works on containers. Another important difference is that `docker save` preserves the history of the image and its layers, while `docker export` flattens the changes into a single layer, losing the history. -> -> In summary, use `docker save` when you want to share Docker images and their history between machines, and use `docker export` when you want to share the state of a Docker container between machines. - -*References*: - -- [docker save \| Docker Docs](https://docs.docker.com/engine/reference/commandline/save/) -- [docker export \| Docker Docs](https://docs.docker.com/engine/reference/commandline/export/) - -## Run a local registry server (image server) - -Use `docker run -d -p 5000:5000 --restart=always --name registry registry:2`. - -*References*: - -- [Deploy a registry server \| Docker Docs](https://docs.docker.com/registry/deploying/#run-a-local-registry) (deprecated) -- [Deploy a registry server \| CNCF Distribution](https://distribution.github.io/distribution/about/deploying/) - ## Container networking *References*: @@ -317,5 +326,5 @@ docker run --net=none --name=SOME_CONTAINER registry.suse.com/bci/bci-busybox ip - [Connect to remote Docker over SSH](https://code.visualstudio.com/docs/containers/ssh) [//begin]: # "Autogenerated link references for markdown compatibility" -[openSUSE/dev-env#Docker]: ../../notes-OS/Linux/openSUSE/dev-env.md "openSUSE Development Environment" +[openSUSE/dev-env#Docker]: ../Linux/openSUSE/dev-env.md "openSUSE Development Environment" [//end]: # "Autogenerated link references" diff --git a/notes-OS/containerization/Kubernetes.md b/notes-OS/containerization/Kubernetes.md index 6f31d51..96565cf 100644 --- a/notes-OS/containerization/Kubernetes.md +++ b/notes-OS/containerization/Kubernetes.md @@ -1,15 +1,18 @@ --- sitemap: - lastmod: 2024-06-19 +0000 + lastmod: 2024-07-19 +0000 --- # Kubernetes -Last modified: 2024-06-19 +0000 +Last modified: 2024-07-19 +0000 - [Interesting posts](#interesting-posts) +- [Versioning](#versioning) - [Installation](#installation) - [Management tool](#management-tool) +- [`kubectl`](#kubectl) +- [`kuztomize`](#kuztomize) - [Cluster status](#cluster-status) - [Storage](#storage) - [Node label](#node-label) @@ -20,18 +23,17 @@ Last modified: 2024-06-19 +0000 - [Get files inside pods](#get-files-inside-pods) - [Port forward](#port-forward) - [Helm](#helm) + - [Troubleshooting releases](#troubleshooting-releases) ## Interesting posts - [Borg: The Predecessor to Kubernetes \| Kubernetes](https://kubernetes.io/blog/2015/04/borg-predecessor-to-kubernetes/) +- [Introduction - Kubernetes CSI Developer Documentation](https://kubernetes-csi.github.io/docs/) - [Kubernetes Node Vs. Pod Vs. Cluster: Key Differencestext](https://www.cloudzero.com/blog/kubernetes-node-vs-pod/) -- [Head-first k8s](https://head-first-kubernetes.github.io/) +- [A 5,5 years retrospective of working with Bare Metal Kubernetes, or To there and back \| Geek Culture](https://medium.com/geekculture/a-retrospective-of-working-with-bare-metal-kubernetes-or-to-there-and-back-1868c0356eff) - [Demystifying Container Orchestration: A Beginner's Guide \| SUSE Communities](https://www.suse.com/c/rancher_blog/demystifying-container-orchestration-a-beginners-guide/) - [Why is learning Kubernetes so intimidating? : devops](https://www.reddit.com/r/devops/comments/o7w9yn/why_is_learning_kubernetes_so_intimidating/) - [Why Is Kubernetes So Hard - 4 Reasons Why And What to do About it — Release](https://release.com/blog/why-kubernetes-is-so-hard) -- [How Kubernetes And Kafka Will Get You Fired \| by Jan Kammerath - Freedium](https://freedium.cfd/https://medium.com/@jankammerath/how-kubernetes-and-kafka-will-get-you-fired-a6dccbd36c77) -- [Kafka on Kubernetes: What could go wrong?](https://redpanda.com/blog/kafka-kubernetes-deployment-pros-cons): - > Kubernetes connects the container runtime interface (CRI) with the container network interface (CNI) and the container storage interface (CSI), and then it provides the plumbing and glue to turn one or more containers into an application. - [Error installing from official repos onto Ubuntu · Issue #3219 · kubernetes/release](https://github.com/kubernetes/release/issues/3219) - [Demo Systems Infrastructure - Kubernetes \| GitLab](https://about.gitlab.com/handbook/customer-success/demo-systems/infrastructure/kubernetes/) - [Why disable swap on kubernetes - Server Fault](https://serverfault.com/questions/881517/why-disable-swap-on-kubernetes) @@ -40,13 +42,16 @@ Last modified: 2024-06-19 +0000 - [kubectl apply: Syntax, Examples, kubectl apply vs. create/replace](https://komodor.com/learn/kubectl-apply-syntax-examples-and-kubectl-apply-vs-create-vs-replace/) - [Assign Pods to Nodes \| Kubernetes](https://kubernetes.io/docs/tasks/configure-pod-container/assign-pods-nodes/) - [Resource Management for Pods and Containers \| Kubernetes](https://kubernetes.io/docs/concepts/configuration/manage-resources-containers/#meaning-of-cpu) - -Toolchains: - -- [Version Skew Policy \| Kubernetes](https://kubernetes.io/releases/version-skew-policy/) - -Tutorials: - +- Mind Maps: + - [DevOps in Kubernetes Mind Map](https://github.com/metaleapca/metaleap-devops-in-k8s/blob/main/metaleap-devops-in-k8s.pdf) + - [Kubernetes Tools Mind Map](https://github.com/metaleapca/metaleap-k8s-tools/blob/main/metaleap-k8s-tools.pdf) + - [K8s Troubleshooting Mind Map](https://github.com/metaleapca/metaleap-k8s-troubleshooting/blob/main/metaleap-k8s-troubleshooting.pdf) +- [Medium parser - K8s Troubleshooting — Insufficient Node Resources \| by Tony \| Geek Culture \| Medium](http://webcache.googleusercontent.com/search?q=cache:https://medium.com/geekculture/k8s-troubleshooting-insufficient-node-resources-d336968a45b0&strip=0&vwsrc=1&referer=medium-parser) +- [How to force delete a Kubernetes Namespace \| ComputingForGeeks](https://computingforgeeks.com/how-to-force-delete-a-kubernetes-namespace/) +- [Test an insecure registry \| CNCF Distribution](https://distribution.github.io/distribution/about/insecure/) +- [docker - ErrImagePull: x509: certificate signed by unknown authority - Stack Overflow](https://stackoverflow.com/questions/73136370/errimagepull-x509-certificate-signed-by-unknown-authority) +- [Red Hat OpenShift vs. OKD](https://www.redhat.com/en/topics/containers/red-hat-openshift-okd) +- [Head-first k8s](https://head-first-kubernetes.github.io/) - [kubernetes video Series' Articles - DEV Community](https://dev.to/techworld_with_nana/series/4349) - [Learn Kubernetes and Containers \| Rancher](https://www.rancher.com/learn-the-basics) - [Connecting Applications with Services \| Kubernetes](https://kubernetes.io/docs/tutorials/services/connect-applications-service/) @@ -59,6 +64,7 @@ Tutorials: API: - [Kubernetes Deprecation Policy \| Kubernetes](https://kubernetes.io/docs/reference/using-api/deprecation-policy/) +- [了解 Kubernetes 中的認證機制 \| 小信豬的原始部落](https://godleon.github.io/blog/Kubernetes/k8s-API-Authentication/) Networking: @@ -72,12 +78,22 @@ Storage: - [Using Secrets as files from a Pod - Secrets \| Kubernetes](https://kubernetes.io/docs/concepts/configuration/secret/#using-secrets-as-files-from-a-pod) - [Create a Pod that has access to the secret data through a Volume - Distribute Credentials Securely Using Secrets \| Kubernetes](https://kubernetes.io/docs/tasks/inject-data-application/distribute-credentials-secure/#create-a-pod-that-has-access-to-the-secret-data-through-a-volume) -Career Certificates: +Career Certifications: - [Frequently Asked Questions: CKA and CKAD & CKS \| T&C DOCS (Candidate Facing Resources)](https://docs.linuxfoundation.org/tc-docs/certification/faq-cka-ckad-cks) - [Introduction to Kubernetes (LFS158x) - Linux Foundation - Training](https://training.linuxfoundation.org/training/introduction-to-kubernetes/) - [I just passed the CKA!! Here are some tips (2022) : r/kubernetes](https://www.reddit.com/r/kubernetes/comments/rzpu5i/i_just_passed_the_cka_here_are_some_tips_2022/) - [CKA or CKAD which one is easier? : r/kubernetes](https://www.reddit.com/r/kubernetes/comments/re37bb/cka_or_ckad_which_one_is_easier/) +- [How I passed Kubernetes KCNA, CKAD, CKA, and CKS exams. My experience. Exam tips and tricks.](https://gist.github.com/bakavets/05681473ca617579156de033ba40ee7a) +- [Do I really need a CKA certification?: Naeem Gitonga](https://naeemgitonga.com/articles/do-i-need-a-cka) + +## Versioning + +*References*: + +- [kubernetes/CHANGELOG/CHANGELOG-1.28.md at master · kubernetes/kubernetes](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG/CHANGELOG-1.28.md) +- [Releases \| Kubernetes](https://kubernetes.io/releases/) +- [Version Skew Policy \| Kubernetes](https://kubernetes.io/releases/version-skew-policy/) ## Installation @@ -150,6 +166,27 @@ curl "${CURL_COMMON_OPTIONS[@]}" https://get.helm.sh/helm-v$HELM_VERSION-linux-a - [Kubernetes technologies: Kubeadm vs MiniKube, Kind and K3S](https://www.padok.fr/en/blog/minikube-kubeadm-kind-k3s) +## `kubectl` + +*References*: + +- [Command line tool (kubectl) \| Kubernetes](https://kubernetes.io/docs/reference/kubectl/) +- [kubectl Usage Conventions \| Kubernetes](https://kubernetes.io/docs/reference/kubectl/conventions/) +- [Kubectl Reference Docs](https://kubernetes.io/docs/reference/generated/kubectl/kubectl-commands) + +## `kuztomize` + +*References*: + +- Official site: [Kustomize - Kubernetes native configuration management](https://kustomize.io/) +- Official guide: [Kustomize \| SIG CLI](https://kubectl.docs.kubernetes.io/guides/introduction/kustomize/) +- Official reference: [Kustomize \| SIG CLI](https://kubectl.docs.kubernetes.io/references/kustomize/) +- [kubectl kustomize \| Kubernetes](https://kubernetes.io/docs/reference/kubectl/generated/kubectl_kustomize/) +- [Declarative Management of Kubernetes Objects Using Kustomize \| Kubernetes](https://kubernetes.io/docs/tasks/manage-kubernetes-objects/kustomization/) +- [Managing Secrets using Kustomize \| Kubernetes](https://kubernetes.io/docs/tasks/configmap-secret/managing-secret-using-kustomize/) +- [Configure Kubernetes with Kustomize  \|  Config Sync  \|  Google Cloud](https://cloud.google.com/kubernetes-engine/enterprise/config-sync/docs/concepts/kustomize) +- [A Quick Introduction to Kustomize \| by Neron Joseph \| Medium](https://neron-joseph.medium.com/a-quick-introduction-to-kustomize-172a6512beaf) + ## Cluster status *References*: @@ -244,10 +281,16 @@ kubectl cp SOME_NAMESPACE/SOME_POD:/tmp/bar /tmp/foo *References*: -- [Helm \| Getting Started](https://helm.sh/docs/chart_template_guide/getting_started/) +- [Helm \| Built-in Objects](https://helm.sh/docs/chart_template_guide/builtin_objects/) - [Helm \| Helm Dependency](https://helm.sh/docs/helm/helm_dependency/) - All about “Helm”- The Package Manager for Kubernetes: - [All about Helm- The Package Manager for Kubernetes Part 1 - BuildPiper](https://www.buildpiper.io/blogs/all-about-helm-the-package-manager-for-kubernetes-part-1/) - [All about Helm- The Package Manager for Kubernetes Part 2 - BuildPiper](https://www.buildpiper.io/blogs/all-about-helm-the-package-manager-for-kubernetes-part-2/) - [kubernetes - UPGRADE FAILED: another operation (install/upgrade/rollback) is in progress - Stack Overflow](https://stackoverflow.com/questions/71599858/upgrade-failed-another-operation-install-upgrade-rollback-is-in-progress) - [Helm 'delete' doesn't delete PVCs · Issue #5156 · helm/helm](https://github.com/helm/helm/issues/5156) +- [Helm delete all releases - Stack Overflow](https://stackoverflow.com/questions/47817818/helm-delete-all-releases) + +### Troubleshooting releases + +- `helm get manifest RELEASE` +- `helm install --debug --dry-run RELEASE ./CHART` diff --git a/notes-OS/containerization/attachments/metaleap-devops-in-k8s.pdf b/notes-OS/containerization/attachments/metaleap-devops-in-k8s.pdf new file mode 100644 index 0000000..87bdd02 Binary files /dev/null and b/notes-OS/containerization/attachments/metaleap-devops-in-k8s.pdf differ diff --git a/notes-OS/containerization/attachments/metaleap-k8s-tools.pdf b/notes-OS/containerization/attachments/metaleap-k8s-tools.pdf new file mode 100644 index 0000000..5e0590c Binary files /dev/null and b/notes-OS/containerization/attachments/metaleap-k8s-tools.pdf differ diff --git a/notes-OS/containerization/attachments/metaleap-k8s-troubleshooting.pdf b/notes-OS/containerization/attachments/metaleap-k8s-troubleshooting.pdf new file mode 100644 index 0000000..a693fe5 Binary files /dev/null and b/notes-OS/containerization/attachments/metaleap-k8s-troubleshooting.pdf differ diff --git a/notes-OS/containerization/container-image.md b/notes-OS/containerization/container-image.md index 2891127..0b868f5 100644 --- a/notes-OS/containerization/container-image.md +++ b/notes-OS/containerization/container-image.md @@ -1,11 +1,11 @@ --- sitemap: - lastmod: 2024-06-18 +0000 + lastmod: 2024-07-09 +0000 --- # Container Image -Last modified: 2024-06-18 +0000 +Last modified: 2024-07-09 +0000 **NOTE**: This note assumes that images are built using Docker by default. @@ -14,7 +14,6 @@ Last modified: 2024-06-18 +0000 - [`CMD` \& `ENTRYPOINT`](#cmd--entrypoint) - [GitHub Container Registry](#github-container-registry) - [CentOS image](#centos-image) - - [Interesting posts](#interesting-posts-1) - [WARP issue](#warp-issue) ## Interesting posts @@ -54,10 +53,19 @@ From Phind: ## CentOS image -### Interesting posts +- Update the mirror address by adding the following to `Dockerfile`: + + ```dockerfile + RUN cd /etc/yum.repos.d/ + RUN sed -i 's/mirrorlist/#mirrorlist/g' /etc/yum.repos.d/CentOS-* + RUN sed -i 's|#baseurl=http://mirror.centos.org|baseurl=http://vault.centos.org|g' /etc/yum.repos.d/CentOS-* + ``` + +*References*: - [Error: Failed to download metadata for repo 'appstream': Cannot prepare internal mirrorlist: No URLs in mirrorlist](https://stackoverflow.com/questions/70963985/error-failed-to-download-metadata-for-repo-appstream-cannot-prepare-internal) - [yum安装时提示：This system is not registered with an entitlement server. You can use subscription-manager to register. - Ajunyu - 博客园](https://www.cnblogs.com/ajunyu/p/13297449.html) +- [Plesk or system updates fail on CentOS 7: Could not resolve host: mirrorlist.centos.org – Plesk](https://support.plesk.com/hc/en-us/articles/24575503258647-Plesk-or-system-updates-fail-on-CentOS-7-Could-not-resolve-host-mirrorlist-centos-org) ## WARP issue diff --git a/notes-OS/containerization/index.md b/notes-OS/containerization/index.md index 734da4c..a023c63 100644 --- a/notes-OS/containerization/index.md +++ b/notes-OS/containerization/index.md @@ -1,7 +1,7 @@ --- type: index sitemap: - lastmod: 2024-06-14 +0000 + lastmod: 2024-07-04 +0000 priority: 0.5 --- @@ -16,6 +16,7 @@ sitemap: ## Interesting posts - [Introduction to Containerization: Docker and Kubernetes Explained \| by Sakshi Infoway \| Medium](https://medium.com/@sakshiinfoway/introduction-to-containerization-docker-and-kubernetes-explained-a3f7c4b4c606) +- [Containers explained: What they are and why you should care](https://www.redhat.com/en/topics/containers) [//begin]: # "Autogenerated link references for markdown compatibility" [container-image]: container-image.md "Container Image"