Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Downloading external resources degrades performance #4374

Open
pemsith opened this issue Jan 5, 2025 · 0 comments
Open

Downloading external resources degrades performance #4374

pemsith opened this issue Jan 5, 2025 · 0 comments

Comments

@pemsith
Copy link

pemsith commented Jan 5, 2025

Description
Tasks that directly download resources from external sources during runtime (e.g., get_url) causes high memory usage. This issue is particularly noticeable in environments with large-scale deployments or limited system resources. There are couple of instances in different files that we are reporting as part of this bug that we would like to get resolved.

openshift-tools/openshift/installer/vendored/openshift-ansible-3.9.40/playbooks/azure/openshift-cluster/launch.yml
openshift-tools/openshift/installer/vendored/openshift-ansible-3.11.28-1/playbooks/azure/openshift-cluster/launch.yml
--- - name: download acs-engine
get_url:
url: "{{ item }}"
dest: "{{ tmp.path }}/"
with_list:
- "http://acs-engine-build-azure.svc.ci.openshift.org/acs-engine"
- "http://acs-engine-build-azure.svc.ci.openshift.org/openshift.json" ---

Expected behavior
The playbook should avoid fetching resources directly from external URLs to prevent high memory usage. Instead:

  • Pre-fetch the required resources to a control machine or staging area ahead of deployment.
  • Use local copies or mirrors for fetching files.
  • This approach would reduce memory usage and improve the performance and reliability of deployments.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant