Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

re-enable helm #3053

Merged
merged 34 commits into from
Nov 10, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
b15d7de
re-enable helm
LostVector Nov 5, 2024
bf9943d
allow manual triggering
LostVector Nov 5, 2024
3be5195
change vespa host
LostVector Nov 5, 2024
b025287
change vespa chart location
LostVector Nov 5, 2024
022afb0
update Chart.lock
rkuo-danswer Nov 5, 2024
11645d1
update ct.yaml with new vespa chart repo
rkuo-danswer Nov 5, 2024
aa3df64
bump vespa to 0.2.5
LostVector Nov 6, 2024
34a317e
update Chart.lock
rkuo-danswer Nov 6, 2024
0c13ab2
update to vespa 0.2.6
rkuo-danswer Nov 6, 2024
1c5ab82
bump vespa to 0.2.7
rkuo-danswer Nov 6, 2024
8b3d16f
bump to 0.2.8
rkuo-danswer Nov 6, 2024
9e224b8
bump version
rkuo-danswer Nov 6, 2024
d0a0959
try appending the ordinal
rkuo-danswer Nov 6, 2024
5ae7844
try new configmap
rkuo-danswer Nov 6, 2024
e5a7e62
bump vespa
rkuo-danswer Nov 6, 2024
e5ed57b
bump vespa
rkuo-danswer Nov 6, 2024
7de79e5
add debug to see if we can figure out what ct install thinks is failing
rkuo-danswer Nov 6, 2024
fba2f64
add debug flag to helm
rkuo-danswer Nov 7, 2024
7f32773
try disabling nginx because of KinD
rkuo-danswer Nov 7, 2024
9876e44
use helm-extra-set-args
rkuo-danswer Nov 7, 2024
4f0f613
try command line
rkuo-danswer Nov 7, 2024
1ad3a29
try pointing test connection to the correct service name
LostVector Nov 7, 2024
b01fd21
bump vespa to 0.2.12
rkuo-danswer Nov 7, 2024
16f17f5
update chart.lock
rkuo-danswer Nov 7, 2024
c2a9433
bump vespa to 0.2.13
rkuo-danswer Nov 7, 2024
600fcff
bump vespa to 0.2.14
rkuo-danswer Nov 7, 2024
d0702ba
bump vespa
rkuo-danswer Nov 7, 2024
4892cb0
bump vespa
rkuo-danswer Nov 7, 2024
89b149e
re-enable chart testing only on changes
rkuo-danswer Nov 9, 2024
7521042
name the check more specifically than "lint-test"
rkuo-danswer Nov 9, 2024
cd6e93c
add some debugging
rkuo-danswer Nov 9, 2024
45a6d5f
try setting remote
LostVector Nov 9, 2024
3d3860c
might have to specify chart dirs directly
LostVector Nov 9, 2024
adc5ace
add comments
LostVector Nov 9, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -1,24 +1,20 @@
# This workflow is intentionally disabled while we're still working on it
# It's close to ready, but a race condition needs to be fixed with
# API server and Vespa startup, and it needs to have a way to build/test against
# local containers

name: Helm - Lint and Test Charts

on:
merge_group:
pull_request:
branches: [ main ]

workflow_dispatch: # Allows manual triggering

jobs:
lint-test:
helm-chart-check:
# See https://runs-on.com/runners/linux/
runs-on: [runs-on,runner=8cpu-linux-x64,hdd=256,"run-id=${{ github.run_id }}"]

# fetch-depth 0 is required for helm/chart-testing-action
steps:
- name: Checkout code
uses: actions/checkout@v3
uses: actions/checkout@v4
with:
fetch-depth: 0

Expand All @@ -28,7 +24,7 @@ jobs:
version: v3.14.4

- name: Set up Python
uses: actions/setup-python@v4
uses: actions/setup-python@v5
with:
python-version: '3.11'
cache: 'pip'
Expand All @@ -45,24 +41,31 @@ jobs:
- name: Set up chart-testing
uses: helm/[email protected]

# even though we specify chart-dirs in ct.yaml, it isn't used by ct for the list-changed command...
- name: Run chart-testing (list-changed)
id: list-changed
run: |
changed=$(ct list-changed --target-branch ${{ github.event.repository.default_branch }})
echo "default_branch: ${{ github.event.repository.default_branch }}"
changed=$(ct list-changed --remote origin --target-branch ${{ github.event.repository.default_branch }} --chart-dirs deployment/helm/charts)
echo "list-changed output: $changed"
if [[ -n "$changed" ]]; then
echo "changed=true" >> "$GITHUB_OUTPUT"
fi

# lint all charts if any changes were detected
- name: Run chart-testing (lint)
# if: steps.list-changed.outputs.changed == 'true'
run: ct lint --all --config ct.yaml --target-branch ${{ github.event.repository.default_branch }}
if: steps.list-changed.outputs.changed == 'true'
run: ct lint --config ct.yaml --all
# the following would lint only changed charts, but linting isn't expensive
# run: ct lint --config ct.yaml --target-branch ${{ github.event.repository.default_branch }}

- name: Create kind cluster
# if: steps.list-changed.outputs.changed == 'true'
if: steps.list-changed.outputs.changed == 'true'
uses: helm/[email protected]

- name: Run chart-testing (install)
# if: steps.list-changed.outputs.changed == 'true'
run: ct install --all --config ct.yaml
# run: ct install --target-branch ${{ github.event.repository.default_branch }}

if: steps.list-changed.outputs.changed == 'true'
run: ct install --all --helm-extra-set-args="--set=nginx.enabled=false" --debug --config ct.yaml
# the following would install only changed charts, but we only have one chart so
# don't worry about that for now
# run: ct install --target-branch ${{ github.event.repository.default_branch }}
10 changes: 8 additions & 2 deletions ct.yaml
Original file line number Diff line number Diff line change
@@ -1,12 +1,18 @@
# See https://github.com/helm/chart-testing#configuration

# still have to specify this on the command line for list-changed
chart-dirs:
- deployment/helm/charts

# must be kept in sync with Chart.yaml
chart-repos:
- vespa=https://unoplat.github.io/vespa-helm-charts
- vespa=https://danswer-ai.github.io/vespa-helm-charts
- postgresql=https://charts.bitnami.com/bitnami

helm-extra-args: --timeout 600s
helm-extra-args: --debug --timeout 600s

# nginx appears to not work on kind, likely due to lack of loadbalancer support
# helm-extra-set-args also only works on the command line, not in this yaml
# helm-extra-set-args: --set=nginx.enabled=false

validate-maintainers: false
8 changes: 4 additions & 4 deletions deployment/helm/charts/danswer/Chart.lock
Original file line number Diff line number Diff line change
Expand Up @@ -3,13 +3,13 @@ dependencies:
repository: https://charts.bitnami.com/bitnami
version: 14.3.1
- name: vespa
repository: https://unoplat.github.io/vespa-helm-charts
version: 0.2.3
repository: https://danswer-ai.github.io/vespa-helm-charts
version: 0.2.16
- name: nginx
repository: oci://registry-1.docker.io/bitnamicharts
version: 15.14.0
- name: redis
repository: https://charts.bitnami.com/bitnami
version: 20.1.0
digest: sha256:fb42426c1d13667a4929d0d6a7d681bf08120e4a4eb1d15437e4ec70920be3f8
generated: "2024-09-11T09:16:03.312328-07:00"
digest: sha256:711bbb76ba6ab604a36c9bf1839ab6faa5610afb21e535afd933c78f2d102232
generated: "2024-11-07T09:39:30.17171-08:00"
6 changes: 3 additions & 3 deletions deployment/helm/charts/danswer/Chart.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ home: https://www.danswer.ai/
sources:
- "https://github.com/danswer-ai/danswer"
type: application
version: 0.2.0
version: 0.2.1
appVersion: "latest"
annotations:
category: Productivity
Expand All @@ -23,8 +23,8 @@ dependencies:
repository: https://charts.bitnami.com/bitnami
condition: postgresql.enabled
- name: vespa
version: 0.2.3
repository: https://unoplat.github.io/vespa-helm-charts
version: 0.2.16
repository: https://danswer-ai.github.io/vespa-helm-charts
condition: vespa.enabled
- name: nginx
version: 15.14.0
Expand Down
2 changes: 1 addition & 1 deletion deployment/helm/charts/danswer/templates/configmap.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ metadata:
data:
INTERNAL_URL: "http://{{ include "danswer-stack.fullname" . }}-api-service:{{ .Values.api.service.port | default 8080 }}"
POSTGRES_HOST: {{ .Release.Name }}-postgresql
VESPA_HOST: "document-index-service"
VESPA_HOST: da-vespa-0.vespa-service
rkuo-danswer marked this conversation as resolved.
Show resolved Hide resolved
REDIS_HOST: {{ .Release.Name }}-redis-master
MODEL_SERVER_HOST: "{{ include "danswer-stack.fullname" . }}-inference-model-service"
INDEXING_MODEL_SERVER_HOST: "{{ include "danswer-stack.fullname" . }}-indexing-model-service"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -11,5 +11,5 @@ spec:
- name: wget
image: busybox
command: ['wget']
args: ['{{ include "danswer-stack.fullname" . }}:{{ .Values.webserver.service.port }}']
args: ['{{ include "danswer-stack.fullname" . }}-webserver:{{ .Values.webserver.service.port }}']
restartPolicy: Never
Loading