Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add sentry to spawned indexing task #3059

Merged
merged 3 commits into from
Nov 6, 2024
Merged

add sentry to spawned indexing task #3059

Changes from 2 commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
5b06b53
add sentry to spawned indexing task
rkuo-danswer Nov 5, 2024
9ac256e
Merge branch 'main' of https://github.com/danswer-ai/danswer into bug…
rkuo-danswer Nov 5, 2024
583cd14
comment why we need sentry here
rkuo-danswer Nov 6, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 11 additions & 0 deletions backend/danswer/background/celery/tasks/indexing/tasks.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@
from time import sleep

import redis
import sentry_sdk
from celery import Celery
from celery import shared_task
from celery import Task
Expand Down Expand Up @@ -50,6 +51,7 @@
from shared_configs.configs import INDEXING_MODEL_SERVER_HOST
from shared_configs.configs import INDEXING_MODEL_SERVER_PORT
from shared_configs.configs import MULTI_TENANT
from shared_configs.configs import SENTRY_DSN

logger = setup_logger()

Expand Down Expand Up @@ -482,6 +484,15 @@ def connector_indexing_task(
that the task transitioned to a "READY" state but the generator_complete_key doesn't exist.
This will cause the primary worker to abort the indexing attempt and clean up.
"""
if SENTRY_DSN:
rkuo-danswer marked this conversation as resolved.
Show resolved Hide resolved
sentry_sdk.init(
dsn=SENTRY_DSN,
traces_sample_rate=0.1,
)
logger.info("Sentry initialized")
else:
logger.debug("Sentry DSN not provided, skipping Sentry initialization")

logger.info(
f"Indexing spawned task starting: attempt={index_attempt_id} "
f"tenant={tenant_id} "
Expand Down
Loading