Streamlit Backend Admin Panel - Unable to add URL Embeddings

[edgBR]

Describe the bug

Dear colleagues,

I am facing issues when ingesting URLs using the UI functionality of the Streamlit backend:

Expected behavior

I expect the processing of the URLs to work properly

How does this bug make you feel?

---

Steps to reproduce

Steps to reproduce the behavior:

1. Deploy the solution.
2. Following environment variables:

VARIABLE	VALUE
AZURE_SEARCH_USE_INTEGRATED_VECTORIZATION	FALSE
AZURE_SEARCH_ENABLE_IN_DOMAIN	FALSE
AZURE_OPENAI_EMBEDDING_MODEL_INFO	{"model":"text-embedding-3-large","modelName":"text-embedding-3-large","modelVersion":"1"}

3. Conversational flow: byod
4. Content safety: enabled.

However, when invoking this via the function URL:

Screenshots

Logs

ValueError: Error 401:
Traceback:
File "/tmp/8dd1b99115639a4/antenv/lib/python3.11/site-packages/streamlit/runtime/scriptrunner/exec_code.py", line 88, in exec_func_with_error_handling
    result = func()
             ^^^^^^
File "/tmp/8dd1b99115639a4/antenv/lib/python3.11/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 541, in code_to_exec
    self._session_state.on_script_will_rerun(
File "/tmp/8dd1b99115639a4/antenv/lib/python3.11/site-packages/streamlit/runtime/state/safe_session_state.py", line 66, in on_script_will_rerun
    self._state.on_script_will_rerun(latest_widget_states)
File "/tmp/8dd1b99115639a4/antenv/lib/python3.11/site-packages/streamlit/runtime/state/session_state.py", line 559, in on_script_will_rerun
    self._call_callbacks()
File "/tmp/8dd1b99115639a4/antenv/lib/python3.11/site-packages/streamlit/runtime/state/session_state.py", line 572, in _call_callbacks
    self._new_widget_state.call_callback(wid)
File "/tmp/8dd1b99115639a4/antenv/lib/python3.11/site-packages/streamlit/runtime/state/session_state.py", line 273, in call_callback
    callback(*args, **kwargs)
File "/tmp/8dd1b99115639a4/pages/01_Ingest_Data.py", line 57, in add_urls
    add_url_embeddings(urls)
File "/tmp/8dd1b99115639a4/pages/01_Ingest_Data.py", line 77, in add_url_embeddings
    raise ValueError(f"Error {r.status_code}: {r.text}")

---

[Prasanjeet-Microsoft]

Hello @edgBR, Thank you for reporting this issue! We will start investigating the issue and keep you updated on our progress.

[Prasanjeet-Microsoft]

Hello @edgBR, Did you deploy this accelerator locally using Azure CLI commands?

Note: When we deploy this accelerator via One Click with the same configuration (text-embedding-3-large), we are able to ingest the URL embedding successfully. So please deploy the accelerator using One Click and let us know the result.

[edgBR]

Hi @Prasanjeet-Microsoft I deployed the accelerator using azd and the devcontainer setup.

I am afraid deploying this with the one click will be difficult currently due to permissions. Would it be possible for you to deploy it via azd and let me know if its working?

[Prasanjeet-Microsoft]

Hi @Prasanjeet-Microsoft I deployed the accelerator using azd and the devcontainer setup.

I am afraid deploying this with the one click will be difficult currently due to permissions. Would it be possible for you to deploy it via azd and let me know if its working?

Hello @edgBR , We have deployed the accelerator using azd with the same configuration and attempted to ingest the URL, but we are encountering a similar issue. We are currently investigating the cause.

Thank you.