Skip to content

Latest commit

 

History

History
37 lines (23 loc) · 1.17 KB

REAME.md

File metadata and controls

37 lines (23 loc) · 1.17 KB

Knowledge Base Assistant

Purpose

This project is an exploration of OpenAI's Assistant API - trying to evaluate the strengths and weaknesses.

  1. Is an Assistant easier to use than Llama Index/Langchain?
  2. Does an Assistant provide more accurate answers than Llama Index/Langchain?

Context

This project is based off the existing Knowledge Base Demo.

Data Inputs:

  1. Our external Notion wiki
  2. Our public website: Focused Labs

Run

  1. A Open AI API account (api key). You can sign up at Open AI's website.
  2. Python (and your favorite IDE). We are using python v3.10.7.

Update .env

OPENAI_API_KEY = "<Open AI API Token>"

Run the test

Run the code blocks in sandbox.ipynb

This will result in an accuracy_test_results.csv file. You can open this and evaluate the accuracy of the answers.