Skip to content

Commit

Permalink
cleans synth eval prompt
Browse files Browse the repository at this point in the history
  • Loading branch information
matthewcoole committed Dec 20, 2024
1 parent 679a2d2 commit 2b9c1b4
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions prompts/synth-eval.txt
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ Examples:
"question": "What was the average weed abundance across the surveyed lowland arable fields over the three-year period?",
"ground_truth": "The answer to given question is not present in context"
"appropriate": false,
"reason": "The question appears to be reffering to a specific dataset but it is not clear which one. The ground truth does not give an appropriate answer and the "
"reason": "The question appears to be reffering to a specific dataset but it is not clear which one. The ground_truth does not give an appropriate answer."
}
{
"question": "What specific parameters are recorded for each tree within the surveyed 10m x 10m plots in the 'UK Environmental Change Network (ECN) woodland vegetation data' dataset?",
Expand All @@ -52,7 +52,7 @@ Examples:
"question": "What are the estimated annual loads of nitrogen from non-agricultural sources to rivers in Scotland?",
"ground_truth": "The answer to given question is not present in context",
"appropriate": false,
"reason": "The ground truth does not provide an answer to the question."
"reason": "The ground_truth does not provide an answer to the question."
}

The question to assess is:

1 comment on commit 2b9c1b4

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

context_precision: 0.48916719081278187
answer_relevancy: 0.5105171402890353
answer_correctness: 0.5221154328743205
context_recall: 0.5176805805061807

Please sign in to comment.