Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FAI-13039] - Add AI Copilot Evaluation dashboards and mock data #372

Merged
merged 50 commits into from
Nov 12, 2024

Conversation

crupley
Copy link
Contributor

@crupley crupley commented Nov 7, 2024

Description

Adds 3 new dashboards to a new AI Copilot Evaluation folder:

  1. Adoption & Usage highlights data from the GitHub API
  2. Impact shows how PR performance is different between users with a Copilot tool and those without
  3. Surveys captures subjective sentiment on Engagement, Time Savings, Benefits, and Satisfaction with Copilot tool use

Additionally, mock data has been added to enable these dashboards to populate:

  • Faros Metrics and Tags for Copilot metrics
  • User Tool Usage for Copilot usage
  • Survey objects

Fixes # (FAI-13039)

Type of change

  • New feature (non-breaking change which adds functionality)

Checklist

(Delete what does not apply)

  • Have you checked that there aren't other open Pull Requests for the same update/change?
  • Have you lint your code locally before submission?
  • Have you added an explanation of what your changes do and why you'd like us to include them?
  • Have you written new tests for your core changes, as applicable?
  • Have you successfully run tests with your changes locally?

Dashboards

Screenshot 2024-11-07 at 1 47 38 PM


Screenshot 2024-11-07 at 1 47 56 PM


Screenshot 2024-11-07 at 1 48 33 PM

@crupley crupley requested a review from chalenge November 7, 2024 21:25
mock-data/src/hasura.ts Dismissed Show dismissed Hide dismissed
mock-data/src/hasura.ts Dismissed Show dismissed Hide dismissed
@crupley crupley marked this pull request as ready for review November 7, 2024 23:50
@crupley crupley self-assigned this Nov 7, 2024
@crupley crupley merged commit 578adcb into main Nov 12, 2024
4 checks passed
@crupley crupley deleted the cr/copilot branch November 12, 2024 16:04
@github-actions github-actions bot locked and limited conversation to collaborators Nov 12, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants