-
Notifications
You must be signed in to change notification settings - Fork 117
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
* Added Katia's project * Update index.md * Fixed yaml (added " " broke the title). --------- Co-authored-by: Tiakat <[email protected]>
- Loading branch information
Showing
2 changed files
with
81 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,81 @@ | ||
--- | ||
type: "project" # DON'T TOUCH THIS ! :) | ||
date: "2024-06-25" | ||
# Title of your project (we like creative title) | ||
title: "Voice and Linguistic Analysis to Determine Emotions in Friends' Interactions" | ||
|
||
# List the names of the collaborators within the [ ]. If alone, simple put your name within [] | ||
names: [Katia Djerroud] | ||
|
||
# Your project GitHub repository URL | ||
github_repo: https://github.com/brainhack-school2024/Djerroud-project | ||
|
||
# If you are working on a project that has website, indicate the full url including "https://" below or leave it empty. | ||
website: | ||
|
||
# List +- 4 keywords that best describe your project within []. Note that the project summary also involves a number of key words. Those are listed on top of the [github repository](https://github.com/brainhack-school2020/project_template), click `manage topics`. | ||
# Please only lowercase letters | ||
tags: [Emotion Detection, Voice Analysis, Linguistic Analysis, Social Interactions] | ||
|
||
# Summarize your project in < ~75 words. This description will appear at the top of your page and on the list page with other projects.. | ||
|
||
summary: "Analyzes emotional dynamics in social interactions using voice and linguistic analysis on the Friends TV show dataset. Utilizing tools like Praat, OpenSmile, NLTK, and Hugging Face Transformers, it detects emotions from audio and text. Deliverables include code, documentation, datasets, and analysis workflows. Achievements encompass integrated emotion detection models and a robust analysis pipeline, with future plans to enhance models and expand datasets." | ||
|
||
# If you want to add a cover image (listpage and image in the right), add it to your directory and indicate the name | ||
# below with the extension. | ||
image: "sweet-talk.jpg" | ||
--- | ||
<!-- This is an html comment and this won't appear in the rendered page. You are now editing the "content" area, the core of your description. Everything that you can do in markdown is allowed below. We added a couple of comments to guide your through documenting your progress. --> | ||
|
||
## Djerroud-project | ||
|
||
Voice and Linguistic Analysis to Determine Emotions in Friends' Interactions Welcome to my project, where I explore the intersection of voice analysis, linguistic analysis, and natural language processing (NLP) to uncover the emotions generated during interactions among friends. This project analyze speech patterns, text exchanges, and vocal nuances to detect and interpret emotional states and determine the closeness betweeen the characters. | ||
|
||
## Features: | ||
|
||
Voice Analysis: Utilizes Praat for detailed spectrograms, pitch, formant analysis, and other acoustic features. Emotion Detection: Employs OpenSmile for extracting vocal features and identifying emotional cues from speech. Linguistic Analysis: Implements NLTK for tokenization, parsing, and sentiment analysis of textual interactions. NLP Models: Integrates state-of-the-art models from SpeechBrain and Hugging Face for comprehensive speech and text processing. Interactive Visualizations: Provides insights through visual representations of emotional states and linguistic patterns. Goals: | ||
|
||
To understand how friends' vocal expressions and word choices convey emotions. To develop a robust system for real-time emotion detection and linguistic analysis. To create a dataset and models that can be utilized for further research in social dynamics and emotional intelligence. Join me in this journey of decoding the emotional landscapes of social interactions through the power of voice and linguistic analysis! | ||
|
||
|
||
Project Definition Objective Analyzing emotional dynamics in social interactions using voice, linguistic, and text analysis techniques applied to the "Friends" TV show dataset. | ||
|
||
## Background Dataset Source: | ||
|
||
Obtained from MarieSTL, Pierre Bellec’s Lab, ensuring credibility and relevance to the research question. | ||
|
||
## Modality: | ||
|
||
Includes audio (MP3) and textual transcripts (JSON) of dialogues. | ||
|
||
## Suitability: | ||
|
||
Ideal for capturing real-life interactions among friends and exploring emotional dynamics. | ||
|
||
## Tools Voice Analysis | ||
|
||
Librosa, Praat, OpenSMILE Linguistic Analysis NLTK, SpaCy, Gensim Emotion Detection Hugging Face Transformers | ||
|
||
## Data Content | ||
|
||
Audio files (MP3) extracted from video episodes JSON transcript files containing dialogue text | ||
|
||
## Deliverables Expected Outputs | ||
|
||
GitHub repository with code scripts and Jupyter notebooks Documentation (README.md) Dataset files (audio, JSON transcripts) Analysis workflow/pipeline Training materials and models | ||
|
||
## Results Achievements | ||
|
||
Integrated voice and linguistic analysis for emotional dynamics Developed emotion detection models for audio and text inputs Established a robust analysis pipeline from data preprocessing to visualization | ||
|
||
## Progress Overview Summary | ||
|
||
Successfully implemented tools for voice and linguistic analysis Challenges included data integration and model optimization Tools I Learned During This Project Praat, OpenSMILE for voice analysis Hugging Face Transformers for emotion detection Docker, Git/GitHub for version control and project management | ||
|
||
## Conclusion and Acknowledgement Next Steps | ||
|
||
Enhance model performance and expand dataset coverage Prepare findings for publication and seek collaboration opportunities Acknowledgement Special thanks to MarieSTL, venkatesh and Pierre Bellec’s Lab for providing the "Friends" dataset Gratitude to the open-source community for tools and libraries used | ||
|
||
## More details | ||
|
||
Additional information is available in the `notebooks` and `presentation` folders. |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.