Feature request : Adding custom backgrounds for video using Selfie Segmentation MediaPipe Solution

[shivaylamba]

Is your feature request related to a problem? Please describe.
No it is a new feature request.

Describe the solution you'd like
Using the newly announced MediaPipe Selfie Segmentation Solution for Web to allow dynamic background change during live video. ( Refer : https://google.github.io/mediapipe/solutions/selfie_segmentation.html )

Describe alternatives you've considered
The https://github.com/tensorflow/tfjs-models/tree/master/body-pix Bodypix model can also do body segmentation. But the Selfie Segmentation model is lighter.

Approach to be followed (optional)

• Use the CDN link or NPM package for MediaPipe.
• Define the model type ( General or Landscape )
• Define the canvas element and Video capture device
• Load the model and send the canvas as the input element
• Wait for the segmentation mask to be generated
• Choose between different types of backgrounds

Additional context

• Refer to https://google.github.io/mediapipe/solutions/selfie_segmentation.html
• https://google.github.io/mediapipe/images/selfie_segmentation_web.mp4

[welcome]

Hello there!👋 Welcome to the project!🚀⚡

Thank you and congrats🎉for opening your very first issue in this project. Please adhere to our Contributing Guidelines.🙌 You may submit a PR if you like, make sure to follow our Pull Request Template. If you want to report a bug🐞 please follow our Issue Template. Also make sure you include steps to reproduce it and be patient while we get back to you.😄

Feel free to join our Discord Community.💖 We have different channels for active discussions.✨ Hope you have a great time there!😄

[shivaylamba]

@sansyrox @midopooler would like to discuss about this implementation with you all

[sansyrox]

@shivaylamba , adding custom backgrounds is not a part of the current roadmap. We would like to improve the facemesh detection feature first.
Custom backgrounds is definitely a good feature to consider for future roadmaps, however, if you or @midopooler be able to help us with implementing that, we would really appreciate it.

[sansyrox]

@shivaylamba , we can discuss this on our weekly community call on Sunday.

[shivaylamba]

Sure @sansyrox

[shivaylamba]

Can you share details of the weekly community call?

[sansyrox]

They usually take place on Sunday around 5pm. I will share the link with you later this week.