You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@openmeetings.apache.org by "Sebastian Wagner (Jira)" <ji...@apache.org> on 2024/01/31 09:21:00 UTC
[jira] [Updated] (OPENMEETINGS-2782) Add blur background filter options on video sharing - AI-ML
[ https://issues.apache.org/jira/browse/OPENMEETINGS-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sebastian Wagner updated OPENMEETINGS-2782:
-------------------------------------------
Description:
OpenMeetings uses webRTC and HTML5 video to share audio video. Purely browser based.
One feature missing is the ability to blur your webcam's camera background.
There are multiple ways to achieve it, Google Meet seems to use: [https://www.tensorflow.org/]
Tensorflow are AI/ML models, they provide precompiled models into JS, for detection of face/body it seems: [https://github.com/tensorflow/tfjs-models/tree/master/body-segmentation] is the best model.
Since Chrome 14 there is also a Background Blur API (relying on operating system APIs): [https://developer.chrome.com/blog/background-blur] - but that doesn't seem to be widely or reliable supported by operating systems yet.
The project would be about adding the background blur into a simple demo and then integrate into the OpenMeetings project. Additionally other types of backgrounds can be added.
Tensorflow TFJS is under the Apache 2.0 License (See [LICENSE|https://github.com/tensorflow/tfjs-models/blob/master/LICENSE]) and should be possible to redistribute with Apache OpenMeetings.
Other live demos and examples:
https://blog.francium.tech/edit-live-video-background-with-webrtc-and-tensorflow-js-c67f92307ac5
was:
OpenMeetings uses webRTC and HTML5 video to share audio video. Purely browser based.
One feature missing is the ability to blur your webcam's camera background.
There are multiple ways to achieve it, Google Meet seems to use: [https://www.tensorflow.org/]
Tensorflow are AI/ML models, they provide precompiled models into JS, for detection of face/body it seems: [https://github.com/tensorflow/tfjs-models/tree/master/body-segmentation] is the best model.
Since Chrome 14 there is also a Background Blur API (relying on operating system APIs): [https://developer.chrome.com/blog/background-blur] - but that doesn't seem to be widely or reliable supported by operating systems yet.
The project would be about adding the background blur into a simple demo and then integrate into the OpenMeetings project. Additionally other types of backgrounds can be added
> Add blur background filter options on video sharing - AI-ML
> -----------------------------------------------------------
>
> Key: OPENMEETINGS-2782
> URL: https://issues.apache.org/jira/browse/OPENMEETINGS-2782
> Project: Openmeetings
> Issue Type: New Feature
> Components: Audio/Video
> Reporter: Sebastian Wagner
> Priority: Major
> Labels: gsoc, gsoc2024, mentor
>
> OpenMeetings uses webRTC and HTML5 video to share audio video. Purely browser based.
> One feature missing is the ability to blur your webcam's camera background.
> There are multiple ways to achieve it, Google Meet seems to use: [https://www.tensorflow.org/]
> Tensorflow are AI/ML models, they provide precompiled models into JS, for detection of face/body it seems: [https://github.com/tensorflow/tfjs-models/tree/master/body-segmentation] is the best model.
> Since Chrome 14 there is also a Background Blur API (relying on operating system APIs): [https://developer.chrome.com/blog/background-blur] - but that doesn't seem to be widely or reliable supported by operating systems yet.
> The project would be about adding the background blur into a simple demo and then integrate into the OpenMeetings project. Additionally other types of backgrounds can be added.
> Tensorflow TFJS is under the Apache 2.0 License (See [LICENSE|https://github.com/tensorflow/tfjs-models/blob/master/LICENSE]) and should be possible to redistribute with Apache OpenMeetings.
> Other live demos and examples:
> https://blog.francium.tech/edit-live-video-background-with-webrtc-and-tensorflow-js-c67f92307ac5
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)