Face tracking and recognition
The mobile application is built on React Native and works on both iOS and Android. The purpose of the application is to add fun elements to the communication between the users as well as to introduce face detection algorithms for further enhancement of the user experience.Project overview
For this WebRTC-based video-conferencing mobile application we developed a built-in face recognition tool.
The Swedish-based customer wanted the tool to include such features as:
- Adding face filters, masks and animated reactions in real time.
- After locating the voice, facial detection algorithms are used to determine if the person is speaking to other people in the room or to meeting participants joining by video.
Platform
WebTechnology
WebRTC (Kurento), Websockets, Xmpp, SIP, HTTP, HTTPS, Xmlrpc, JavaScript, NodeJS, React Native, JQuery, MySQL, MS SQL, SOAP, Rest API, AWS/GCPTeam
1 DevOps1 Backend/AWS Developer1 React Developer1 QA Engineer1 DesignerDuration
24 monthsClient
Startup
Solution
We developed Mobile and Web applications to allow video and audio calls via WebRTC, screen capture, screen sharing as well as adding face filters, masks and animated reactions. Another feature we introduced is a complex facial detection mechanism to determine if the person is speaking to colleagues sitting nearby or to the entire audience joining the chat from all over the world. The Web-application supports mobile, tablets and desktop devices with the latest browser versions.