Face tracking and recognition
for video-conferencing

telephone pictureThe mobile application is built on React Native and works on both iOS and Android. The purpose of the application is to add fun elements to the communication between the users as well as to introduce face detection algorithms for further enhancement of the user experience.
telephone picture
men

Project overview

For this WebRTC-based video-conferencing mobile application we developed a built-in face recognition tool.

The Swedish-based customer wanted the tool to include such features as:

  • Adding face filters, masks and animated reactions in real time.

  • After locating the voice, facial detection algorithms are used to determine if the person is speaking to other people in the room or to meeting participants joining by video

  • Platform

    Web
  • Technology

    WebRTC (Kurento), Websockets, Xmpp, SIP, HTTP, HTTPS, Xmlrpc, JavaScript, NodeJS, React Native, JQuery, MySQL, MS SQL, SOAP, Rest API, AWS/GCP
  • Team

    1 DevOps
    1 Backend/AWS Developer
    1 React Developer
    1 QA Engineer
    1 Designer
  • Duration

    24 months
  • Client

    Startup
videoconftool picture

Solution

We developed Mobile and Web applications to allow video and audio calls via WebRTC, screen capture, screen sharing as well as adding face filters, masks and animated reactions. Another feature we introduced is a complex facial detection mechanism to determine if the person is speaking to colleagues sitting nearby or to the entire audience joining the chat from all over the world. The Web-application supports mobile, tablets and desktop devices with the latest browser versions.