Experimental Camera

Description

The editor to the code is available here

This project takes the term ‘read my lips’ quite literally and allows us to imprint our emotions to our lips. I decided to use the lips as the canvas on the screen given how we’re covering our mouths nowadays due to the pandemic.

The lips usually give an added layer to our conversations and that’s an important aspect of listening that we don’t get to access anymore. So, I found it interesting to remove everything else except the lips and allow meaning to be conveyed through them.

I used face-API for this project. I use the face landmarks to re-create the lips from the relevant points and used the expression with the highest probability to decide the color of the fill.