How Instagram’s Viral Face Filters Work

Computer vision is incredibly valuable to Facebook, and Pokémon, Disney princesses, and ‘Friends’ characters help us see why

What Pokémon are you? Which Disney character or Friends friend? You’ve probably seen these face filters invading Instagram over the past few weeks. Pull up the camera, point it at your face, and the app will generate a random selection for you. Naturally, you post the result — “Snorlax??” — your friends see it, and then they make their own; a viral sensation is born.

All of this is the result of Instagram opening up its platform last year, giving anyone with a computer and a free program called Spark AR the ability to make their own simple face filter in just a few minutes. You don’t even need technical expertise: A simple YouTube tutorial will show you how it’s done.

The filter community is flourishing. There are those “which X are you?” filters, but some creators have gone much deeper. Instagram filter artist Dvoshanky has created side-scrolling games inside filters, where a user can play a Flappy Bird clone, or as an alien invading Area 51 who has to jump over obstacles. All of it stems from computer vision technology that allows the software to understand, in a very basic sense, what it’s “seeing” in a photograph or…