» FaceTracker (DX11.Texture 2d)
This site relies heavily on Javascript. You should enable it if you want the full experience. Learn more.

FaceTracker (DX11.Texture 2d)

So I found this library: https://github.com/ShiqiYu/libfacedetection
And it was super easy to use. So after a wrapper class and a handling node here are the results from vvvv with any DX11 texture:


Trololo at 60-70 fps with multiview-reinforce engine.


Crowd footage at 10-20 fps with multiview engine. It tracks as many faces as much you throw at it.

This library is fast but far from accurate. But I made the wrapper class in a way that in the future it can be easily extended with other engines, so if anyone finds robust and fast face trackers, throw that at me and I'll implement it if they don't cost a fortune.

Available in mp.dx http://vvvvpm.github.io/#mp.dx

microdee, Tuesday, Jan 23rd 2018 Digg | Tweet | Delicious 19 comments  
Lrinke 24/01/2018 - 15:35

that's f*** awesome :D
next project yolo object detection?

microdee 24/01/2018 - 21:46

it's up and running now in mp.dx: http://vvvvpm.github.io/#mp.dx
check out the FaceTracker patch in girlpower

ggml 25/01/2018 - 02:03


colorsound 25/01/2018 - 10:11

great ¡¡ thank you.

CeeYaa 25/01/2018 - 12:51

nize - thanks again, microdee

metrowave 26/01/2018 - 15:44

Cool, that's funny...

microdee 27/01/2018 - 03:49

if anybody has red node issues install mp.dx through vpm again (only overwrite mp.dx), I forgot to set the build config back to release the first time, causing DLL issues for everyone without Visual Studio and without C++ development packs for it. Now it's in release so should be fine with VC redist 2017

eps 20/02/2018 - 13:40

mucho gracias, ultra cool'n'useful

ggml 23/02/2018 - 12:55

hello; could this tracker aproximate the relative movement of faces ? (does it output ids?)

microdee 23/02/2018 - 15:52

nope, it's only looking at single frame images, it can't keep a track of faces in the time domain. however you can come up with something based on positions and searching for other consistencies accross frames.

ggml 06/05/2018 - 22:38

microdee is this implementation available for try ?

microdee 07/05/2018 - 02:05

it's available in mp.dx, https://vvvvpm.github.io/#mp.dx/latest

tobyk 22/05/2018 - 18:31

Hi @Microdee. Having trouble with this one if you've got a tick...

Under vvvv_50beta36_x64 I get a red FaceTrackerContent node.
The error pin on the FaceTracker node says

An attempt was made to load a program with an incorrect format. (Exception from HRESULT: 0x8007000B)
   at mp.dx.Tracking.FaceTrackerContext.facedetect_frontal_surveillance(Byte* result_buffer, Byte* gray_image_data, Int32 width, Int32 height, Int32 step, Single scale, Int32 min_neighbors, Int32 min_object_width, Int32 max_object_width, Int32 doLandmark)
   at mp.dx.dx11.Nodes.TextureFaceTrackerNode.Evaluate(Int32 SpreadMax) in C:\projects\mp-dx\DX11Utils\TextureFaceTrackerNode.cs:line 150

Installed via VPM github.latest.vpack
Tried with latest DX11 pack (1.3 released a few days ago) and with the DX11 pack that VPM installs.

microdee 24/05/2018 - 14:25

hi! thanks I will check if the necessary dll's are copied properly later, I have a suspicion it doesn't do that

rogalag 25/05/2018 - 19:00

Hi @Microdee:
Something's wrong downloading your vpm pack .
I'm using latest vpm 1.2.8
Maybe you can provide alternative "classic style" download link

microdee 25/05/2018 - 22:22

that there looks like an edge case. check your SSH situation, if you use a proxy or a vpn make sure they don't fiddle with secure channels.
You can have "classic style downloading" but you'll need to download and extract 5 zip files.


extract all to packs folder. also mp.* packs require .NET 4.7+ so make sure your windows 7 is up to date (so turn updates back on if you turned them off).

I still didn't have time to fix the face tracker dll automatic deployment, if you can't wait though download this https://github.com/microdee/mp.dx/blob/master/DX11Utils.Native/dependencies/libfacedetect.dll and put it next to DX11Utils.dll inside the plugins folder of mp.dx. x64 only.

rogalag 26/05/2018 - 13:43

Thanks a lot @microdee, I will try to collect pack , hope it'll work...

rogalag 27/05/2018 - 18:23

Thank you!. Facetracker working perfectly!

vj shanti 11/08/2018 - 11:57

Hi there!
How can I instal this contribution?


  • 1

anonymous user login


~1d ago

domj: Little vvvv robotics and light control in the Tschechisches Zentrum Berlin in few hours, just patching en route https://bit.ly/2V0FAb3 ;)

~1d ago

AKa-visuals: @polyrhythm Stunning!.. cant wait for ibl integration. Keep on!

~1d ago

catweasel: @polyrhythm looks lovely!

~1d ago

polyrhythm: i put a little love into my vvvv raytracer after some time not touching it. textured emissive lights! https://i.imgur.com/OVzp6d5.png

~2d ago

sinus: Yes, they did the kollabo with klf. Still a tornado in the club.

~2d ago

microdee: @sinus: hahaha maaan that's some amazing stuff :D

~2d ago

elektromeier: @sinus: the extreme noise terror which played at klf s exit gig at brits?

~2d ago

sinus: Ipswitch

~2d ago

sinus: @evvvvil: from ispwitch! noble men! https://extremenoiseterror.bandcamp.com/

~3d ago

evvvvil: Fuck Norfolk that's where every boring person in the world is from. Suffolk is also a shithole and their football team is worst. xx