This site relies heavily on Javascript. You should enable it if you want the full experience. Learn more.
Manipulating Faces
about
Besides its full body/skeleton tracking capabilities the Kinect also features a dedicated face tracking functionality. With it you can easily identify individual parts (eyes, nose, mouth) of a face and then manipulate, replace, extend those using texture- or geometry-based techniques.
The download comes with 13 different demos on what you can do with the tracking data.
Note:
- Requires b32.1 + addonpack + dx11 pack
- Those demos will not work with Kinect2 out of the box but should be fairly simple to adapt once the Kinect2 nodes also features face-tracking capabilities.
download
anonymous user login
Shoutbox
~3d ago
joreg:
Workshop on 01 08: Augmented Reality using OpenCV, signup here: https://thenodeinstitute.org/courses/ss24-vvvv-augmented-reality-using-opencv-in-vvvv/
~12d ago
joreg:
Workshop on 18 07: Fluid simulations in FUSE, signup here: https://thenodeinstitute.org/courses/ss24-vvvv-fluid-simulations-in-fuse/
~12d ago
joreg:
Workshop on 17 07: Working with particles in FUSE, signup here: https://thenodeinstitute.org/courses/ss24-vvvv-working-with-particles-in-fuse/
~23d ago
joreg:
Here's what happened in June in our little univvvverse: https://visualprogramming.net/blog/2024/vvvvhat-happened-in-june-2024/
~24d ago
joreg:
We're starting a new beginner tutorial series. Here's Nr. 1: https://visualprogramming.net/blog/2024/new-vvvv-tutorial-circle-pit/
~26d ago
joreg:
Registration is open for LINK - the vvvv Summer Camp 24!
Full details and signup are here: https://link-summercamp.de/
~26d ago
joreg:
Workshop on 11 07: Compute Shader with FUSE, signup here: https://thenodeinstitute.org/courses/ss24-vvvv-compute-shader-with-fuse/
~1mth ago
joreg:
Workshop on 27 06: Rendering Techniques with FUSE, signup here: https://thenodeinstitute.org/courses/ss24-vvvv-rendering-techniques-with-fuse/
~1mth ago
joreg:
Workshop on 20 06: All about Raymarching with FUSE, signup here: https://thenodeinstitute.org/courses/ss24-vvvv-all-about-raymarching-with-fuse/
~1mth ago
joreg:
vvvv gamma 6.5 is out, see changelog: https://thegraybook.vvvv.org/changelog/6.x.html
thanks for sharing! but FullscreenQuad and some modules are missing here.
Seems good but no Kinect no ffffun... :(
@mino: i added requirements above. does that help?
@esnho: in most samples you can easily use FaceData (Kinect Microsoft Fallback) to simulate the face.
it worked! i like Celeb and UVReplace one ;)
Nice demos indeed... thanks for sharing! I have some experience programming for the Kinect but on other platforms - vvvv is quite new to me. The "makeup" patch is one that really caught my eyes. I believe it's possible to try to use another face shot as reference image, right? But how to go about editing the face markers? The patch loads them from the "face.vpe" file, right? Do we have to edit this file by hand or is there some tool that can save these points to a file?
the patch is using a PointEditor (3d Persistent) internally that allows you to manipulate the points directly. have a look at the helppatch of that node to learn how to operate it.
@joreg: I'll take a look at it... thanks!
Not sure why but my face is not being recognized, all nodes are fine, Kinect is working, maybe I am just too ugly?
Simone
SOLVED: you have to be in full sight (a least torso) of the camera, just the head isn t enough...