» Kinect Point Cloud Shader
This site relies heavily on Javascript. You should enable it if you want the full experience. Learn more.

Kinect Point Cloud Shader

effect
Credits: Screamer, Hierro for the original plugin and color filter shader. Desaxismundi, Sanch, u7angel for the original displacement shader. sugokuGENKI and http://graphics.stanford.edu/~mdfisher/Kinect.html for the XYZ conversion.

about

Must have the following installed for plugin to work:

http://www.openni.org/downloadfiles/openni-binaries/latest-unstable/25-openni-unstable-build-for-windows-v1-0-0/download

http://www.openni.org/downloadfiles/openni-compliant-middleware-binaries/latest-unstable/46-primesense-nite-unstable-build-for-windows-v1-3-0/download

Drivers:

https://github.com/avin2/SensorKinect/archives/unstable

Note: Must use a float texture between the shaders.

download

KinectSkeletonPointCloud.zip
06.02.11 [06:21 UTC] by jonferran | 3542 downloads

newemka 18/03/2011 - 06:04

Great work! seems very interesting. I've managed to use Multiskeleton(kinect). but not KinectskeletonPointCloud. I'm hunting the solution since a few hours... Shall i run the NiUserTracker.exe from multiskeleton? or maybe OpenNISkeleton.csproj ? but i can't run it, I should install Visual studio i guess. maybe someone could help me?

rogalag 22/03/2011 - 00:52

As I remember Multiskeleton and KinectPointCloud both use "skeleton" plugin,but in fact in first example it is original Hierro plug, and under the same name "skeleton" plug by jonferran for KinectPointCloud. So vvvv use first installed plugin- in your case hierro's. I might be wrong, but try this: remove Multiskeleton, or zip it, than start KinectPointCloud. It should work.

vjc4 04/04/2011 - 19:48

i cant get it to work
can you re uploadit with the latest drivers from kinect-point-cloud-shader?

http://rapidshare.com/files/455786617/kinectc4.zip

johansebastian 06/09/2011 - 10:17

I would like to get this working.. however there are 3 nodes which are somewhat red in the middle, and grey along top/bottom:
onlyColorWorldXYZ, Ord2Enum, and another copy of onlyColorWorldXYZ.
At first they were bright red, but after hovering over them and seeing where it wanted to find the files, I copied them into the appropriate dirs.
Reopened jonKinectPointCloud (which btw I put that file into the main vvv dir, not sure if thats the right place to put it).

Can someone direct me in the right direction? I have been wanting to add my Kinect to my VJ shows ever since I bought the thing a few months ago. I searched all over the net to find an app that would let me do some effects with it (like this one) and found vvvv. So far I really like the vvvv concept.

Edit:
When I view the source code for onlyColoredWorldXYZ.fx it shows an error at the bottom of the window:
DepthToWorld: ps_2_a does not support doubles

WTF ??

metrowave 08/09/2011 - 18:31

bump

jonferran 08/09/2011 - 22:20

Okay Okay, I will update this soon due to popular demand :P

Give me a day or so to clean up the embarassing spiderweb that I call a patch.

colorsound 15/09/2011 - 19:36

hi jonferran , thanks for sharing , i have the same problem as johansebastian i get red error on the shader in line 31 double4 DepthToWorld(int x, int y, double depthValue) and line 204 PixelShader = compile ps_2_a shift(); ,

any hints ?

using Nvidia GeForce GTX580 :
Fixed FunctionVertex Shader 1.0Vertex Shader 1.1Vertex Shader 2.0Vertex Shader 2.aVertex Shader 3.0Pixel Shader 1.0Pixel Shader 1.1Pixel Shader 1.2Pixel Shader 1.3Pixel Shader 1.4Pixel Shader 2.0Pixel Shader 2.aPixel Shader 2.bPixel Shader 3.0

win7 64bit
vvvv26

alg 16/09/2011 - 00:06

I'm replaced all doubles by floats and it's compiled. Just search all double keywords and replace it by float keywords. So, you must get float4, float and etc.

colorsound 20/09/2011 - 10:43

hi alg , thanks for the help , yes i replaced by float and shaders compile ok no more red . the plug still dont work but probably wrong openni version or drivers . last i installed where the ones to use with phlegma version .

RoyCui 05/01/2013 - 08:02

@johansebastian I had met the same problem,and finally soleved it.You can try as the following steps:
1.Push the right button of your mouse on the onlyColoredWorldXYZ node,and then you'll find that a code editor is open.
2.Edit the codes in this window,change all the word "double" into "float".After all have finished,Ctrl + S to save the codes,and you'll definitely find that the red nodes will be back the gray ones!

Hope this can help you

_
sansui 10/06/2013 - 18:07

this does not working in 45beta30x86?

I'm using kinect by openNI driver.
I knew these drivers stable and I am using these drivers.
kinect
OpenNI-win32-1.5.2.23-redist
SensorKinect-Bin-Win32-v5.1.0.25
NITE 1.5.2.21

Depth(openNI) help, Skeleton(openNI) help patch work well.
but this point cloud patch does not work.
first time, I found three node red.
but as RoyCui comment, I fixed that. then no red node. looks normal.
but in renderer, nothing shown.

could you give me any help for me?

anonymous user login

Shoutbox

~9d ago

joreg: Postponed: Next vvvv beginner course starting April 29: https://thenodeinstitute.org/courses/vvvv-beginner-class-summer-2024/

~1mth ago

~1mth ago

joreg: The Winter Season of vvvv workshops is now over but all recordings are still available for purchase: https://thenodeinstitute.org/ws23-vvvv-intermediates/

~2mth ago

schlonzo: Love the new drag and drop functionality for links in latest previews!

~2mth ago

joreg: Workshop on 29 02: Create Sequencers and Precise Clock Based Tools. Signup here: https://thenodeinstitute.org/courses/ws23-vvvv-08-create-sequencers-and-precise-clock-based-tools-in-vvvv-gamma/