This site relies heavily on Javascript. You should enable it if you want the full experience. Learn more.

Plugin for Softkinetic DS325 / Creative Interactive Gesture Camera with Intel Perceptual Computing SDK

plugin

about

Heyho,

here's a pretty much complete plugin for Intel's "Intel Perceptual Computing SDK" (here).

It works with two cameras:
Softkinetic DS325
Creative Interactive Gesture Camera
(the two are the same device in different housings...)

You need to install the Intel PCSDK from above URL.

Note: Currently, the Intel PCSDK (and thus this plugin) does not support
multiple cameras.

2012-11-15: Initial release. Proudly presented by MESO.

2013-01-30: Changed to beta 2.

2013-05-07: Changed to release version of PCSDK. Added support for voice recognition.

download

20130507_PCSDK Release 01.zip
07.05.13 [02:26 UTC] by herbst | 2241 downloads
release 1 version

Show 2 older revisions

Older Revisions

20130130_PCSDK Beta 2.zip
30.01.13 [15:57 UTC] by herbst | 948 downloads
beta 2 version (deprecated)

02_PCSDK DS325.zip
15.11.12 [18:16 UTC] by herbst | 1094 downloads
beta 1 version (deprecated)

gaz 15/11/2012 - 18:48

Mmmh time to invest in a new piece of tech.

microdee 15/11/2012 - 20:29

soo i see it works in close situations and i see 1280*720 rgb image but what's different from kinect? or why should one invest in this one if Leap comes out (hopefully) 4 months later?

u7angel 15/11/2012 - 20:39

@gaz
agreed :)

metrowave 16/11/2012 - 01:13

Just bought it, 2 of them! Thanks for the patch...

herbst 16/11/2012 - 11:48

@microdee: the difference is the close interaction, and its quite stable for hand/finger position and orientation. (Actually, depending on how good the Leap works, this might of course be kind of redundant).
Oh, and you get head tracking with "landmark detection" (eye and mouth corners).

I attached some images. What you see there is

infrared image (you get RGB, depth, noisy infrared and "label", which is a hand and head mask)
hand openness (between 0 and 1)
fingertip positions
hand position, palm normal, and pointing direction

Works best in a standard desktop environment. Works, but not as good when camera isn't in front of you (e.g. above or somewhere else).

mrboni 16/11/2012 - 12:43

What is the usable range?

metrowave 16/11/2012 - 18:41

apparently the range is 15cm to 1 meter... but that is good for most gestural (finger/hand) interaction.

herbst 16/11/2012 - 18:53

There is an activation range of 40cm. Once a hand is found inside that 40cm, it can move back to at least 1m.

sonostrano 19/11/2012 - 13:04

My camera has just arrived. Thanks for the patch!

metrowave 20/11/2012 - 03:47

The patch works perfect, including both hands at once. Thanks again for the work.

catweasel 01/12/2012 - 21:20

Not having any joy here, the examples all work ok, but in v4 the light stays red and the plugin does put out any data, its not red, there are no error messages...
What v4 version are you all using?

metrowave 02/12/2012 - 01:38

I used it on vvvv_45beta28.1 and Win 7 64. Of course had to install the Intel SDK first. I had red node at first then I decided to re-install v4 and put above patch next to VVVV.exe that made it working without red node.

mediadog 07/12/2012 - 04:09

Thanks for the plugin, got my camera today!

But sadly, no workey: Win7 x64, SDK installed, samples work fine, 28.1. No red node, but "DS325 (Devices DS325) help.v4p" never shows enabled or info, and console gives:

00:00:01 ERR : Exception occured in TMPluginWrapperNode.Evaluate: Access violation at address 6F651B27 in module 'libpxcupipeline.DLL'. Read of address 6679B3F0

Reinstalling, moving things, made no difference.

Thanks again!

mediadog 07/12/2012 - 05:44

Same result on 2nd machine with clean Win7x64 install and 28.1. I am using the Perceptual Computing SDK 2013 Beta2 (Version 5831).

metrowave 08/12/2012 - 02:26

That's strange. It's hit and miss now, it was working well before but now works sometimes and other times not working. I've got the vvvv_45beta28.1 folder installed in c:/Program Files(86)/vvvv_45beta28.1

I noticed it's working when I start vvvv.exe first and then click on one of the 02_PCSDK DS325.zip patches. it needs work but it's a good start.

catweasel 12/12/2012 - 15:37

Same error as mediadog, is this linked in the plugin meso? Where does it come from and where is it meant to live?

metrowave 14/12/2012 - 05:02

@catweasel: have you tried firing up vvvv.exe first and then starting the patches? Like I mentioned I'm having problems too but hit and miss it works when I start vvvv root first and the double click the DS325 patches. The images above are the results. The location I put the DS325 folder is next to vvvv.exe in C:\Program Files (x86)\vvvv_45beta28.1\DS325

I'm hopeful @herbst updates these patches soon as they are very good efforts and a good start...

mediadog 14/12/2012 - 08:21

Still no joy moving the DS325 folder. I tried moving the SDK DLLs into the DS325 folder as well since they are in the same folders as the example .EXEs.

I thought maybe this was a 32/64 bit issue, so I pulled out a laptop with Win7 x32, installed 28.1 and the x32 PCSDK, examples run fine, same behavior with the patches.

The only difference I did notice when running vvvv.exe first is that it takes longer to fully initialize, as if it is initializing the hardware, but I still get the same fault. When I run the patches directly, the camera can be unplugged and it acts the same (immediate fault).

@herbst: I'd be happy to help debug this. I've got an outrageous art project in mind this camera is perfect for, and I'd rather help get this working than make my own plugin.

Thanks all!

metrowave 14/12/2012 - 22:22

It's very strange that it runs sometimes here. One last suggestion. Un-register the vvvv using the crack file and re-register it then start the vvvv.exe first. Perhaps the order of this counts. But I don't see how, just a random try.

@herbst: help with this please it can be potentially a very good patch, especially that DS325 is USB only, hence portable.

catweasel 17/12/2012 - 17:41

I've tried de-cracking an re-cracking, I've started v4 first, and put the folder in the v4 root, still no worky :(

metrowave 20/12/2012 - 03:51

What is your installed version of Intel Perceptual SDK? I'm still using intel_pc_sdk_intel64_5057.msi and I haven't installed the latest one which is intel_pc_sdk_intel64_5831.msi maybe that's the problem.

metrowave 25/12/2012 - 02:13

I just tested the DS325 with the new vvvv_45beta29_x64 and 32bit. it worked fine but when I shut on patch the next one won't run unless I quit vvvv and start again. I managed to test all of the patches.

mediadog 26/12/2012 - 00:25

Ahhh, yes, that's why I listed I was using 5831 in my initial posts, I thought a PCSDK mismatch might be the problem.

Unfortunately, Intel does not offer specific downloads that I can find, just the latest which is 5831, so no way for me to try an older one. Can someone post 5057 here, purty please? Or can anyone confirm things working with 5831? Thanks folks!

mediadog 02/01/2013 - 22:52

SUCCESS! This plugin does require the first SDK beta, not beta2. After some thrashing, I found it here:

http://registrationcenter-download.intel.com/akdlm/irc_nas/2808/IntelPerceptualComputingSDK-Beta.zip

Uninstall the previous PCSDK, remove the PCSDK folders, install this, and it seems to work with 29 with no further thrashing.

Wheeeeee!

metrowave 03/01/2013 - 07:04

Excellent so I shouldn't update my SDK to the next version? I'm glad it works for you now, perhaps you can improve this patch and if interesting share it. I know not too many have the DS325 camera yet, but I like the little thing, especially its portability.

alpaykasal 04/01/2013 - 03:06

is anyone else having this problem?

i installed the beta1 sdk as linked in this thread, tried vvvv and it didn't work, but neither did any of the depth related samples that installed with the SDK. the harr tracking and landmark distribution worked, but no depth demos. the camera info exe says it cannot find the camera. it looks fine in the windows device manager.

i tried it on my big beefy machine, and also my laptop. both are win7 64bit. same deal.

beta2 samples worked fine when i uninstalled beta1 and tried beta2.

i went back to beta1, same deal... no camera working in the samples, and along with that, no vvvv use either.

any suggestions?

alpaykasal 04/01/2013 - 03:09

additionally, thank you @meso and/or @herbst for your efforts on this.

also, any chance of seeing beta2 support? because then i'd be all set :)

metrowave 05/01/2013 - 05:35

I'll try to upload the SDK version that worked for me, but I think it is the first one as mediadog mention. I'll post the link here shortly.

alpaykasal 05/01/2013 - 07:08

Thanks... if it is the one linked in this thread, that is the one i tried. i hope you do have a different one. i'm not sure what to do next.

i found on the intel forums that some ppl had trouble in the past unless they disabled their onboard webcam (i guess it will show up as id 0 to opencv)... it didn't help me.. but i am posting that solution here in case it can help someone else.

metrowave 06/01/2013 - 19:53

Here is the link to the original Intel SDK:

http://www.4shared.com/zip/Fk4HGTMN/IntelPerceptualComputingSDK-Be.html

I hope it works for you.

alpaykasal 07/01/2013 - 12:39

thanks metrowave, i wish i had my camera with me now, but i'll be able to give it a go later today. thanks again.

catweasel 10/01/2013 - 15:49

The first beta works for me now too, thanks guys!

zeos 11/01/2013 - 18:22

Hi vvvvolks,

I just installed the Intel Driver (beta1) 32bit from metrowave's link,
but when I run the examples I got that:

 c:\Program Files (x86)\Intel\PCSDK\bin\win32>gesture_viewer.cs.exe
 Failed to locate a capture module

in vvvv I get exception

Any ideas

Thanks!

alpaykasal 20/01/2013 - 00:28

Hey everyone, i found out my camera's firmware is definitely not backward compatible with beta1... so that may mean some of you will have trouble getting this vvvv patch up and running as you will be locked into beta2 as I am.

with the help of Seth Gibson (Intel) and Justin Maurer (coworker at http://Supertou.ch ), we got an app written in Cinder that is based on beta2. it simply spits out OSC for X and Y data off of every finger. I am using it now. fun stuff. I will share it as a contribution soon, as soon as it is less primitive looking. I'll also make an effort to learn how to make it a node (it currently relies on a config file for things like host and udp port, etc)

Stay tuned.

metrowave 20/01/2013 - 00:59

Good stuff, Nice work!

I was also thinking of OSC for sound generating making a gestural noise synth with the DS325.

alpaykasal 20/01/2013 - 01:18

my first goal is sound triggering... samples and synthesis... and I must say, this camera does not disappoint! the Kinect was never good for this because of the lag. it was ok for graphical onscreen stuff but when a drum sound drops a half second after I expect it to, it feels very very broken. the ds325's response rate is amazing! really good for music. though it gets really confused on id'ing the different fingers. it tracks them all really well but gets confused with which is which. I had hoped to use index finger to hit a hit-test area as a sound trigger, then maybe rotate 2 fingers to tweak the sound. sadly, it confuses the fingers too often for this to be useful.

Still, I will take that fancy response rate and make something useful. so I am happy.

I'll share this stuff sometime this week. on vvvv.org and git.

herbst 30/01/2013 - 17:01

So everyone, updated to beta 2. Seems to be a lot faster and more stable. Currently, the download for the voice recognition/synthesis addon from beta 2 is broken, but I hope it will work again soon, so I can incorporate it.

metrowave 30/01/2013 - 21:08

Thanks a lot herbst. great efforts, so this new update is for the latest Intel® Perceptual Computing SDK 2013 Beta. Looking forward to testing it, have to upgrade the SDK first. I think I do have the voice recog/synthesis v.2 addon, it's 524MB. with Intel's permission I'm uploding it on 4shared and will post the link here, if you don't have it you can try that first.

Edit: here is the Intel voice addon SDK:

http://www.4shared.com/zip/hxjBKcL3/PCSDK_Beta2_Voice_Addon.html?

mediadog 03/02/2013 - 00:44

Most excellent! Thanks herbst! It didn't work when I installed the intel64 SDK2 version, which I thought installed both the 32 and 64 versions. So I uninstalled and installed the ia32 version and that works! Muchos gracias amigo!

elektromeier 26/03/2013 - 18:59

intel sdk beta3 is out. any chance to get the plugins updated?

metrowave 28/03/2013 - 16:31

bump

sonostrano 09/04/2013 - 11:46

not working anymore :(

metrowave 24/04/2013 - 02:11

There is a new 2013 major version?

http://software.intel.com/en-us/vcsource/tools/perceptual-computing-sdk

Intel Perceptual Computing 2013 SDK installation window

herbst 07/05/2013 - 02:38

Sorry for letting you all wait - didn't have access to such a camera for quite some time and finally bought one for myself. So, here are the changes to make the release version work. And I added voice recognition support!

Please test, as I had to do quite some changes and didn't test very thoroughly.

colorsound 07/05/2013 - 16:28

hello thank you for the update.

I tried all the help patches,

i got working the voice recognition. At first it was showing strange letters but later started to work quite good with lots of words and phrases.

The face patch it,s the only one that got the camera to turn on the green light.
In this one i saw some activity a square in the left corner of the renderer sort of responding from the face.

The rest did not work.

I tested with last alpha 29.5

metrowave 09/05/2013 - 01:47

Thanks again herbst, everything works well for me using alpha29.3 except that the help patches work one at a time, meaning after closing one you have to quit vvvv before starting another one of DS325 help patches.

The voice recognition and the accelerometer effect are very good and interesting indeed. The face recognition also works.

@colorsound, just retry it but quit vvvv and restart between the patches, also the lights on DS325 is not always on the same way, but the unit works.

colorsound 10/05/2013 - 10:13

hi thanks for suggestions, i have tested with other computer installing a fresh driver and vvvv but still not working , maybe my device is malfunctioning. also opening close v4 for each help patch.

colorsound 10/05/2013 - 10:16

although camera works with the D,fusion studio computer vision from intel

NEON 22/07/2013 - 16:58

Hello Guys,

did you already manage it to use the face recognition in VVVV?
I got the Sample in the SDK working, but i am not sure, how you could implement that feature in VVVV. Any Ideas on that? I want to save different Persons (give them different IDs) and want to recognize them later.

Great if somebody could help or even send a testpatch ...

Thanks in advance

NEON

gaz 05/08/2013 - 16:02

Hey

is it possible to display the video feed from the RGB camera while at the same time accessing the sensor data?

kennyallau 08/11/2013 - 07:08

Hi everyone,

@herbst, this is a very useful patch, great work!

I have the same question regarding the RGB feed from the cam; How do I access it?

It would be great to have a pin for rgb output.

gaz 08/11/2013 - 17:44

Kennyvallau

Herbst said it is possible, but needs additional development. If you need the addition for a commercial project it may be an idea to fund the development. I'm hoping to have a project that needs it soon!

colorsound 18/10/2014 - 12:08

hi guys , is there any update or plans to update for beta33 and DepthSenseSDK-1.4.3.1527-VS2010 or with iisu?

cheers

motzi 23/10/2014 - 23:19

hey,
does anyone have an offline installer for the intel-sdk? intel took them offline :(

thanks

metrowave 26/10/2014 - 00:51

the older version is here, if you look above here on this post, there is the link for audio SDK as well:
http://www.4shared.com/zip/Fk4HGTMN/IntelPerceptualComputingSDK-Be.html

catweasel 09/05/2018 - 21:58

I;m guessing no one still has this sdk installer?

metrowave 11/05/2018 - 10:57

@catweasel this is the old version I found :
https://www88.zippyshare.com/v/m5h9GVgj/file.html
have you also checked here (I think this won't work with the older camera):
https://github.com/IntelRealSense/librealsense

catweasel 11/05/2018 - 12:33

Thanks I'll give it go! And no I dont think they're still supported, they're not on the list anyway!

catweasel 20/05/2018 - 20:12

00:00:33 : Unable to initialize the PXCUPipeline
With the sdk you linked to :( thanks though @metrowave

metrowave 20/05/2018 - 21:15

@catweasel, think I found the one you're looking for:

https://userscloud.com/842a4fvw3jui
https://userscloud.com/jrm61esfs9sx
https://userscloud.com/dbffimu2q7n2

These are 2014, depth camera manager and SDK and runtime, I had to use tricks to find them on my drives, hopefully useful ;)

DmitryKoa 27/03/2021 - 07:35

thanks

Plugin for Softkinetic DS325 / Creative Interactive Gesture Camera with Intel Perceptual Computing SDK

about

download

Shoutbox