» CamShiftTracker (FreeFrame DShow9)
This site relies heavily on Javascript. You should enable it if you want the full experience. Learn more.

CamShiftTracker (FreeFrame DShow9)

Info This node comes with the addon pack. Get it here.

Here you are supposed to see an image (rendered with SVG) describing the pins of this node. However, this does not work with Internet Explorer. You may want to consider using another browser, like FireFox, Chrome, Safari or Opera that do support SVG.


related discussions

start a forum thread about this node

about CamShiftTracker (FreeFrame DShow9)

open source


When you use CamShiftTracker the most important step is the fine tuning of the tracking parameters.

These are:

  • Size and orientation of initial ROI
  • Saturation min, Value min and max

To achieve an optimal tracking output, these parameters have to be adjusted to the lighting situation of the video scene (or vice versa).

If possible, turn off automatic gain control (AGC), automatic brighness ajustment etc. on your camera.

During fine tuning of the parameters you should have Show Backproject set to 1, so you can see which pixels of the image are considered as belonging to the object (i.e. those which are white). Also, set Show ROI to 1, to see the search frame.
When nearly all pixels in the area of the object are white and the rest of the image is black, you're done.

Like a good linear minimizer, adjust one parameter at a time, then continue with the next one. Playing around will give you a feeling for this...

Be sure that your object lies in or, ideally, fills the initial ROI when you initialise the tracker by banging Init Tracker. You will get the best results by using a white background. Since white (background) pixels have a very low saturation, you can kick 'em out by increasing the 'Saturation min' pin value.
Adjust Value min and Value max to the range of your object brightness:

dark very low V1 (near 0.0) low V2
bright high very high V2 (near 1.0)
different shades low high

After each tuning step, init Tracker again to submit the tracking values and refine the object search.

If all that doesn't help, you might have to improve the lighting situation.
Think about illuminating the object with a lamp, or adding a diffuser if the video image is too dark and the colors don't come out right.

anonymous user login


~2h ago

mrboni: anyone in london free today / tomorrow and up for helping with some v4 dmx / motion tracking?

~21h ago

StiX: everyone should use VObject. check my contribution for basic material to take apart and learn!

~22h ago

m4d: evvvvil: you, sir are a hero! \o/

~3d ago

sebescudie: nvidia deep learning introduction : https://www.youtube.com/watch?v=6eBpjEdgSm0

~3d ago

evvvvil: I learned this shit the hard way, tried so many exports... Anyway go get advanced shaders p2 workshop here: https://youtu.be/rRS0LY37Db8

~3d ago

evvvvil: After Effects CC corrupts the audio if audio was recorded in mono but you're trying to export in stereo. Anyway enjoy bruh-bruhs.

~3d ago

evvvvil: Yes guys, I uploaded the advanced shader p2 video but it had no sound, tt was really FUCKING TEDIOUS fixing the audio track.

~3d ago

Noir: thanks abduct

~3d ago

esnho: great!