» OpticalFlow DX11 for real
This site relies heavily on Javascript. You should enable it if you want the full experience. Learn more.

OpticalFlow DX11 for real

effect gpu dx11 CV shader optical flow
Credits: vux, princemio, Horn and Schunck, Lucas and Kanade


This is my first contribution, if you have tips would be really worthy!

It contains Optical Flow solutions based on Horn and Schunck and Lucas and Kanade papers. I used them for my bachelor thesis, introducing intrinsic variations (5x5 kernel for derivatives or iterations in HS) and extrinsic (preprocessing and postprocessing) that increase the quality of the prediction. The results are given in RGB and vector representation.

Developed at Waltz Binaire http://waltzbinaire.com/


28.06.17 [10:30 UTC] by otosatram | 864 downloads

ggml 27/06/2017 - 23:48

hi! how is the rg texture accesible? OF texture looks black. thanks!

otosatram 28/06/2017 - 09:34

The rg texture is the output from the OpticalflowHS and OpticalflowLK, if you pre or postprocess it the colours will get softer, but should still be there. With a boost you should be able to visualize it. Tell me if it works!

mburk 28/06/2017 - 09:50


sebescudie 28/06/2017 - 10:39

wooooo thanks!!

princemio 28/06/2017 - 10:57

@ggml move ;)

ggml 28/06/2017 - 11:27

@prince cannot confirm

m4d 29/06/2017 - 11:11

spot on!

eps 30/06/2017 - 17:21

to see the texture one must scale it up (e.g. by hscb texfx)
obv the original values are pretty subtle

andresc4 06/07/2017 - 17:22

nice one!!
this is super usefull

anonymous user login


~3d ago

joreg: absolutely. if it is for a repo that is public, just submit a pullrequest. otherwise please start a forum thread.

~3d ago

benjawmino: @joreg I ended up figuring out BezierSegment yesterday, so nevermind! Tell me, could a user submit a help patch? :)

~3d ago

joreg: @benjawmino please elaborate on this question a bit in a new forum thread. otherwise it is hard to answer..

~4d ago

benjawmino: so are there no splines/curves in gamma yet??

~8d ago

skyliner: wanna do drone shows or applications? then check this super cool project of our man e1n

~12d ago

NoseBleedIndustries: Thanks Joreg! The few minutes I was able to see, very good workshops!

~12d ago

joreg: @NoseBleedIndustries please give us some days, we'll have an announcement soon...

~12d ago

NoseBleedIndustries: I could not assist the Node20 (workshops ) Any Idea when we will have access to the links of the recordings?

~14d ago

bjoern: unity has c# bindings for usd, under apache license: https://github.com/Unity-Technologies/usd-unity-sdk