» Diploma.CharacterAnimation
This site relies heavily on Javascript. You should enable it if you want the full experience. Learn more.

Diploma.CharacterAnimation

The idea

The aim of this thesis is to design a framework for vvvv, which enables developers to deal with character animation including skinning, skeletons, etc., easily.

It should be determined, whether it is possible to transfer character animation specific terms and workflows from animation packages (e.g. Maya) into vvvv - and of course implement a possible solution in a set of vvvv nodes.

While one common case of using character animation in vvvv might be importing a character rig from an external source using e.g. the Collada Importer, this diploma should also find ways to create character rigs inside of vvvv dynamically.

Current State

The result is a set of 10 nodes implemented using vvvv's C# plugin interface:

  • CreateJoint (Skeleton)
  • Joint (Skeleton Join)
  • SetJoint (Skeleton)
  • GetJoint (Skeleton)
  • GetJointTransform (Skeleton)
  • SelectJoint (Skeleton GUI)
  • InputMorph (Skeleton)
  • MixPose (Skeleton)
  • AutoSkinWeights (Skeleton)
  • SkinDeformer (Skeleton)

Watch THIS VIDEO ON VIMEO to see a quick compilation of some results which evolved while playing arount with those nodes.

Download

The developed nodes are now available for download: Skeleton.zip. Just place the files contained in the zip into the plugins-directory of you VVVV folder. Remember, that you need Microsoft .NET Framework 2.0 and SlimDX installed, to use the nodes.

Alternatively, you can checkout the latest version of the sourcecode from the VVVV plugin repository on Sourceforge:

https://github.com/vvvv/vvvv-sdk/tree/develop/vvvv45/addonpack/src/nodes/plugins/Skeleton/SkeletonNodes
and
https://github.com/vvvv/vvvv-sdk/tree/develop/common/src/core/Utils/Skeleton

Tutorials

There are two articles about how to use those skeleton nodes here on the VVVViki, as well as on www.quasipartikel.at:

Known Issues

There are still a lot of issues with the nodes described above. I set up quick bug tracker at www.zauner900.net/bugs/index.php, where there are listed upcoming tasks to do. It's public, so feel free to add issues, if you want to give feedback. However, some of the major issues are:

  • Constraints (or joint limits): In the initial implementation there has been a way of setting constraints for each joint, to define, how far, and aroun which axes a joint can move. However, this has been in combination with saving joint rotations as euler angles. In the meantime, those euler angles have been replaced with quaternions. I haven't stumbled upon a simple way of defining limits for quaternion rotations - any hints very much appreciated.
  • Performance: There's definitly a lot of potential in improving performance. When several InputMorph (Skeleton) nodes are connected in serial, framerate drops. This is caused by the fact, that the whole chain of nodes has to recalculate complete skeletons, as soon es only one joint changes. There is need of a smarter way to handle this.
  • Inverse kinematcis would be awesome.
  • Automatic computation of skinning data: Besides being very slow, AutoSkinWeights (Skeleton) only performs rigid skinning, which results in un-smooth deformation in joint regions. This might be ok for prototyping and in the cases, the result should look noisy anyway. But for more advanced projects, AutoSkinWeights (Skeleton) should also provide a soft skinning algorithm. Using heat maps as proposed in section 4 of Automatic Rigging and Animation of 3D characters looks promising.

anonymous user login

Shoutbox

~11d ago

fleg: This Tuesday, Cologne: exhibition opening of "interwoven", textile disinformation patterns created with vvvv. https://fleg.de/news/exhibition-interwoven

~25d ago

manuelgonzalvez: Assimp nodes all broken afted Win Update w/exception "COM object that has been separated from its underlying RCW(...)"

~25d ago

manuelgonzalvez: @levi thanks would love to! anyway managed to get something similar working based on forum search and anthokio's patches.

~25d ago

levi: @ravasquez thanks. 31.2 x86 verrion worked. @manuelgonzalvez i have a dx11 projectTexture if u a want.

~26d ago

manuelgonzalvez: Anyone has a dx11 port of "projectedTexture" dx9 fx for projection mapping?

~26d ago

manuelgonzalvez: Anyone has a dx11 port of "projectedTexture" dx9 fx for projection mapping?

~27d ago

ravazquez: @levi not sure bout the ImagePack, but I believe VL.OpenCV should give you the same tools and should work with beta just fine

~27d ago

levi: anyone knows of a VVVVpacks.image that works for elliot's projector calibration patches?x64,dx11. always crashes v4 on solve.

~1mth ago

Lorenz: VJing with GIFS: https://lorenzpotthast.de/gifjockey/ A fun little side project, that I first prototyped in v4 and now turned web-based ;)

~2mth ago

schlonzo: finally fixed in 4.8 nice1