Using Brekel Kinect plugin and tracker (www.brekel.com), and Motion Builder’s physics simulation, we can interact with 3D characters in real-time without any programming magic.

I’m playing around with creating some sort of virtual dressing room I guess.

Pumping Realtime mocap data into Maya using Ikinema plugin.

Using the iPad as a trackable virtual motion capture camera. Currently working on getting frame-rate and interactivity speed up to par. Also working on getting a real-time OGL 3D viewer on iPad which accesses the data stream from Blade.

By doing this, the iPad does the heavy work and any number of viewers can use the virtual camera system with just an iPad or iPhone.

Update:

The system now works without a mocap stage or any external tracking. Everything is performed on the iPad, including absolute position and orientation.

This is a first attempt at combining a projection film on my office window with a projector, and a Wii-mote for IR pen tracking.

The goal is to make a large multi-user window surface in our main hallway.
More to come!

Using 2 monitors, Maya’s real-time, high-quality stereo display capabilities, and two front-surface mirrors at 45 degree angles, I’ve built a super high resolution stereoscopic viewer. A really easy way to get an idea of what a 4K 3D effect might look like on a budget. (Of course a single monitor and some 3D glasses would work too).

I installed this in the viewing window of our mocap stage. One can then look into this display through semi-silvered mirrors mounted in front of the glass and get a real-time 3D view of the CG characters overlayed on the actual actors on the stage.

Great for previz, direction, on-lookers, and fun!

Simple camera constraint in motion builder allows Brekel Kinect plugin to control first person view in real time.

Could also use to control angle of view on an interactive tabletop.

This must have been done already, but I wanted to try it.

Some artifacts on edges due to lower resolution of Kinect and occlusion caused by only one angle, but not too shabby! I could temporally smooth and filter the data over a coupe frames to clean it up I think.

I can see this being used for plenty of things, like instant depth mattes sans green screen, post fog effects (could easily be real-time effects too).

I recorded the color and depth streams as video using Brekel toolkit (lots of free stuff out there for this), then brought them into after effects and used the gray-scale depth image as a mask for blur effect on the color image.

Enjoy me looking like a dork!

A test setup of our virtual overlay window in FIEAs mocap stage. This was a quick test utilizing an effect called “Peppers Ghost”. I’m just projecting the 3D view onto a wall behind the viewer. The reflection shows up in the glass door window as an overlay on the real stage.

Great for playback and director review in the space.

Thanks to nhAnimOnline (YouTube username) for the test horse animation.

In the mocap studio using Maya and Ikinema Realtime mocap data stream to update a flat image and simulate three dimensionality from the perspective of the viewer or video camera, which is being tracked by the Vicon system.

Basically an expensive version of Jonny Lees Wiimote user tracking demo, but on a flat table.

Can be used to play rts games, view maps and city layouts or even cheap glasses-free medical or industrial training.

I just want to make a real time version of table top Operation!