Tag Archives: works

Kinect SDK MTS Expo Session

Posted by Zozo on

Hello everybody!

18 – 19 October 2011 I was visiting Microsoft Technology Summit Conference, and I had been invited to make an Expo Session about Kinect SDK.

I had some problems with topics choose  – I had only 3×15 minutes. I took IMO best ones:

  1. Basics of Kinect SDK, How it works and something about sensors + DEMO – sensors and skeleton capture
  2. Basics of audio in Kinect, How microphones works + DEMO – beam and audio source tracking. I omitted speech recognition, because environment of expo hall was very loud and it simply was not working.
  3. Business Applications based on Kinect SDK + DEMO – introduction to Kinect Toolkit and HoverButton Control.

Kinect Toolkit is very small right now and I think – if we want to develop serious applications, we should wait for next version.

Slides from presentation: Download here (PL)

In demos I’ve described some snippets:

First demo – First Kinect application:

Runtime nui = new Runtime();

Definition of NUI – first, what we should do to start writing program for Kinect.

nui.Initialize(RuntimeOptions.UseColor | RuntimeOptions.UseDepthAndPlayerIndex | RuntimeOptions.UseSkeletalTracking);
nui.VideoFrameReady += new EventHandler<ImageFrameReadyEventArgs>(nui_VideoFrameReady);
nui.DepthFrameReady += new EventHandler<ImageFrameReadyEventArgs>(nui_DepthFrameReady);

nui.VideoStream.Open(ImageStreamType.Video, 2, ImageResolution.Resolution640x480, ImageType.Color);
nui.DepthStream.Open(ImageStreamType.Depth, 2, ImageResolution.Resolution320x240, ImageType.DepthAndPlayerIndex);

Initialization Kinect sensors.

void nui_VideoFrameReady(object sender, ImageFrameReadyEventArgs e)
{
      NuiVideo.Source = e.ImageFrame.ToBitmapSource();
}
void nui_DepthFrameReady(object sender, ImageFrameReadyEventArgs e)
{
      NuiDepth.Source = e.ImageFrame.ToBitmapSource();
}

Sensors frames event handlers – connecting sensor streams to images.

nui.NuiCamera.ElevationAngle = 0;
nui.Uninitialize();

Control elevation angle by simple slider.

And this is finish of first Kinect application. Next steps is to show how skeleton view works, tell something about microphone sensor in Kinect and finally show how to make simple business app – using hover button and of course Natural User Interface.

Demo files (you have to install Kinect SDK first!): Download here