Published on March 7, 2014
1 Microsoft Kinect for Human-Computer Interaction Prepared By: Patel Mihir B. 131060753015
Microsoft Kinect for HCI_________ 2 Presentation Objective: • • • • • Introduction How it Works Hardware and software Applications Conclusion
Introduction___________________ 3 Kinect (codenamed in development as Project Natal) • motion sensing input devices by Microsoft for Xbox 360 and Xbox One video game consoles and Windows PCs. • it enables users to control and interact with their console/computer as Human is game controller, through a natural user interface using gestures and spoken commands. • The first-generation Kinect was first introduced in November 2010. • Kinect builds on software technology developed by Microsoft Game Studios and on range camera technology by Israeli developer Prime sense.
4 • Kinect sensor is a horizontal bar connected to a small base with a motorized pivot and is designed to be positioned lengthwise above or below the video display. • RGB camera • depth sensor • multi-array microphone running proprietary software which provide Full-body 3D motion capture Facial recognition Full Skeleton Tracking Gesture Recognition Voice Recognition Capabilities
6 RGB camera -That stores three-channel data in a 1280 x 960 resolution at 12 frames per second, or a 640 x 480 resolution at 30 frames per second. This makes capturing a color image or video possible. infrared (IR) emitter and an IR depth sensor -The emitter emits infrared light beams and the depth sensor reads the IR beams reflected back to the sensor. The reflected beams are converted into depth information measuring the distance between an object and the sensor. This makes capturing a depth image possible. Multi-array microphone -That contains four microphones for capturing sound. Because there are four microphones, it is possible to record audio from a specific direction, as well as find the location of the sound source and the direction of the audio wave.
How It Works_________________ 7
Hardware & Software___________ 8 • Microsoft released Kinect software development kit for Windows 7 in June, 2011. • This SDK was meant to allow developers to write Kinect apps in C++/CLI, C#, or Visual Basic .NET by using Microsoft Visual Studio 2010. Similer software • “LibFreenect” for Linux machines • Google's released “Robotic Operating System (ROS)” • “OpenNI” is used on all OS.
Application___________________ 9 • Gaming Console and Gaming purpose Ex. Xbox 360 and Xbox one. • Robotic applications Ex. MIT and UC Berkley researchers teamed up to create a quadrocopter capable of autonomous flight. • Interactive science experiments Ex. team from the University of Konstanz in Germany paired the Kinect to help the blind navigate on their own. • Exercise and physical therapy • Language/speech learning Ex. Natural human-computer interaction with Kinect and Leap Motion • Home Healthcare / Tele-Medicine
Challenges____________________ 10 • Lots of variation in bodies, orientation, poses • Lots of data to recognize of different poses,body,weight.
Conclusion___________________ 11 • Kinect for Windows sensor and the Kinect for Windows software development kit (SDK) to develop and deploy innovative solutions for retail, healthcare, education and every area where Human computer interaction(HCI) is required.
References___________________ 12 • www.kinectforwimdows.com • I. Tashev, "Recent Advances in Human-Machine Interfaces for Gaming and Entertainment," Int'l J. Information Technology and Security, vol. 3, no. 3, 2011, pp. 69–76. • V. Tam and Ling-Shan “Integrating the Kinect Camera, Gesture Recognition and Mobile Devices for Interactive Discussion” IEEE International Conference • R A. El-Iaithy, J. Huang, M. Yeh“Study on the Use of Microsoft Kinect for Robotics Applications” IEEE International Conference. • Z. Zhang, “Microsoft Kinect sensor and its effect,” IEEE Multimedia Mag. • www.kinecthacks.com • www.openkinect.com
Gesture-Based Human-Computer-Interaction Using Kinect ... the recently developed Microsoft Kinect depth sensor to ... Human-Computer-Interaction ...
New Kinect for Windows to improve human interaction with ... Kinect for Windows. (Photo: Microsoft) ... from which human-computer interaction programs can ...
The Kinect for Windows software development kit (SDK) October release was a pivotal update with a number of key improvements. One important update in this ...
Kinect for Windows Human Interface Guidelines v1 ... world of Microsoft Kinect for ... building exciting human-computer interaction solutions you ...
We all know that children can learn from videos. But many educators have questioned the effectiveness of such learning when compared to the understanding ...
Microsoft Kinect Sensor and Its Effect ... the excitement behind the Microsoft Kinect ... Effect that potentially will transform human-computer interaction in
At the 2011 Blur Conference, which focuses on human-computer interaction, hackers demonstrated how they adapted the Microsoft Kinect to work for purposes ...
Microsoft Research blog ... hand tracker which can enable new possibilities for human-computer interaction ... standard Xbox One Kinect without any ...
Explore research at Microsoft, a site featuring the impact of research along with publications, products, downloads, and research careers. Store ...