The Research Experience for Teachers Program /

Subject Area(s):Mathematics, Statistics, Anatomy, Computer Graphics Courses, Computer Applications

Computer Science Tools:Xbox One Kinect, ImageJ Software, Body Tracking Software, Microsoft Excel (or other spreadsheet software)

Activity Title: “Skeleton Tracking with Microsoft Kinect 2.0”

Grade Level: 9-12

Time Required: 90 minutes

Recommended Group Size: 2-3 people

Summary: In this activity, students will use an Xbox One Kinect, Body Tracking Software, and ImageJ to measure angles between bones (defined as a 2-tuple of relevant joints), and to determine various body proportions. Students will analyze collected data, using spreadsheet software, to look for connections between each partner’s joint proportions. Students should then explore ways to differentiate people using only the data collected by the sensor.

Computer Science Connection: Computer scientists often have to analyze data to make connections and to look for relationships among data sets. Computer scientists who work with image processing software to aide in identification must use clues from anatomical shapes and motions in videos and pictures.

Keywords: Measurement, Angles, Ratios, Proportions, Data Analysis, Image Analysis, Anatomical Structure

Pre-Requisite Knowledge:Some knowledge of spreadsheet software, and the ImageJ tool.

Learning Objectives:

Students will be able to:

  • Compute ratios
  • Apply proportions
  • Analyze data sets
  • Draw inferences from data sets
  • Use spreadsheets for data analysis
  • Make accurate measurements using computer software
  • Use technology appropriately to solve problems

Materials List:

  • Windows PC (Windows 8 and above)
  • Xbox One Kinect (setup instructions)
  • ImageJ (download link)
  • Kinect 2.0 Runtime (Provided in the associated file)
  • Body Tracking Software (Provided in the associated file)
  • Microsoft Excel (or equivalent)

Common Errors:

  • Head location is considered the bridge of the nose and not the top of the head, thus, determining the height of a person through Kinect data is notanaccurate representation of a person’s height.
  • The Body Tracking Software tracks up to 6 skeletons simultaneously, but the only joint data that’s collected is that of the person who signaled for the software to save data.
  • Accurate joint data is collected only if the Kinect sensor can see all of the joints it’s tracking. Joints that are not being tracked due to being out of the view of the sensor will cause the Body Tracking Software to draw a red line where the clipped joints are located.
  • Skeleton images and joint data are saved in the skeleton and data folder, respectively. If these folders don’t exist, or if the joint data file is open while the user is trying to save additional data, the save will fail. The directory structure is established correctly in the associated file, so no work is needed unless the folders were changed.