Skip to main content

Gesture Interface

Equipment: Kinect & TV

 

Set up: 

  1. Turn on the computer

  2. Open the Gesture Interface file

  3. Hit “run”


Controls/Navigation: 

  • Right arm to swipe right

  • Left arm to swipe left


Gameplay: 

  1. Have the person stand in front of the Kinect so that the program registers them. In the middle screen, they should be outlined as a red stick figure and have two red, gridded panels by their sides, with one on the left and other on the right.

    1. If they don’t have the panels, they may need to raise one or both arms into the air to get the software’s attention.

  2. The person then needs to press the panels with their arm(s) to signal for the program to swipe through different photos with information about the photo and the experience it relates to.

    1. There are photos on the left and right screens with small blurbs of information about the photo at the bottom and the experience it’s for at the top.


Notes about the arms:

  • Using long sleeves as arms works with the experience. The system will track the long sleeves as arms even if there aren’t any actual arms in them, so the user just needs to swing their body to get the sleeves in the air and aim them at the panels to interact with the experience

  • Elbows do not reach the grid. If someone is missing their arms up to their elbow and isn’t wearing long sleeves, they can’t interact with the experience very well