Sunday, April 15, 2012

     

Controlling Mindstorms with Kinect



Ok, I like many people have seen these videos or have managed to come up with the idea of making the Kinect for Xbox 360 somehow working with the Lego Mindstorms NXT. So I have searched all over the internet to try to find a tutorial of some kind and found nothing. But wait! After playing some video games and doing indirect research i have found a way for people like me to do this for themselves. Below I have made a tutorial for people to get this project up and running and working. Whether its for a project at school or something you wanted to do around the house, this project will BLOW. YOU. AWAY! Below is a video of someone using the kinect to drive around their NXT. Its not how I am going to show you but, It will work and do just as great.




Requirements: You will need

  1. A PC running Windows XP, Vista, or 7.
  2. A PC with a bluetooth connector or USB BT dongle.
  3. A Lego Mindstorms NXT Kit (education is preferred)
  4. A Microsoft Kinect for XBOX 360 or Windows (If you have the 360 version, you will need the adapter with the plug and USB.)
  5. A PC with internet connection

Steps:
  1. First, you must download and install the Microsoft Kinect for windows SDK. (It doesn't matter if you have a XBOX 360 Kinect it will still work.) Click Here to download
  2. Second, you must download a program called FAAST. What this program will do is allow your movements on the kinect to translate to functions on a keyboard or keypad. Click Here to download
  3. Third, Make sure you have the Lego Mindstorms Mindstorms NXT software program open and running. If you don't please open it.
  4. Next, Once the program is open go to the NXT remote controller under the tools menu.
  5. Turn on your NXT and under connections in the remote control, establish a bluetooth connection with the NXT. If you don't know how, Click Here for the instructions. Scroll download until you see the heading Bluetooth.
  6. After you have established the connection, Connect your Kinect to your PC. and allow the drivers to install from the SDK and the Windows Database.
  7. Once the drivers have been installed, Open the FAAST program that you have downloaded earlier.
  8. From the  Tracker dropbox menu, select Microsoft so that the program will know that you are using the Kinect with the drivers you've installed.
  9. Then, click connect. This will connect start up the Kinect have it ready for programming with the FAAST program.
  10. Next click Gestures. Here you can make the movements you do that are recorded by the Kinect could translate to a key, or multiple keys on a keyboard. But the make sure that movements that you can select from can act as a key that the remote control program can recognize. Below are keys that the remote control program can recognize.
      1. Dpad Left = NXT will drive left
      2. Dpad Right = NXT will drive Right
      3. Dpad Up = NXT will drive forward
      4. Dpad Down = NXT will drive backwards
      5. Tab = Reversed Action of motor in port A of NXT
      6. Space = Normal Action of motor in port A of NXT
      7. W = Increase speed
      8. S = Decrease speed
  11. Once you have finished the programming of your selection of movements to keyboard keys, You can now click the Start Emulator Button. Once you click this button you can NOW control the NXT however you had programmed it.
  12. Last, Enjoy! I hoped this Tutorial helped a lot and i'll try to make more!

1 comment:

  1. i can control the robot using faast skeletal tracking. how do i make the robot follow me around using faast?

    ReplyDelete