Friday, April 3rd, 2009, 518 days ago

Hand gesture detection and recognition using openCV

handrect1

handrect2

handrect3

Related Posts: Hand guesture recognition using openCV

Clicking the pictures and the detailed previews will display which show the hand contours extracting from video capture. These pictures illustrate the results of color based segmentation for hand gesture detection ( not recognition yet ). it is a  real time programme,  however, in this demonstration, the programme still depends on environments’ light , because of the color based segmentation method. If, combinned with motion detection and background substraction, it supposes to be robuster.

Posted in HCI, Research | Share on facebook twitter digg delicious

52 Responses to “Hand gesture detection and recognition using openCV”

  1. Wayne says:

    Hi andol. Great work! How did you finally manage to detect the contour of your hand with the noise and stuff? From an older post it reads “But the noise is easy to take off”… how did you do that?

    • Andol says:

      Well, i used two steps to get the noises away which include using blur to smooth big contours and to melt numerous small contours, secondly, according to the hand characters, select largest contour as target.

  2. bill says:

    Hi. Will you be posting your code for this as you did for the circle detect? In the circle detect, there are two includes for math.h. Not being a C++ coder, I wonder what the differences in syntax between ” and < are for the math.h include files. Cheers.

    • Andol says:

      Oh, the twice includes of math.h in circle detection codes was a mistake. You can delete one of them and debug it again, that would be fine, no different. About the code, yeah, i ll update it soon.

  3. Name says:

    can u share the source code for this?

  4. Andol says:

    The codes are here: codes

  5. fireball says:

    hi li,in the page http://www.andol.info/hci/1097.htm
    I dont find the gesture recognition code , I have download hsv.cpp in the “sharing code” page which is not the one showing in this page.

    • Andol says:

      Oops, sorry for that some posts were lost by mistake couple days ago while debugging. So that post number is not previous one with source code. Big apologies.

  6. Jose says:

    Me podrias ayudar, estoy tratando de hacer algo parecido, mas segun yo voy en la segmentacion

  7. Amir Hakim says:

    plz Andol
    i do a project that detect the hands in a difference states so w need ur advice how do this ??/

  8. ostrov says:

    Thank you,
    very interesting article

  9. quarks says:

    hi would you please show this code ,i need this kind of code for my implementation

  10. kabir hossain says:

    fantasfic work ..really helpfull.

  11. gem says:

    hi i need this codes ,the codes u specified is not avilable woud u helo me

  12. Angel_Gurl says:

    Hi Andol! I’m new to opencv…lately i’ve been trying to do hand detection (detect hand and place a circle around it)…can you please help me? do i need to use haar classifier?
    Thank You

    • Andol says:

      haar classifier is used to detect specified and predefined gestures, it is stable and effective once the training is finished. If you can get sufficient examples both positive and negative it would be very recommended to do so.

  13. Ashutosh Mukherjee says:

    I m doing the exact project in my engineering final year project but i have not used HAAR cascades but i have used skin segmentation to filter hand skin…. wud be glad if u can share ur email address so that i can clarify my doubts….. need some guidance in hand gesture recognition.

  14. Ashutosh Mukherjee says:

    Sir i have mailed u on ur hotmail account with some screenies and our exact problem…. we r anxiously waiting for ur reply…

  15. ritika says:

    thank you…

  16. Alexandre says:

    So far you have been very helpful with your recent articles and I would like you to know that I am grateful for your sharing.
    Hi! I was wondering if you might have any insight as to how I might go about identifying each finger and the thumb. Do you know what I could do next?

  17. Dhruv Adhia says:

    I can share finger detection with you guys if you want.

  18. Jonathan says:

    @Dhruv it’d be wonderful if you could share it here! i’m pretty bad at programming but i need a finger/hand detection with tracking, any of u could help me out? my emails jona_lim87@hotmail.com any help is really really appreciated

  19. mzy says:

    hi,Andol, when i test the program you wrote in http://download.andol.info/hsv.cpp I cannot get any boundary shown above, is the program latest, my circumstance is vc++ 6.0 opencv1.0, looking forward to your reply, thanks.

  20. Ansam says:

    Hi Andol, I couldn’t find the source code for the gestures !!! I found just a code for Hand Detection.
    Please I need a link for it.

  21. kutu says:

    Thank you Sir for your code.it helps me a lot.But my problem is i have to find the trajectory of the moving hand.please help me

  22. kutu says:

    hi,sir.i am able to find the centroid of hand in real time.Now i have to find the trajectory of the moving centroid.please tell me how can i draw the trajectory

    • Andol says:

      Hi Kutu, i recommend a motion detection example in openCV’s installation folder ‘examples’, check it out, the source code should be included there.

  23. Sarang says:

    hi andol ….will u please tell me can hand gesture recognition be possible with what you have stated can it be useful for controlling applications like office, media players……..
    .

    • Andol says:

      @Sarang it is possible to use hand gestures to control applications like media players but still long way to go, here what i ve done is only to detect the hand shapes and the key point is of the gesture segmentations and recognitions.

  24. Sarang says:

    is openCV that powerful

  25. Sarang says:

    what if we compare matlab and openCV which is better for hand gesture detection…..

    will you please tell me the prerequisites one need to know to implement hand gesture recognition system

    • Andol says:

      @Sarang openCV is a open library for computer vision and Matlab is an application environment such like Visual studio for algorithm designs and validations, that means, openCV can be used in Matlab as long as including relevant files, also, openCV can be used in Eclipse and other development environments.To recognise accurate hand gestures, in my opinion, first of all you should extract every hand gesture, and then give each detected gesture a trigger of certain operations.

  26. naj says:

    hi,,! sir,, do you have some experience on sign language detection..can you please share your knowledge,, just want to know how will i recognize the different sign language.. is there a code in opencv for it sir? thanks a lot.!:)

    • Andol says:

      @Naj would you provide more explanations of what types of sign language detection you use?

      • naj says:

        Sir,i will be using this approach,http://sandarenu.blogspot.com/2008/06/opencv-computer-vision-library.html
        ,the problem is i dont know how will i recognize the different sign languages, for example i use sign language letter “B”, how will i recognize it as letter B or how will i use the algorithm to recognize the sign language letter as “B”. thank you sir.:) thanks for repyling too:)

        • Andol says:

          @Naj Your chosen method to detect signs is understood as Haar Classifier which requires huge trainings with both positive images and negative images. You need to use these sample images to train your system, such like 100 sample images with the letter B and another 100 images without the sign B. Hope this helps.

  27. naj says:

    Sir..i see..ok sir.. thanks for the great info.. :) ohh..btw sir, just another question, for example. ill use sign language letter “B”, how will i make an output of it. for example, an output text “B” on a textbox. :)

    • Andol says:

      @Naj about openCV output, there are functions in openCV library to out put the texts, images, and even writing the results into a .txt file. Check the openCV manual this will be found easily.

  28. naj says:

    ohh..ok sir.. thanks for helping me again:) gotta check it out ..:)

Leave a Reply

You can use these XHTML tags:
<a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>