Comments on: Hand detection using openCV

By: anil

anil — Sun, 22 Jan 2012 08:38:21 +0000

@andol
we r developing a virtual keyboard..
we want 2 give keypress interrupt to system whenever a particular hand gesture take place….
we used sendKey method in C#..
we r developing our project in C#..
will u plz tell us how exactly do it(keypress)..

By: Andol

Andol — Wed, 21 Dec 2011 15:37:38 +0000

@spiffy
have you got different gestures for left and right click operations?

By: spiffy

spiffy — Wed, 21 Dec 2011 14:37:29 +0000

hi andol
when will you reply me??

By: spiffy

spiffy — Sat, 17 Dec 2011 16:31:00 +0000

i am using c++ language

By: Andol

Andol — Fri, 16 Dec 2011 19:23:31 +0000

@spiffy
there needs two distinguishable gestures that are associated with left and right click. In that case, left and right clicks may need two other finger gestures, such like bending a finger.

By: Andol

Andol — Fri, 16 Dec 2011 19:20:42 +0000

@Spiffy
hi Spiffy, can I ask what programme languages do you use in your project, since there are slightly differences of pointer position control by using c, c++, c# or java.
cheers

By: spiffy

spiffy — Fri, 16 Dec 2011 18:36:48 +0000

hi andol
i am doing work on computer control using fingure movement in opencv.i have done till moving pointer by recognizing fingure movement.plz help me how can i perform left and right click?

By: spiffy

spiffy — Fri, 16 Dec 2011 18:22:58 +0000

hi andol.i am doing work on computer control using fingure movement.i have done worke till by decteing fingure movement of pointer can you plz help me how in i perform left and right click?

By: sam

sam — Sun, 23 Oct 2011 16:41:32 +0000

hey, i want to do hand gesture recognition in java. i tried it using JAI bt came to kno that it is under development. Will you please suggest any API using java that can be used for this purpose…..

By: Nareen

Nareen — Wed, 19 Oct 2011 14:50:02 +0000

Hi Andol,

I want to implement a patient monitoring system. The system should check whether a patient has taken a pill or not and also whether the patient has had water afterward or not. It sounds easy since I am thinking of using same glass and location and a well as already saved images of patient movements (gestures) while taking medication. I am new to programming and just came across OpenCV. I think by using opencv I can easily implement such a program. But I don’t know where to start from? What features of OpenCV do I need to use? I am thinking of capturing images from a webcam and comparing those images with already saved images to find any match. Any idea? Any help would be greatly appreciated. Thank you!

By: priyanka.s.awaraddi

priyanka.s.awaraddi — Sat, 15 Oct 2011 03:48:56 +0000

hi….
i’m presently working on finding the free empty slots in parking area…but i dont know any algorith to find the free parking area number….the parking slots have a fixed number…
please help me

By: Fyre

Fyre — Mon, 03 Oct 2011 18:19:23 +0000

Hi andol,
I liked your code very and i have similar project going on. It would be very nice of you if you just help me with the mouse controlling and clicking part. I have got the tracking and the center of gravity of the hand all i need to do is that i need to map the mouse cursor and its functions with the hand and its features. I am looking forward for left click with 1 finger right click with 2 fingers and scroll up with three fingers and so on . The movement will be done when there is no finger or when all 5 fingers are present.

Do help
Thnks

By: Shahrukh Khan

Shahrukh Khan — Sun, 14 Aug 2011 17:46:01 +0000

hi Andol,
i am Shahrukh Khan from india . I am working on a project which is will recognize hand gestures on the android platform. i figured you might help in a small tutorial on Introduction to javaCV+android. also if this is alot to ask for can you atleast tell me the approach to start using javaCV and hand gesture recognisation. i dont even know how to get the secondary camera feed from the android phone !!
for ex: http://www.eyesight-tech.com/
Thank you in advance (“,)

By: andrew wesa

andrew wesa — Wed, 22 Jun 2011 01:15:54 +0000

pleaseee andoll can u helppp for code or description of how to do motion detection plzzz i wana to mix two techniques ( skin colour detection & motion detection ) to reduce the noise plzzz help me andol

By: Andol

Andol — Mon, 20 Jun 2011 12:29:19 +0000

@David
‘capture the image on a new window’ – does that mean capturing a window as image sources?

By: david

david — Sat, 18 Jun 2011 07:21:48 +0000

hi andol,
my project is Finger detection of hand gesture recognition for controlling a robot using OpenCV, can you explain about this process?
and how to capture the image on a new window….because its a video sequence.

thank you very much andol

By: Andol

Andol — Wed, 15 Jun 2011 20:53:13 +0000

@Setia
can i have more details of system environments, like opencv version, linked libraries and so on.
this error may happen due to your system environment settings.

By: setia, Indonesia

setia, Indonesia — Wed, 15 Jun 2011 06:17:08 +0000

hi andol,
i find one error when i compile this source code

Linking…
LINK : fatal error LNK1104: cannot open file “odbccp32.libv.lib”
how to solve this problem ?
need your help….thank you

By: Andol

Andol — Sun, 20 Mar 2011 10:09:32 +0000

i do not.

By: ateendra

ateendra — Sat, 19 Mar 2011 18:00:29 +0000

hi, i am getting an inverted mask video, what must i do. secondly, the method you show here is not robust, do you have haar feature detector, or convex hull detector?

By: Tomasa Kovacic

Tomasa Kovacic — Wed, 16 Feb 2011 11:41:29 +0000

Let me start by saying nice post. Im not sure if it has been talked about, but when using Chrome I can never get the entire site to load without refreshing many times. Could just be my computer. Thanks.

By: Andol

Andol — Mon, 20 Dec 2010 16:12:48 +0000

This is good indeed, cheers mate

By: Asee Shrestha

Asee Shrestha — Sat, 18 Dec 2010 16:42:59 +0000

For anyone who is trying to achieve the mouse control in linux (Ubuntu)
$ sudo apt-get install xdotool

and use it to control the mouse cursor.
all you need is format command to send input to the xdotool
using sprintf() function

By: Andol

Andol — Tue, 19 Oct 2010 16:31:15 +0000

As long as the mouse positions can be taken over by the hand’s positions.

By: sam

sam — Tue, 19 Oct 2010 15:32:10 +0000

can i use the windows API other than the Hooks library?

By: Andol

Andol — Tue, 19 Oct 2010 14:14:16 +0000

A mechanism called HOOKS may be required to intercept the communications between the mouse and the system, this is a reference: http://msdn.microsoft.com/en-us/library/ms644959(VS.85).aspx

By: sam

sam — Tue, 19 Oct 2010 13:53:59 +0000

no what i meant was you have to talk to the windows API through the windows.h file rght?.
so could you please explain what should i do after detecting hand contours? thanks.

By: Andol

Andol — Mon, 18 Oct 2010 20:07:02 +0000

1. Detecting the hand contours is necessary because this provides the hand’s position for the point’s references.
2. Not sure the mapping requires the windows.h file since this step has not been tested in my previous projects. But this mapping is essential as it is needed to provide some reference points to match these two coordinates between the desktop and webcam range.

By: sam

sam — Mon, 18 Oct 2010 16:29:53 +0000

hi Andol, i want to use this code to move my mouse pointer. i have read all the comments here so far and found that this question has been raised several times. so please guide me whether my summation is correct or wrong.
1. you have to detect hand contours(this will give the detected hand as a rectangle)
2. map hand coordinates to mouse coordinates using the windows API(windows.h file)
i have a question here. in order to map coordinates you have to get the current coordinates of the hand rght? but how you gonna find them? and do we have to make some reference point for that?
im waiting for your answer. thanks a lot

By: Raion

Raion — Tue, 24 Aug 2010 18:50:33 +0000

haha yes you’re right i was mistakenly considering it only detecting hands due to the ceiling light illumination. i realized when the light fell on my face it detected that as well.

By: Andol

Andol — Fri, 20 Aug 2010 20:38:36 +0000

Hi Raion, this code was designed to detect human skins no matter face or hands, i am not sure why this code only detected hands when you used it, but the hsv parameters should be adjusted if the environments change. this is a full code example. hope this helps.

By: Raion

Raion — Thu, 19 Aug 2010 21:55:31 +0000

Hi Andol, for the life of me i can’t figure out why this code detects hands and not face or any other part of the body of the same color. If you had given a simple explanation somewhere i think i missed it. Can you please explain this? Also it’s amazing that you’re putting up all the codes like this. That’s a lot of work on your part so thanks for that.

By: Jenil

Jenil — Sat, 31 Jul 2010 10:01:25 +0000

Hello Anmol , I am in my Final Year of Engineering and have taken the project of controling mouse and games with various hand gesture and finger movements. So please if you can help me on it. I have searched a lot on net and have realised that is can be done with opencv but how i dont know so if you can please help me with various steps and source code.I want to learn new language and stuff so please guide me. And it will be very helpful if you provide a video tutorial.
Waiting for your reply.

By: Andol

Andol — Tue, 13 Jul 2010 18:10:28 +0000

Well done Tushar, i ‘d like to share a post for your progresses, waiting for your good news.

By: Tushar

Tushar — Tue, 13 Jul 2010 17:19:22 +0000

Hi Andol,
I figured it out…Actually cvConvexitydefects does the trick its give the start and the end points and the depth so we can determine the fingers from that….I am working on it as soon as I am up with something will post it here

By: Andol

Andol — Tue, 13 Jul 2010 12:13:19 +0000

@Tushar though you could refer this http://code.google.com/p/hand-gesture-detection/

By: Tushar

Tushar — Mon, 12 Jul 2010 20:33:07 +0000

Can you help me. I was going through the wiki page for open cv and was able to detect the contour of my hand…I want to know how to detect the tips of my finger….It would be really great if you could direct me to some source where I can learn how to do it

By: Andol

Andol — Mon, 12 Jul 2010 18:37:38 +0000

@Tushar, detecting finger tips is available, which requires clear finger contour detection. Sorry i do not have any codes about finger tip detection at this moment.

By: Tushar

Tushar — Mon, 12 Jul 2010 17:59:34 +0000

Hi Andol,
I need to detect the tips of the fingers…Can you help me with the code for this… I want to know which finger is visible. Please let me know if this is possible. I am new at opencv so any help would be great

By: sudharsan.n.s

sudharsan.n.s — Fri, 09 Jul 2010 17:52:44 +0000

cheers too….. and is there any HaarCascade training set for detecting hand, i searched that many times, but i got nothing….. if there is anything means just help me out, because detecting hand using skin color does not satisfy the result…

hearing for your reply……….

By: Andol

Andol — Wed, 07 Jul 2010 20:31:47 +0000

indeed, the color range matters, cheers

By: sudharsan.n.s

sudharsan.n.s — Wed, 07 Jul 2010 20:14:38 +0000

just if we use this value for hsv
Hsv hsv_min = new Hsv(0, 30, 80);
Hsv hsv_max = new Hsv(20, 150, 255);

instead of this
Hsv hsv_min = new Hsv(127, 66, 57);
Hsv hsv_max = new Hsv(183, 203, 124);

it works fine…

By: asad kahn

asad kahn — Wed, 07 Jul 2010 09:21:29 +0000

Thanx dear but still didnt find appropriate way. Is there any one knows about the handshpe date base use for for tracking? waiting for reply.

By: Andol

Andol — Mon, 05 Jul 2010 10:21:49 +0000

as well as this one http://www.andol.info/hci/1116.htm, and this one http://www.andol.info/hci/905.htm

By: Andol

Andol — Mon, 05 Jul 2010 10:20:40 +0000

though this may help: http://www.andol.info/hci/895.htm

By: asad kahn

asad kahn — Mon, 05 Jul 2010 09:23:42 +0000

Dear Andol I m working on gesture recognition i need to detect and track the hand so which kind of method is beneficial for me if u have code plz send as well.

By: Lama

Lama — Tue, 29 Jun 2010 15:03:46 +0000

Hi,
Do you know some free (natural) hand gesture or whole human or upper body database?
I read about the Massey Gesture Database, but the link does not work
Help me please.

By: Andol

Andol — Sat, 12 Jun 2010 08:33:14 +0000

Rajkumar, my thinking is that, to separate the hand from contours may require convexity detection.

By: Rajkumar

Rajkumar — Thu, 10 Jun 2010 16:07:38 +0000

Hi,

First of all,great work. I found it quite useful.I am currently doing a similar thing although on a depth based camera which does not have colour..

Right now I have the contour of the hand and the arm and its a motion tracking system. I now need to cut the hand from the arm and use the hand to control a cursor on screen. Could you give me an idea as to how i should separate the hand and how to control a cursor?

By: Andol

Andol — Sat, 22 May 2010 15:32:52 +0000

hi JP Talusan, if you had had a look at the source loading codes in opencv, you would find that it is able to load live webcam images, still images, and .avi video files. Here is a simple instance:
#include “cv.h”
#include “highgui.h”
int main( int argc, char** argv )
{
IplImage* pImg;
if( argc == 2 &&
(pImg = cvLoadImage( argv[1], 1)) != 0 ) //argv[1] is a parameter of image path.
{
cvNamedWindow( “Image”, 1 );
cvShowImage( “Image”, pImg );
cvWaitKey(0);
cvDestroyWindow( “Image” );
cvReleaseImage( &pImg );
return 0;
}
return -1;
}
cheers.

By: JP Talusan

JP Talusan — Sat, 22 May 2010 12:00:50 +0000

Sir, i know this code works for a live webcam feed, how do you make it work for an input of still image and .avi video files only

By: Andol

Andol — Wed, 17 Mar 2010 08:22:51 +0000

Hi Bon, i am not sure if the hand detection algorithm fits fire detection by openCV, though thay have some features in common. You can have a try using hand detection algorithm with some improvements according to fire features.

By: bon

bon — Wed, 17 Mar 2010 04:58:29 +0000

algorithm your is great, do you have algorithm fire detection using openCV ? Can you send to me .
my email : trung_lvt@yahoo.com

By: Andol

Andol — Fri, 12 Mar 2010 20:22:52 +0000

Hi Finch, after ive got the while-black result, i use: "cvSmooth" to reduce the noises, "cvCandy" to extract lines, "cvFindContours" to extract the most possible hand contours, once i ve got the right contours, i use "cvBoundingRect" to locate the position of hand as a rectangle, then draw out the rectangle which is the picture you see. Or you can refer here for detail codes here http://download.andol.info/hsv.cpp. PS: thanks for your codes sharing.

By: Finch

Finch — Fri, 12 Mar 2010 20:03:43 +0000

Hello Andol, thanks for the advice, your helping me on my way but i have a few questions.

Im trying to make an application that responds to hand gestures. At the moment all I want to do it figure out where (in terms of x,y) the center of the hand is in the image and how many fingers are being held up.

So once I have the black and white image you show in this post, how do i then draw areas round them and get the .Center values from it ? I see in another one of your posts you have managed to draw a very precise contour round the hand, how did you manage that ? I know you only do OpenCV and not Emgu but if you show me the specific method calls you would use I can probably figure out the Emgu equivalents.

Thank you for your time.

Also, I see a few people asking how to do it in the Emgu CV version. Well…

Capture camera = new Capture() Image originalImage = camera.QueryFrame() ; // Raw image


/* All the colour segmentation is done in Hsv not Bgr so we need a Hsv version of our image */

Image hsvImage = originalImage.convert();
/* Now we need to define the upper (max) and lower (min) Hsv values that we want to extract from the image */

Hsv hsv_min = new Hsv(127, 66, 57);

Hsv hsv_max = new Hsv(183, 203, 124);
/* Note: I am trying to detect hands in my webcam image and in a dark room, you will need to play around with the parameters in hsv_min & hsv_max to find the colours you want to extract 
Now, the process of checking if pixels are in range of these min and max values results in a greyscale image, so we'll need one of those. */
Image greyedImage = hsvImage.InRange(hsv_min, hsv_max);
/* BAM ! A greyscale image containing only the pixels with Hsv values between the hsv_min & hsv_max ranges. *.

By: sobia

sobia — Mon, 22 Feb 2010 18:43:35 +0000

hi Andol
i have to control a robotic car by fingers i hv saw ur code.it working for hand exraction.nw i hve to count of fingers in a particular moment.plaese help me wat i do next..

By: Andol

Andol — Fri, 19 Feb 2010 10:43:57 +0000

sorry, i just did some code projects in Windows, ubutun has not yet been tested.But i think, the codes would be mostly the same.

By: Namesake

Namesake — Wed, 17 Feb 2010 13:50:22 +0000

Hi Andol,
After detecting the hand, Is there a way to connect the mouse pointer to coordinate(x,y)? I am using Ubuntu. What command should I use to do so?

By: kabir hossain

kabir hossain — Thu, 04 Feb 2010 04:11:15 +0000

Hi, i got your code.This is working well but i want to find the hand location.I have used contour but still can not find hand location.can your help me?plz

By: Andol

Andol — Tue, 02 Feb 2010 05:44:16 +0000

the way is to assign different gesture to left click and right click, e.g. four fingers means left click, full palm means right click.

By: Avesum

Avesum — Mon, 01 Feb 2010 10:09:13 +0000

how can i perform left click and right click by my finger using webcam in open CV library plz help..

By: Andol

Andol — Thu, 21 Jan 2010 11:54:09 +0000

once you segment clean hand contours, the next step would be detect the convexities by using a function in openCV called ‘CvConvexityDefect’ to get the hand’s features.

By: quarks

quarks — Thu, 21 Jan 2010 11:35:51 +0000

hi thanks for this i had done still but i dont know how to proceed again (ie) to detect the gesture and perform mouse clicks help me please

By: Andol

Andol — Mon, 18 Jan 2010 15:24:48 +0000

first, detecting the hand, and then finding a centre of detected hand as a rectangle, and at last connecting the cursor to coordinates of the hand.

By: quarks

quarks — Mon, 18 Jan 2010 09:13:33 +0000

hi i need to get the coordinates of the hand while moving ….. please help me …its urgent

By: quarks

quarks — Mon, 18 Jan 2010 09:10:27 +0000

hi i would like to control cursor movements by using hand so please help me to find coordinates of hand..please help me in this urgent

By: Andol

Andol — Sat, 28 Nov 2009 12:51:21 +0000

sorry, i am not using EmguCV, so the source code is based on openCV rather than EmguCV. You can refer to the code here: http://www.andol.info/hci/830.htm/attachment/handdetection-2

By: Andol

Andol — Sat, 28 Nov 2009 12:50:15 +0000

Please referring to here: http://www.andol.info/hci/830.htm/attachment/handdetection-2

By: Nguyen Van Bao

Nguyen Van Bao — Sat, 28 Nov 2009 09:40:04 +0000

great….
i using EgmuCV, can you send me Hand detection using EmguCV code, my email:baonv2109@gmail.com
thank you!!

By: Nguyen Van Bao

Nguyen Van Bao — Sat, 28 Nov 2009 09:39:21 +0000

great….
i using EgmuCV, can you send me Hand detection using EmguCV, my email:baonv2109@gmail.com
thank you!!

By: Nguyen Van Bao

Nguyen Van Bao — Sat, 28 Nov 2009 09:29:31 +0000

great….
i using EgmuCV, can you Hand detection using EgmuCV, my email:baonv2109@gmail.com
thank !!

By: Andol

Andol — Mon, 09 Nov 2009 09:03:12 +0000

well, if haar is adopted to detect the hand’s gestures, the first thing you should do is to capture enough number of samples including positive and negative. Then you can train your application according to these samples you have gathered. for more details, it is possible to refer the machine learning part of openCV.

By: Edwin

Edwin — Mon, 09 Nov 2009 05:01:04 +0000

Hello, I need your help on hand detection in OpenCV, I am quite poor at computer programing and I want to use this technique to control a robot eye. I have successfully managed to acquire and capture the image from my web cam and now need to move on to the next step. I was told i have to use the Haar libraries and the same concept of Face detection by my professors. What should i do? Thank you

By: Hand detection using openCV by Andol « Dogsmile's Blog

Hand detection using openCV by Andol « Dogsmile's Blog — Sun, 25 Oct 2009 07:19:33 +0000

[...] Reference: http://www.vimeo.com/4026184 http://www.andol.info/hci/830.htm [...]