Isolating IR light from the LEDS.

So I was trying to figure out how to isolate the pixels that belonged to the IR light from the LEDs. Problem was that there was tons of IR light coming from the projector as well, and my filter wasn't able to filter out at the camera. Here is a raw image coming directly from the camera.

I was trying to tackle the problem by looking at how bright each pixel was. This isn't the way to go in my experience. Especially if you have poor filtering from the projector. When I took this screenshot I started sampling the pixels with the GIMP to try to figure out what RGB values the IR light I wanted had. I quickly noticed that there were HSV values along with RGB that the GIMP was displaying. Most importantly every single pixel that belonged to a finger had a H or hue value between 265 and 270 or a very low saturation, like below 5.

At the time of this writing I haven't done it yet, but it's 11:46 and I have school tomorrow. Anyway, it should be very easy to isolate the IR light from the LEDs this way. I think of the hue as a spectrum and the camera model I have detects different wavelengths with different hues. More updates on this soon.
----Updates----
Yeah, so I tried isolating. The best way I managed to do it was by using multiple criteria to give each pixel "percentage chance" of being a pixel that a finger was touching. I wrote this in yuv space, rgb is harder to think about (to me at least) for this problem. Basically you want to look at each pixel and then see how far it is on the uv plane from the target (purplish) colour you are looking for. Then look at the overall brightness y value for that pixel. Take a weighted average of those two values...kind of like what google does for pages...but for pixels. Code is still a bit messy, but check the code section to see this in action.
-----More updates----
So I got a fancy new IR cut filter for the projector from here:
http://www.optics-online.com/irc.asp
The exact model I got was the IRC30-50x50. You can get all the information on it from the filters page.
Here are the results. I can definitely say that and IR cut filter is a definite must unless you have a really good silicon layer and the projection surface is on top of the glass.
The filter itself wasn't too expensive, but the shipping was more than the price of the filter. That's going from the US to Canada.