Hand Hygiene Monitor

Computer vision technology for personnel hygiene control.

Full case study in PDF
Download

The challenge

Our client is one of the leading agricultural corporations in Ukraine, who specialize in full-cycle meat product manufacturing. 

To improve production safety, our client needed an automated system for employee hand hygiene control. We came up with an idea to create a computer vision enabled device that analyzes the quality of hand disinfection. 

Delivered value

We designed and developed a proof of concept device that leverages computer vision to analyse how well an employee has covered their hands with UV-reactive hand sanitizer.

The device outputs coverage quality in percent, determining whether the employee’s hands are sterilized enough to enter the safety area. 

The process

Our decision to use UV reactive hand sanitizer shaped the design of the device. This sanitizer is most visible under a UV lamp; any other light would damage the image contrast, tampering with the accuracy of the analysis. 

That’s why our device is a box made of opaque plastic. Its only opening is in the front, for inserting the hands. This prevents unnecessary light from entering. For the interior of the box, we had to find three key components:

  • Appropriate lights. We went with multiple UV diodes because they provide a narrower wavelength than other light sources and ensure even lighting. 
  • The right background. We covered the bottom of the interior with green felt. It serves as a chroma key and enables simple detection of hands in the video. 
  • A suitable camera. We chose the RPi Camera (G) with a fisheye lens because it’s compatible with our Raspberry Pi, has an angle of view wide enough to catch both hands, and comes with adjustable focus control. 

To develop the computer vision algorithm, our engineers used the OpenCV library and added several custom algorithms. Here’s a rough summary of how the recognition process goes: 

  • Our algorithm separates hands from the background and detects their contours. 
  • Then it checks that both hands are in the correct position (that they aren’t touching the device interior and aren’t overlapping). 
  • Finally, it analyzes sanitizer coverage: the areas of hands covered with sanitizer appear bright blue in the image. 

By calculating the ratio of blue-covered area to the total hand surface, our algorithm assesses the quality of hand disinfection.

Services
Data science
Mechanical design
Electrical design
Firmware development
Prototype assembly
Technologies
Computer vision
C++
Python
Raspberry Pi, QT
OpenCV
Industry
AgroTech

How it works

schema_wash_hands_vector Created with Sketch.
youtube-thumbnail