UAE | Education

Virtual mouse, an invention to help the disabled

Computer engineering student at Khalifa university develops software that allows control of a mouse through the movement of a person's eyes

  • By Rania Moussly, Staff Reporter
  • Published: 00:00 June 5, 2011
  • Notes

Sultan Ahmad Sultan Al Sharif has developed a virtual mouse as part of his final year project
  • Image Credit: Asghar Khan/Gulf News
  • Sultan Ahmad Sultan Al Sharif has developed a virtual mouse as part of his final year project to assist those with special needs.
Image 1 of 2

Dubai: People with certain disabilities may now be able to become fully functional on a personal computer or laptop due to an invention by computer engineering student Sultan Ahmad Sultan Al Sharif.

Al Sharif has developed software called the Virtual Mouse: Human Eye based Mouse Control as part of his final year project at Khalifa University (KU). This means a person is now able to control the mouse on a laptop or desktop computer through the movement of their eyes.

"This project is aimed at everyone but specifically for those who have a physical disability," said Al Sharif. "People who can't use their hands or move their bodies can now use our system to control an on-screen mouse with their eyes."

He added the control happens because a person's eye movements are followed by a laptop's embedded camera (or a desktop computer's camera) to move the on-screen mouse.

"To perform a click function you close one eye; either the left or right to perform a left or right click," he said. "If both eyes are closed the computer is sent into sleep mode."

Al Sharif and his supervisors, Dr Harish Bhaskar and Dr Yousuf Iraqi, are currently in the process of patenting the software, a process expected to take up to nearly two years.

How it works

The software was developed at no cost at KU over a period of six months. It uses already existing 2D face detection software and any camera embedded into most modern-day laptops or desktop personal computers.

"This idea stems from various forms of human computer interactions, which have seen systems control computers using hand gestures and head movements," said Dr Bhaskar, assistant professor of computer engineering at KU.

Video: Game-changing software uses eye movement to control computer

Revolutionary software helps people with disabilities to usecomputer through eye movement.

"Sultan's method is one form of human computer interaction, but using the eyes is very natural because you must anyway look into a monitor to use a computer."

Dr Iraqi, assistant professor of computer engineering at KU, added the simplicity of the invention's implementation was to eliminate the need for special equipment. This was in order to make the software accessible to everybody.

The software was therefore designed and implemented on a personal laptop housing a 1.3 mega pixel embedded camera, which can be bought from virtually any electronics shop.

"It's simply software that allows the camera to look at you while you are looking at the screen and follow your eye movements to move the mouse," said Al Sharif. "2D face detection already exists, we just modified and upgraded it to implement eye detection."

The 22-year-old studies engineering because of his love of science and he wanted to follow in his father's footsteps.

After graduation he hopes to do a master's degree in engineering and eventually move on to academic research.

However, during his study at the master's level he aims to perfect the virtual mouse software, the first of many inventions to come, as it currently needs tweaking.

At present the software has been developed to detect and pinpoint a registered user's eye movement to an invisible box measuring 1.6 inches (or 120 x 120 pixels) on the monitor but Al Sharif is hoping to make it even more accurate.

Comments (5)

  1. Added 14:58 June 5, 2011

    This is extremely a great project. I wear glasses for reading. I noticed when I see my face on live video from my computer there is a glare in the picture from my glasses. Has your software taken this into consideration? If so this is indeed good news. If not how will your software accommodate visually impaired people? Thanks for this important contribution. Your efforts will be rewarded I'm sure.

    Don, Dubai, United Arab Emirates

  2. Added 13:07 June 5, 2011

    Amazing work :D...

    chilaka prasad, dubai, United Arab Emirates

  3. Added 12:40 June 5, 2011

    Congratulations to Mr. Sultan Ahmad Sultan Al Sharif and entire Khalifa university team ,Excellent work, go ahead..

    Sayeed Makkiyil Adam., Dubai, United Arab Emirates

  4. Added 11:34 June 5, 2011

    Good Job. But what about the Eyes, Whole Day we will move our Eyes Like Mouse Ball?? there is no comparison between Mouse and Eyes, Eyes are Precious.

    FARAZ, Abu Dhabi, United Arab Emirates

  5. Added 10:35 June 5, 2011

    Excellent Job Mr. Sultan & all the best for you & Khalifa Universuity Gradutes.

    Nasser Al Suwaidi , Ras AL Khaimah, United Arab Emirates

Your access to everything in education