• Jun 14, 2017 News!Vol.8, No.5 has been indexed by EI (Inspec).   [Click]
  • Nov 09, 2017 News!Vol.9, No.5 has been published with online version. 16 peer reviewed articles from 11 specific areas are published in this issue.   [Click]
  • Jul 19, 2017 News!Vol.9, No.4 has been published with online version. 16 peer reviewed articles from 16 specific areas are published in this issue.   [Click]
General Information
Editor-in-chief
Prof. Wael Badawy
Department of Computing and Information Systems Umm Al Qura University, Canada
I'm happy to take on the position of editor in chief of IJCTE. We encourage authors to submit papers concerning any branch of computer theory and engineering.
IJCTE 2012 Vol.4(4): 631-635 ISSN: 1793-8201
DOI: 10.7763/IJCTE.2012.V4.546

Autonomous Robot Control Using Facial Expressions

Rohin Mittal, Prateek Srivastava, Alpha George, and Asim Mukherjee
Abstract—In this paper, a novel real time robot control system using human facial expressions is presented. The proposed system mainly consists of three modules: face detection, facial expression recognition and robot control. The first module aims to find the user’s face from the image captured from a live video through a series of steps including skin color classification, edge detection and mathematical morphology, while the second module analyses the detected face to recognize the facial expressions like happiness, sadness, surprise, anger and neutral using Principal Component Analysis (PCA) and Euclidian distance calculation. Finally, the detected facial expressions are used as controlling commands for the robot. Experiments were conducted for respective modules. 150 images under different lightening conditions and complex background were employed. In the experiment on detecting the facial region, the rate of detection was 99.3% and on recognizing the facial expression, the recognition rate was 97.3%. The robot was then controlled autonomously with an accuracy of 100%. Combining the above three rates, the overall rate of success of our system was 97.3%.

Index Terms—Autonomous robot, euclidian distance, face detection, facial expression recognition, principle component analysis.

Rohin Mittal is with the Apache Design Solutions Pvt. Ltd., Bengaluru, India (e-mail: rohinmittal2007@gmail.com).
Prateek Srivastava is with the NTPC Ltd., Singrauli, India (email: prateek.annie@gmail.com)
Alpha George is with the Samsung Software India R and D Center, Noida, India (email: alphageee@gmail.com)
Asim Mukherjee is with the Electronics and Communication Engineering Department at Motilal Nehru National Institute of Technology, Allahabad, India (email: asimmkj@mnnit.ac.in)

[PDF]

Cite: Rohin Mittal, Prateek Srivastava, Alpha George, and Asim Mukherjee, "Autonomous Robot Control Using Facial Expressions," International Journal of Computer Theory and Engineering vol. 4, no. 4, pp. 631-635, 2012.
Copyright © 2008-2015. International Journal of Computer Theory and Engineering. All rights reserved.
E-mail: ijcte@vip.163.com