Communications - Scientific Letters of the University of Zilina 2016, 18(1):29-34 | DOI: 10.26552/com.C.2016.1.29-34

A New Algorithm for Key Frame Xtraction Based on Depth Map Using Kinect

Peter Sykora1, Patrik Kamencay1, Robert Hudec2, Miroslav Benco2
1 Department of Telecommunications and Multimedia, Faculty of Electrical Engineering, University of Zilina, Slovak
2 Department of Telecommunications and Multimedia, Faculty of Electrical Engineering, University of Zilina, Slovakia

In this paper, a new algorithm for key frame extraction based on depth map for hand gesture recognition is presented. The all input sequences are captured by Microsoft Kinect camera system. These methods extract three key frames from captured depth video sequence. These key frames describe dynamic gesture. The proposed extraction method is composed of two parts. The first part, labelled as space segmentation extracts the region of hand from background. The second part labelled as time segmentation splits captured sequence into three parts and marks one frame per part as the key frame. A new gesture database for evaluation of proposed method was created. The proposed method to human evaluators was compared. The experimental results show that the proposed system obtained accuracy about 90%.

Keywords: gesture recognition; 3D video; Microsoft Kinect; depth map; image segmentation

Published: February 29, 2016  Show citation

ACS AIP APA ASA Harvard Chicago Chicago Notes IEEE ISO690 MLA NLM Turabian Vancouver
Sykora, P., Kamencay, P., Hudec, R., & Benco, M. (2016). A New Algorithm for Key Frame Xtraction Based on Depth Map Using Kinect. Communications - Scientific Letters of the University of Zilina, 18(1), 29-34. doi: 10.26552/com.C.2016.1.29-34
Share...
Download citation
  • BibTeX (.bib)
  • Bookends (.ris)
  • EasyBib (.ris)
  • EndNote (.enw)
  • EndNote 8 (.xml)
  • ISI WoS (.isi)
  • Medlars (.medlars)
  • Mendeley (.ris)
  • MODS (.xml)
  • Papers (.ris)
  • RefWorks (.txt)
  • RefManager (.ris)
  • RIS (.ris)
  • MS Word (.xml)
  • Zotero (.ris)
    • Open full article

    References

    1. YOSHIMURA, Y., OZAWA, R.: A Supervisory Control System for a Multi-fingered Robotic Hand using Datagloves and a Haptic Device. Intern. Conference Intelligent Robots and Systems (IROS), 2012, p. 5414-5419 Go to original source...
    2. CARBONARO, N., MURA, G. D., LORUSSI, F., PARADISO, R., DE ROSSI, D., TOGNETTI, A.: Exploiting Wearable Goniometer Technology for Motion Sensing Gloves. IEEE J. of Biomedical and Health Informatics, 2014, vol. 18, No. 6, p. 1788-1795 Go to original source...
    3. MINNEN, D., ZAFRULLA, Z.: Towards Robust Cross-user Hand Tracking and Shape Recognition. IEEE Intern. Conference on Computer Vision Workshops (ICCV Workshops), 2011, pp. 1235-1241 Go to original source...
    4. CHANG, L. Y., POLLARD, N. S., MITCHELL, T. M., XING, E. P.: Feature Selection for Grasp Recognition from Optical Markers. Intern. Conference on Intelligent Robots and Systems, 2007, pp. 2944-2950 Go to original source...
    5. TANGSUKSANT, W., ADHAN, S., PINTAVIROOJ, C.: American Sign Language Recognition by using 3D Geometric Invariant Feature and ANN Classification. 7th Intern. Conference Biomedical Engineering (BMEiCON), 2014, pp. 1-5 Go to original source...
    6. MEYER, J., KUDERER, M., MULLER, J., BURGARD, W.: Online Marker Labeling for Fully Automatic Skeleton Tracking in Optical Motion Capture. IEEE Intern. Conference on Robotics and Automation (ICRA), 2014, pp. 5652-5657 Go to original source...
    7. LUKAC, P., HUDEC, R., BENCO, M., KAMENCAY, P., DUBCOVA, Z., ZACHARIASOVA, M.: Simple Comparison of Image Segmentation Algorithms Based on Evaluation Criterion. 21st Intern. Conference Radioelektronika (RADIOELEKTRONIKA), 2011, pp. 1-4 Go to original source...
    8. QURAISHI, M. I., DHAL, K. G., CHOUDHURY, J. P., GHOSH, P., SAI, P., DE, M.: A Novel Human Hand Finger Gesture Recognition using Machine Learning. 2nd IEEE Intern. Conference on Parallel Distributed and Grid Computing (PDGC), 2012, pp. 882-887 Go to original source...
    9. JUAN, W., GUIFANG, Q., JUN, Z., YING, Z., GUANGMING, S.: Hand Motion-Based Remote Control Interface with Vibrotactile Feedback for Home Robots. Int. J. Adv Robot Syst, 2013, vol. 10:270. doi: 10.5772/56617 Go to original source...
    10. ZHOU, R., JUNSONG, Y., WENYU, L., ZHENGYOU, Z.: Minimum Near-Convex Shape Decomposition and its Application in Hand Gesture Recognition. Intern. J. of Computer Vision (IJCV), 2011
    11. KIM, T. K., WONG, S. F., CIPOLLA, R.: Tensor Canonical Correlation Analysis for Action Classification. Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2007 Go to original source...
    12. LIU, L., SHAO, L.: Learning Discriminative Representations from RGB-D Video Data. Proc. of Intern. Joint Conference on Artificial Intelligence (IJCAI), Beijing, 2013
    13. CHENYANG, Z., XIAODONG, Y., YINGLI, T.: Histogram of 3D Facets: A characteristic Descriptor for Hand Gesture Recognition. 10th IEEE Intern. Conference and Workshops on Automatic Face and Gesture Recognition (FG), 2013, pp. 1-8
    14. DARDAS, N. H., GEORGANAS, N. D. Real-Time Hand Gesture Detection and Recognition Using Bag-of-Features and Support Vector Machine Techniques. IEEE Transactions on Instrumentation and Measurement, 2011, vol. 60, No. 11, p. 3592-3607. Go to original source...

    This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits use, distribution, and reproduction in any medium, provided the original publication is properly cited. No use, distribution or reproduction is permitted which does not comply with these terms.


    Return to the content