Mühendislik ve Doğa Bilimleri Fakültesi

Permanent URI for this communityhttps://gcris.khas.edu.tr/handle/20.500.12469/36

Browse

Now showing 1 - 4 of 4

Citation Count: 4
Action Recognition Using Random Forest Prediction with Combined Pose-based and Motion-based Features
(IEEE, 2013) Ar, İlktan; Akgül, Yusuf Sinan
In this paper we propose a novel human action recognition system that uses random forest prediction with statistically combined pose-based and motion-based features. Given a set of training and test image sequences (videos) we first adopt recent techniques that extract low-level features: motion and pose features. Motion-based features which represent motion patterns in the consecutive images are formed by 3D Haar-like features. Pose-based features are obtained by the calculation of scale invariant contour-based features. Then using statistical methods we combine these low-level features to a novel compact representation which describes the global motion and the global pose information in the whole image sequence. Finally Random Forest classification is employed to recognize actions in the test sequences by using this novel representation. Our experimental results on KTH and Weizmann datasets have shown that the combination of pose-based and motion-based features increased the system recognition accuracy. The proposed system also achieved classification rates comparable to the state-of-the-art approaches.
Citation Count: 34
A Computerized Recognition System for the Home-Based Physiotherapy Exercises Using an RGBD Camera
(IEEE, 2014) Ar, İlktan; Akgül, Yusuf Sinan
Computerized recognition of the home based physiotherapy exercises has many benefits and it has attracted considerable interest among the computer vision community. However most methods in the literature view this task as a special case of motion recognition. In contrast we propose to employ the three main components of a physiotherapy exercise (the motion patterns the stance knowledge and the exercise object) as different recognition tasks and embed them separately into the recognition system. The low level information about each component is gathered using machine learning methods. Then we use a generative Bayesian network to recognize the exercise types by combining the information from these sources at an abstract level which takes the advantage of domain knowledge for a more robust system. Finally a novel postprocessing step is employed to estimate the exercise repetitions counts. The performance evaluation of the system is conducted with a new dataset which contains RGB (red green and blue) and depth videos of home-based exercise sessions for commonly applied shoulder and knee exercises. The proposed system works without any body-part segmentation bodypart tracking joint detection and temporal segmentation methods. In the end favorable exercise recognition rates and encouraging results on the estimation of repetition counts are obtained.
Citation Count: 1
A framework for combined recognition of actions and objects
(Springer-Verlag Berlin, 2012) Ar, İlktan; Akgül, Yusuf Sinan
This paper proposes a novel approach to recognize actions and objects within the context of each other. Assuming that the different actions involve different objects in image sequences and there is one-to-one relation between object and action type we present a Bayesian network based framework which combines motion patterns and object usage information to recognize actions/objects. More specifically our approach recognizes high-level actions and the related objects without any body-part segmentation hand tracking and temporal segmentation methods. Additionally we present a novel motion representation based on 3D Haar-like features which can be formed by depth color or both images. Our approach is also appropriate for object and action recognition where the involved object is partially or fully occluded. Finally experiments show that our approach improves the accuracy of both action and object recognition significantly.
Citation Count: 7
A monitoring system for home-based physiotherapy exercises
(2013) Ar, İlktan; Akgül, Yusuf Sinan
This paper describes a robust low-cost vision based monitoring system for home-based physical therapy exercises (HPTE). Our system contains two different modules. The first module achieves exercise recognition by building representations of motion patterns stance knowledge and object usage information in gray-level and depth video sequences and then combines these representations in a generative Bayesian network. The second module estimates the repetition count in an exercise session by a novel approach. We created a dataset that contains 240 exercise sessions and tested our system on this dataset. At the end we achieved very favourable recognition rates and encouraging results on the estimation of repetition counts. © 2013 Springer-Verlag London.

Browse

Browsing Mühendislik ve Doğa Bilimleri Fakültesi by Author "Akgül, Yusuf Sinan"