Skip to main content

Research Repository

Advanced Search

FinSeg: finger parts semantic segmentation using multi-scale feature maps aggregation of FCN.

Saleh, Adel; Rashwan, Hatem; Abdel-Nasser, Mohamed; Singh, Vivek; Abdulwahab, Saddam; Sarker, Md.; Garcia, Miguel; Puig, Domenec

Authors

Adel Saleh

Hatem Rashwan

Mohamed Abdel-Nasser

Vivek Singh

Saddam Abdulwahab

Miguel Garcia

Domenec Puig



Abstract

Image semantic segmentation is in the center of interest for computer vision researchers. Indeed, huge number of applications requires efficient segmentation performance, such as activity recognition, navigation, and human body parsing, etc. One of the important applications is gesture recognition that is the ability to understanding human hand gestures by detecting and counting finger parts in a video stream or in still images. Thus, accurate finger parts segmentation yields more accurate gesture recognition. Consequently, in this paper, we highlight two contributions as follows: First, we propose data-driven deep learning pooling policy based on multi-scale feature maps extraction at different scales (called FinSeg). A novel aggregation layer is introduced in this model, in which the features maps generated at each scale is weighted using a fully connected layer. Second, with the lack of realistic labeled finger parts datasets, we propose a labeled dataset for finger parts segmentation (FingerParts dataset). To the best of our knowledge, the proposed dataset is the first attempt to build a realistic dataset for finger parts semantic segmentation. The experimental results show that the proposed model yields an improvement of 5% compared to the standard FCN network.

Citation

SALEH, A., RASHWAN, H., ABDEL-NASSER, M., SINGH, V., ABDULWAHAB, S., SARKER, M., GARCIA, M. and PUIG, D. 2019. FinSeg: finger parts semantic segmentation using multi-scale feature maps aggregation of FCN. In Tremeau, A., Farinella, G.M. and Braz, J. (eds.). Proceedings of 14th international joint conferences on Computer vision, imaging and computer graphics theory and applications 2019 (VISIGRAPP 2019), 25-27 February 2019, Prague, Czech Republic. Setúbal, Portugal: SciTePress [online], 5, pages 77-84. Available from: https://doi.org/10.5220/0007382100770084

Conference Name 14th international joint conferences on Computer vision, imaging and computer graphics theory and applications 2019 (VISIGRAPP 2019)
Conference Location Prague, Czech Republic
Start Date Feb 25, 2019
End Date Feb 27, 2019
Acceptance Date Nov 29, 2018
Online Publication Date Feb 27, 2019
Publication Date Dec 31, 2019
Deposit Date Dec 4, 2021
Publicly Available Date Jan 20, 2022
Publisher SciTePress
Volume 5
Pages 77-84
ISBN 9789897583544
DOI https://doi.org/10.5220/0007382100770084
Keywords Semantic segmentation; Fully convolutional network; Pixel-wise classification; Finger parts
Public URL https://rgu-repository.worktribe.com/output/1542064

Files





You might also like



Downloadable Citations