4.6 Article

Finger Vein and Inner Knuckle Print Recognition Based on Multilevel Feature Fusion Network

Journal

APPLIED SCIENCES-BASEL
Volume 12, Issue 21, Pages -

Publisher

MDPI
DOI: 10.3390/app122111182

Keywords

finger vein features; inner knuckle print features; multimodal recognition; convolutional neural network; feature fusion

Funding

  1. National Natural Science Foundation of China [61976189, 62001418]
  2. Leading Innovation Team of Zhejiang Province [2021R01002]
  3. Natural Science Foundation of Zhejiang Province [LQ21F010011]

Ask authors/readers for more resources

In this study, we propose a dual-branch network-based recognition method for multimodal biometric recognition using finger vein (FV) and inner knuckle print (IKP). The method combines convolutional neural network, transfer learning, and triplet loss function to complete feature representation and achieves deep multilevel fusion of the two modalities' features.
Multimodal biometric recognition involves two critical issues: feature representation and multimodal fusion. Traditional feature representation requires complex image preprocessing and different feature-extraction methods for different modalities. Moreover, the multimodal fusion methods used in previous work simply splice the features of different modalities, resulting in an unsatisfactory feature representation. To address these two problems, we propose a Dual-Branch-Net based recognition method with finger vein (FV) and inner knuckle print (IKP). The method combines convolutional neural network (CNN), transfer learning, and triplet loss function to complete feature representation, thereby simplifying and unifying the feature-extraction process of the two modalities. Dual-Branch-Net also achieves deep multilevel fusion of the two modalities' features. We assess our method on a public FV and IKP homologous multimodal dataset named PolyU-DB. Experimental results show that the proposed method performs best and achieves an equal error rate (EER) of the recognition result of 0.422%.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available