1 Introduction
Level of fusion | Fusion approach |
---|---|
Sensor-level fusion | Mosaicing |
Feature-level fusion | Feature concatenation |
Score-level fusion | |
Decision-level fusion | Majority voting |
-
We constructed our database by introducing the multi-view concept, whereas the previously released database [29] considered only the side-view, and discussed use of the view as a quality measure; in addition, we applied some pre-processing steps on the feature level and have called this database “MultiQ Score Database version 2”.
-
We have added an analysis of how the quality measures affect the recognition accuracy of each modality.
-
We have added the RankSVM as a new benchmark to enable further discussion of the evaluation results. Consideration of the RankSVM enables analysis of the recognition accuracy in greater depth.
2 Related work
2.1 Existing score database
2.2 Score-level fusion
2.3 Quality-dependent approaches
3 Single sensor-based multi-quality multi-modal biometric score database
3.1 Overview of the OU-ISIR Gait Database, Large Population Dataset
3.2 Quality measures
3.3 Matching algorithm for score calculation
3.4 Constructed score database
4 Performance evaluation
4.1 Overview
4.2 Accuracy analysis of each modality and impact analysis of each quality
Modal | Gait | Head | Height | |||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
SR ∖TR | 30 | 15 | 10 | 7.5 | 6 | 5 | 3.75 | 3 | 2 | 1 | 30 | 15 | 10 | 7.5 | 6 | 5 | 3.75 | 3 | 2 | 1 | 30 | 15 | 10 | 7.5 | 6 | 5 | 3.75 | 3 | 2 | 1 |
(a) 85° | ||||||||||||||||||||||||||||||
640 ×480 | 4.2 | 4.6 | 5.5 | 6.8 | 9.5 | 12.3 | 21.4 | 17.5 | 40.1 | 41.1 | 2.9 | 3.5 | 3.9 | 4.3 | 4.8 | 5.1 | 5.8 | 6.3 | 8.0 | 10.9 | 13.6 | 13.6 | 13.6 | 13.6 | 13.7 | 13.8 | 14.1 | 14.3 | 17.2 | 18.2 |
320 ×240 | 4.2 | 4.7 | 5.9 | 7.3 | 10.3 | 13.3 | 22.1 | 19.0 | 40.7 | 41.7 | 3.4 | 4.4 | 5.3 | 6.2 | 7.0 | 7.7 | 9.0 | 10.2 | 12.7 | 16.9 | 13.8 | 13.8 | 13.8 | 13.9 | 13.9 | 13.9 | 14.3 | 14.5 | 17.4 | 18.7 |
213 ×160 | 4.2 | 4.9 | 6.2 | 7.8 | 10.7 | 13.7 | 22.2 | 19.5 | 40.4 | 41.4 | 4.0 | 6.0 | 7.7 | 9.2 | 10.3 | 11.4 | 13.3 | 14.9 | 17.8 | 23.0 | 13.8 | 13.8 | 13.8 | 14.0 | 14.1 | 14.1 | 14.4 | 14.8 | 17.7 | 19.4 |
160 ×120 | 4.4 | 5.2 | 6.7 | 8.5 | 11.9 | 14.7 | 23.5 | 20.9 | 40.7 | 41.8 | 3.7 | 6.8 | 10.1 | 12.1 | 14.3 | 15.9 | 18.5 | 20.7 | 24.4 | 30.6 | 14.1 | 14.2 | 14.2 | 14.2 | 14.4 | 14.5 | 15.1 | 15.4 | 18.4 | 19.6 |
128 ×96 | 4.6 | 5.9 | 7.6 | 9.4 | 12.9 | 15.7 | 23.7 | 22.1 | 40.3 | 41.5 | 5.2 | 7.1 | 9.7 | 13.2 | 16.8 | 19.7 | 23.8 | 26.3 | 30.1 | 35.8 | 14.7 | 14.8 | 14.9 | 14.9 | 15.1 | 15.3 | 15.8 | 16.3 | 19.1 | 21.1 |
106 ×80 | 5.0 | 6.4 | 8.7 | 10.6 | 14.0 | 16.8 | 24.2 | 23.2 | 40.3 | 41.9 | 6.7 | 8.9 | 11.1 | 14.4 | 17.5 | 20.6 | 26.2 | 29.9 | 34.7 | 39.6 | 15.1 | 15.4 | 15.5 | 15.8 | 16.1 | 16.4 | 17.1 | 17.5 | 20.9 | 23.1 |
80 ×60 | 5.0 | 8.3 | 11.3 | 13.3 | 16.7 | 19.3 | 25.8 | 25.5 | 40.0 | 42.3 | 14.6 | 15.4 | 17.7 | 18.9 | 20.8 | 22.7 | 26.7 | 30.1 | 38.3 | 43.5 | 16.3 | 16.8 | 17.1 | 17.8 | 18.5 | 18.8 | 20.1 | 21.0 | 24.8 | 27.0 |
(b) 75° | ||||||||||||||||||||||||||||||
640 ×480 | 4.3 | 4.6 | 5.5 | 7.0 | 9.5 | 12.9 | 21.2 | 19.4 | 40.3 | 41.6 | 4.0 | 4.3 | 5.1 | 5.5 | 6.0 | 6.2 | 7.0 | 7.7 | 9.4 | 11.8 | 14.1 | 14.1 | 14.1 | 14.2 | 14.2 | 14.3 | 14.7 | 14.7 | 17.2 | 18.5 |
320 ×240 | 4.4 | 5.0 | 6.0 | 7.7 | 10.4 | 13.8 | 21.9 | 20.7 | 41.0 | 42.1 | 4.0 | 4.8 | 6.0 | 7.1 | 8.0 | 8.8 | 10.5 | 11.7 | 14.7 | 18.4 | 14.2 | 14.2 | 14.2 | 14.3 | 14.4 | 14.5 | 14.7 | 15.0 | 17.4 | 18.9 |
213 ×160 | 4.5 | 5.0 | 6.4 | 8.1 | 11.0 | 14.5 | 22.2 | 21.3 | 40.5 | 42.0 | 4.4 | 6.6 | 8.7 | 10.1 | 11.7 | 12.9 | 15.4 | 17.2 | 20.4 | 25.2 | 14.1 | 14.1 | 14.2 | 14.4 | 14.5 | 14.7 | 15.0 | 15.3 | 17.7 | 19.7 |
160 ×120 | 4.7 | 5.6 | 7.0 | 8.9 | 11.8 | 15.3 | 23.0 | 22.2 | 40.6 | 42.2 | 4.2 | 6.5 | 10.0 | 12.6 | 15.5 | 17.2 | 20.2 | 22.5 | 26.6 | 32.4 | 14.5 | 14.6 | 14.7 | 14.8 | 14.7 | 15.0 | 15.4 | 15.6 | 18.5 | 19.8 |
128 ×96 | 4.7 | 5.9 | 7.8 | 9.9 | 12.9 | 16.0 | 23.5 | 23.4 | 40.6 | 42.0 | 5.2 | 7.0 | 9.5 | 12.9 | 16.6 | 20.2 | 24.8 | 28.1 | 32.3 | 37.3 | 15.4 | 15.4 | 15.4 | 15.6 | 15.7 | 15.8 | 16.6 | 16.6 | 19.2 | 21.2 |
106 ×80 | 5.1 | 6.5 | 8.5 | 10.9 | 13.9 | 17.2 | 23.9 | 23.9 | 40.4 | 42.1 | 7.3 | 9.1 | 11.6 | 14.3 | 17.0 | 20.3 | 26.3 | 30.4 | 36.6 | 40.9 | 15.6 | 15.7 | 15.9 | 16.2 | 16.4 | 16.7 | 17.3 | 17.7 | 20.8 | 23.0 |
80 ×60 | 5.7 | 8.3 | 10.7 | 13.1 | 16.1 | 18.9 | 25.6 | 25.8 | 39.9 | 42.8 | 17.5 | 17.6 | 18.5 | 19.3 | 21.3 | 22.6 | 26.7 | 30.2 | 37.7 | 43.9 | 16.4 | 17.0 | 17.3 | 17.9 | 18.4 | 18.9 | 20.2 | 20.9 | 24.8 | 27.1 |
(c) 65° | ||||||||||||||||||||||||||||||
640 ×480 | 4.2 | 4.7 | 5.7 | 7.4 | 9.6 | 13.3 | 20.3 | 21.8 | 39.4 | 42.1 | 3.9 | 4.9 | 5.5 | 6.0 | 6.3 | 6.9 | 7.7 | 8.3 | 9.7 | 12.2 | 14.6 | 14.6 | 14.7 | 14.7 | 14.7 | 14.8 | 14.9 | 15.4 | 17.5 | 18.4 |
320 ×240 | 4.4 | 4.8 | 6.2 | 8.1 | 10.6 | 14.4 | 21.4 | 23.1 | 40.0 | 42.5 | 4.1 | 5.4 | 6.5 | 7.6 | 8.5 | 9.5 | 11.2 | 12.8 | 15.7 | 19.9 | 14.7 | 14.7 | 14.8 | 14.8 | 14.8 | 15.0 | 15.1 | 15.5 | 17.6 | 18.9 |
213 ×160 | 4.3 | 5.1 | 6.5 | 8.5 | 10.8 | 14.7 | 21.5 | 23.1 | 39.7 | 42.2 | 4.0 | 6.6 | 8.8 | 10.8 | 12.5 | 13.9 | 16.5 | 18.3 | 21.9 | 27.4 | 15.0 | 15.0 | 14.9 | 15.1 | 15.1 | 15.2 | 15.5 | 15.9 | 18.1 | 19.6 |
160 ×120 | 4.5 | 5.8 | 7.1 | 9.4 | 12.0 | 15.5 | 22.4 | 24.2 | 40.1 | 42.5 | 4.6 | 6.8 | 10.0 | 13.1 | 15.9 | 18.8 | 21.7 | 23.9 | 27.9 | 34.0 | 15.0 | 15.1 | 15.2 | 15.4 | 15.4 | 15.5 | 15.8 | 16.2 | 18.7 | 19.7 |
128 ×96 | 4.7 | 5.9 | 7.7 | 10.1 | 12.7 | 16.6 | 22.7 | 24.7 | 39.7 | 42.4 | 5.5 | 7.6 | 9.5 | 12.6 | 15.7 | 18.8 | 23.8 | 28.0 | 32.6 | 38.3 | 15.6 | 15.6 | 15.7 | 15.7 | 16.1 | 16.1 | 16.5 | 16.9 | 19.1 | 20.9 |
106 ×80 | 5.0 | 6.8 | 9.0 | 11.2 | 13.6 | 17.4 | 23.4 | 25.1 | 39.6 | 42.5 | 8.4 | 9.5 | 12.0 | 14.0 | 16.5 | 19.6 | 23.7 | 28.5 | 36.2 | 42.0 | 16.2 | 16.2 | 16.2 | 16.3 | 16.5 | 16.8 | 17.1 | 17.6 | 20.5 | 22.7 |
80 ×60 | 5.5 | 8.3 | 11.0 | 12.8 | 15.8 | 19.3 | 24.9 | 26.9 | 39.3 | 42.8 | 24.9 | 23.9 | 24.4 | 24.2 | 24.9 | 25.7 | 27.9 | 30.0 | 35.6 | 43.8 | 16.9 | 17.2 | 17.7 | 17.9 | 18.5 | 18.7 | 19.7 | 20.3 | 24.1 | 26.2 |
(d) 55° | ||||||||||||||||||||||||||||||
640 ×480 | 5.0 | 5.5 | 6.3 | 7.9 | 10.0 | 13.5 | 19.6 | 23.7 | 38.1 | 42.6 | 4.7 | 5.5 | 6.3 | 7.2 | 7.6 | 8.2 | 9.2 | 9.8 | 11.3 | 13.8 | 14.6 | 14.6 | 14.6 | 14.6 | 14.6 | 14.7 | 14.8 | 15.2 | 17.1 | 18.3 |
320 ×240 | 5.2 | 5.8 | 6.9 | 8.7 | 10.8 | 14.5 | 20.7 | 24.8 | 38.9 | 43.0 | 4.6 | 5.9 | 7.2 | 8.5 | 10.0 | 10.8 | 12.8 | 14.1 | 17.2 | 21.0 | 14.6 | 14.7 | 14.7 | 14.7 | 14.8 | 14.9 | 15.2 | 15.4 | 17.3 | 18.8 |
213 ×160 | 5.2 | 5.9 | 7.0 | 9.0 | 11.1 | 14.7 | 20.8 | 24.9 | 38.5 | 42.7 | 4.7 | 6.9 | 9.5 | 11.8 | 13.8 | 15.9 | 18.5 | 20.5 | 24.1 | 29.1 | 14.7 | 14.7 | 14.8 | 15.0 | 15.2 | 15.1 | 15.4 | 15.7 | 17.7 | 19.5 |
160 ×120 | 5.4 | 6.3 | 7.5 | 9.6 | 12.1 | 15.5 | 21.4 | 25.6 | 39.0 | 43.0 | 4.8 | 6.9 | 9.8 | 13.0 | 16.3 | 19.3 | 23.1 | 26.2 | 30.5 | 35.3 | 14.9 | 15.0 | 15.1 | 15.2 | 15.4 | 15.4 | 15.7 | 16.0 | 18.5 | 19.9 |
128 ×96 | 5.5 | 6.5 | 8.1 | 10.2 | 12.7 | 16.2 | 22.0 | 25.9 | 38.6 | 42.8 | 7.2 | 9.3 | 11.9 | 14.5 | 17.0 | 19.9 | 24.9 | 28.6 | 34.3 | 39.6 | 15.4 | 15.5 | 15.6 | 15.7 | 15.9 | 16.0 | 16.3 | 16.7 | 19.0 | 20.8 |
106 ×80 | 5.9 | 7.2 | 9.0 | 11.1 | 13.3 | 17.1 | 22.7 | 26.4 | 38.7 | 42.7 | 12.0 | 13.6 | 15.3 | 17.1 | 19.1 | 21.7 | 24.8 | 28.9 | 35.5 | 41.5 | 16.1 | 16.1 | 16.4 | 16.4 | 16.5 | 16.8 | 17.1 | 17.5 | 20.4 | 22.7 |
80 ×60 | 5.9 | 8.0 | 10.1 | 12.9 | 15.1 | 18.5 | 24.0 | 27.5 | 38.6 | 42.9 | 25.2 | 26.1 | 26.3 | 27.3 | 27.8 | 28.6 | 30.2 | 31.2 | 34.7 | 40.5 | 16.8 | 17.1 | 17.3 | 17.8 | 18.1 | 18.5 | 19.2 | 19.9 | 22.9 | 25.7 |
Modal | Gait | Head | Height | |||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
SR ∖TR | 30 | 15 | 10 | 7.5 | 6 | 5 | 3.75 | 3 | 2 | 1 | 30 | 15 | 10 | 7.5 | 6 | 5 | 3.75 | 3 | 2 | 1 | 30 | 15 | 10 | 7.5 | 6 | 5 | 3.75 | 3 | 2 | 1 |
(a) 85° | ||||||||||||||||||||||||||||||
640 ×480 | 89.7 | 89.3 | 85.9 | 78.2 | 56.2 | 61.5 | 28.2 | 31.6 | 10.3 | 5.6 | 88.5 | 84.2 | 80.8 | 77.1 | 74.5 | 72.3 | 68.1 | 65.2 | 59.2 | 49.5 | 0.8 | 0.9 | 1.2 | 0.8 | 1.0 | 0.9 | 0.8 | 0.8 | 0.6 | 0.6 |
320 ×240 | 89.4 | 88.9 | 85.1 | 76.4 | 54.5 | 59.2 | 26.9 | 29.5 | 9.8 | 5.2 | 84.6 | 73.8 | 64.1 | 58.3 | 53.3 | 49.5 | 43.8 | 39.9 | 33.8 | 25.2 | 1.0 | 1.1 | 1.0 | 0.9 | 1.0 | 0.8 | 0.9 | 0.8 | 0.6 | 0.5 |
213 ×160 | 89.4 | 87.7 | 83.2 | 73.6 | 51.9 | 56.1 | 25.5 | 27.2 | 9.5 | 5.0 | 83.4 | 66.3 | 53.4 | 44.5 | 39.0 | 34.8 | 29.2 | 25.4 | 20.7 | 14.1 | 1.3 | 1.2 | 1.3 | 1.1 | 1.1 | 0.9 | 0.9 | 0.7 | 0.6 | 0.5 |
160 ×120 | 87.6 | 85.9 | 79.8 | 68.5 | 48.2 | 49.8 | 23.4 | 24.5 | 8.8 | 4.6 | 82.8 | 65.8 | 51.9 | 41.3 | 35.3 | 29.8 | 23.1 | 19.3 | 14.1 | 8.6 | 1.2 | 1.4 | 1.2 | 1.2 | 1.1 | 0.9 | 0.9 | 0.8 | 0.6 | 0.5 |
128 ×96 | 85.4 | 82.4 | 74.9 | 64.2 | 44.4 | 45.7 | 21.3 | 21.9 | 8.2 | 4.3 | 69.5 | 56.0 | 44.4 | 36.5 | 31.0 | 25.6 | 20.2 | 16.5 | 11.8 | 6.6 | 1.4 | 1.5 | 1.5 | 1.3 | 1.2 | 1.0 | 0.8 | 0.7 | 0.6 | 0.5 |
106 ×80 | 83.2 | 79.5 | 70.5 | 57.2 | 39.7 | 38.7 | 18.7 | 18.2 | 7.2 | 3.8 | 55.0 | 42.1 | 34.7 | 28.2 | 23.6 | 21.1 | 16.7 | 13.5 | 10.2 | 5.5 | 1.5 | 1.4 | 1.3 | 1.0 | 1.0 | 0.9 | 0.8 | 0.6 | 0.5 | 0.4 |
80 ×60 | 82.4 | 68.6 | 56.0 | 47.0 | 32.3 | 29.5 | 14.7 | 13.2 | 5.8 | 3.0 | 30.3 | 23.9 | 19.4 | 16.0 | 14.6 | 13.1 | 10.7 | 10.1 | 8.0 | 5.0 | 1.7 | 1.2 | 1.2 | 1.0 | 0.9 | 0.7 | 0.6 | 0.5 | 0.4 | 0.3 |
(b) 75° | ||||||||||||||||||||||||||||||
640 ×480 | 90.0 | 89.1 | 86.3 | 77.8 | 56.8 | 55.3 | 26.8 | 26.2 | 10.0 | 5.0 | 87.3 | 82.7 | 77.0 | 72.8 | 69.5 | 67.3 | 61.9 | 59.0 | 53.6 | 46.8 | 0.8 | 0.8 | 0.9 | 0.8 | 0.8 | 0.8 | 0.8 | 0.7 | 0.6 | 0.6 |
320 ×240 | 89.7 | 88.7 | 85.5 | 76.3 | 55.2 | 53.5 | 25.4 | 24.8 | 9.4 | 4.6 | 84.3 | 71.2 | 62.2 | 54.6 | 48.5 | 45.2 | 38.7 | 35.3 | 29.0 | 23.0 | 1.2 | 1.0 | 0.8 | 0.9 | 1.2 | 0.9 | 0.8 | 0.8 | 0.6 | 0.5 |
213 ×160 | 89.2 | 87.8 | 83.3 | 72.8 | 52.3 | 49.8 | 24.5 | 23.3 | 9.0 | 4.3 | 82.8 | 63.9 | 50.5 | 41.5 | 35.2 | 30.6 | 25.2 | 21.6 | 17.3 | 12.2 | 0.9 | 1.1 | 1.1 | 1.1 | 0.9 | 0.9 | 0.7 | 0.7 | 0.6 | 0.5 |
160 ×120 | 88.2 | 85.8 | 80.9 | 68.5 | 49.4 | 45.9 | 22.4 | 21.3 | 8.5 | 4.1 | 80.8 | 64.8 | 51.9 | 41.6 | 34.3 | 28.6 | 22.1 | 17.8 | 12.6 | 7.7 | 1.4 | 1.3 | 1.2 | 1.2 | 0.9 | 0.9 | 0.7 | 0.7 | 0.6 | 0.5 |
128 ×96 | 85.1 | 82.5 | 74.9 | 63.7 | 44.9 | 42.0 | 20.6 | 18.7 | 7.8 | 3.8 | 66.9 | 54.1 | 42.9 | 34.5 | 29.7 | 25.7 | 19.3 | 15.6 | 11.0 | 6.6 | 1.5 | 1.7 | 1.3 | 1.4 | 1.1 | 0.9 | 0.7 | 0.7 | 0.5 | 0.5 |
106 ×80 | 84.9 | 80.1 | 71.1 | 56.9 | 40.8 | 35.5 | 18.7 | 16.6 | 7.2 | 3.4 | 47.2 | 37.8 | 31.3 | 26.2 | 22.0 | 19.5 | 15.5 | 13.2 | 9.5 | 5.9 | 1.0 | 1.2 | 1.4 | 1.0 | 1.0 | 0.8 | 0.6 | 0.6 | 0.5 | 0.4 |
80 ×60 | 82.5 | 71.3 | 56.1 | 48.5 | 32.2 | 28.6 | 14.5 | 12.4 | 5.8 | 2.9 | 26.0 | 21.7 | 17.2 | 15.7 | 14.0 | 12.6 | 10.6 | 9.2 | 7.4 | 5.0 | 1.3 | 1.4 | 1.0 | 1.0 | 0.7 | 0.7 | 0.6 | 0.5 | 0.4 | 0.3 |
(c) 65° | ||||||||||||||||||||||||||||||
640 ×480 | 89.3 | 88.8 | 86.3 | 77.5 | 59.0 | 48.4 | 26.4 | 22.1 | 9.5 | 4.5 | 88.1 | 82.3 | 75.5 | 71.6 | 67.7 | 64.3 | 59.3 | 55.8 | 50.5 | 43.5 | 0.8 | 1.0 | 0.9 | 0.8 | 0.7 | 0.8 | 0.7 | 0.7 | 0.6 | 0.5 |
320 ×240 | 89.3 | 88.7 | 85.7 | 75.9 | 57.4 | 46.3 | 25.0 | 21.0 | 8.9 | 4.1 | 83.7 | 69.6 | 59.3 | 51.4 | 46.2 | 41.3 | 35.6 | 31.5 | 26.1 | 20.1 | 1.2 | 1.0 | 0.9 | 0.9 | 0.8 | 0.9 | 0.7 | 0.7 | 0.6 | 0.5 |
213 ×160 | 89.2 | 87.6 | 83.8 | 73.1 | 54.7 | 44.5 | 24.3 | 20.0 | 8.7 | 4.0 | 82.9 | 66.2 | 51.6 | 41.6 | 34.3 | 29.9 | 23.5 | 19.9 | 15.6 | 10.4 | 1.1 | 1.2 | 1.2 | 0.9 | 0.9 | 0.9 | 0.8 | 0.8 | 0.6 | 0.5 |
160 ×120 | 87.8 | 85.8 | 80.8 | 69.0 | 50.2 | 40.6 | 22.1 | 18.1 | 8.0 | 3.7 | 76.0 | 61.3 | 48.1 | 39.2 | 31.8 | 26.7 | 20.6 | 16.8 | 12.1 | 7.3 | 1.1 | 1.2 | 1.2 | 1.1 | 1.0 | 0.9 | 0.7 | 0.7 | 0.6 | 0.5 |
128 ×96 | 86.6 | 83.8 | 78.2 | 65.5 | 47.5 | 37.5 | 20.6 | 16.6 | 7.7 | 3.6 | 61.9 | 48.4 | 37.8 | 31.5 | 26.5 | 22.9 | 18.5 | 15.0 | 11.1 | 6.5 | 1.4 | 1.2 | 1.2 | 1.0 | 1.0 | 0.9 | 0.7 | 0.7 | 0.5 | 0.5 |
106 ×80 | 84.7 | 80.8 | 72.7 | 58.8 | 42.5 | 33.9 | 18.5 | 14.9 | 6.9 | 3.3 | 44.1 | 32.3 | 26.6 | 22.3 | 19.9 | 17.5 | 14.2 | 12.2 | 9.4 | 6.0 | 1.1 | 1.5 | 1.2 | 1.0 | 1.0 | 0.8 | 0.7 | 0.6 | 0.5 | 0.4 |
80 ×60 | 82.5 | 72.3 | 56.1 | 48.3 | 33.3 | 26.9 | 15.1 | 11.2 | 5.8 | 2.7 | 16.0 | 15.0 | 11.2 | 10.8 | 9.3 | 9.3 | 8.1 | 7.5 | 6.5 | 4.9 | 1.4 | 1.3 | 1.0 | 0.9 | 0.8 | 0.7 | 0.6 | 0.5 | 0.4 | 0.3 |
(d) 55° | ||||||||||||||||||||||||||||||
640 ×480 | 88.0 | 87.3 | 85.1 | 76.8 | 63.7 | 46.4 | 27.2 | 21.1 | 9.7 | 4.5 | 84.7 | 76.8 | 69.6 | 63.4 | 58.8 | 55.2 | 50.3 | 47.5 | 43.4 | 37.2 | 0.9 | 0.7 | 0.7 | 0.8 | 0.7 | 0.6 | 0.8 | 0.7 | 0.6 | 0.5 |
320 ×240 | 87.1 | 86.2 | 84.0 | 75.1 | 61.9 | 44.9 | 26.0 | 19.9 | 9.0 | 4.2 | 81.9 | 66.8 | 54.3 | 46.9 | 40.1 | 36.4 | 30.2 | 27.4 | 23.0 | 18.1 | 0.8 | 1.1 | 0.9 | 0.9 | 0.8 | 0.7 | 0.7 | 0.7 | 0.6 | 0.5 |
213 ×160 | 86.9 | 85.4 | 83.2 | 73.7 | 58.7 | 42.3 | 24.7 | 19.0 | 8.7 | 4.0 | 77.9 | 59.7 | 47.1 | 36.3 | 29.7 | 25.7 | 19.7 | 16.9 | 12.9 | 9.1 | 1.2 | 1.0 | 1.2 | 1.0 | 0.9 | 0.8 | 0.7 | 0.7 | 0.6 | 0.5 |
160 ×120 | 87.2 | 85.0 | 81.6 | 70.1 | 55.1 | 40.4 | 23.4 | 17.7 | 8.3 | 3.8 | 68.3 | 51.7 | 39.3 | 31.1 | 25.5 | 22.2 | 17.5 | 14.9 | 10.9 | 7.1 | 1.0 | 1.2 | 1.1 | 1.1 | 0.9 | 0.9 | 0.7 | 0.7 | 0.6 | 0.5 |
128 ×96 | 86.3 | 83.4 | 78.5 | 66.4 | 52.1 | 38.0 | 22.4 | 16.5 | 7.8 | 3.6 | 44.8 | 33.9 | 26.2 | 21.0 | 18.5 | 16.3 | 13.7 | 11.7 | 9.2 | 6.0 | 1.6 | 1.6 | 1.3 | 1.1 | 1.0 | 0.9 | 0.7 | 0.6 | 0.5 | 0.5 |
106 ×80 | 83.6 | 80.6 | 74.2 | 61.3 | 47.7 | 34.4 | 19.7 | 15.0 | 7.3 | 3.4 | 36.0 | 27.1 | 20.6 | 17.5 | 15.1 | 13.5 | 11.4 | 10.2 | 8.0 | 5.6 | 1.2 | 1.5 | 1.2 | 1.0 | 0.8 | 0.8 | 0.7 | 0.7 | 0.5 | 0.4 |
80 ×60 | 82.8 | 72.4 | 58.2 | 51.4 | 38.1 | 27.6 | 15.9 | 11.6 | 5.7 | 2.9 | 3.4 | 3.8 | 4.6 | 4.0 | 4.4 | 4.2 | 4.3 | 4.4 | 4.3 | 3.8 | 1.2 | 1.3 | 1.2 | 0.9 | 0.8 | 0.7 | 0.6 | 0.6 | 0.4 | 0.3 |
4.3 Evaluation protocols for score-level fusion
4.4 Benchmarks for score-level fusion
4.5 Evaluation result for score-level fusion
Fusion rule | Bi-modal (gait and head) | Multi-modal (gait, head, and height) | ||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Q
H
H85
|
Q
H
L85
|
Q
L
H85
|
Q
L
L85
|
Q
H
H55
|
Q
H
L55
|
Q
L
H55
|
Q
L
L55
|
Q
H
H85
|
Q
H
L85
|
Q
L
H85
|
Q
L
L85
|
Q
H
H55
|
Q
H
L55
|
Q
L
H55
|
Q
L
L55
| |
Sum | 2.3 | 29.0 | 4.4 | 40.1 | 3.3 | 32.7 | 5.6 | 41.4 | 1.9 | 23.0 | 3.9 | 33.9 | 2.8 | 26.4 | 4.7 | 34.6 |
Min | 4.2 | 10.8 | 4.9 | 43.4 | 4.5 | 13.8 | 5.7 | 40.5 | 4.2 | 17.0 | 4.9 | 31.7 | 4.5 | 15.8 | 5.7 | 36.5 |
SVM | 1.9 | 32.9 | 3.3 | 47.8 | 2.9 | 28.6 | 7.2 | 50.2 | 1.6 | 18.0 | 2.7 | 38.1 | 2.7 | 17.3 | 6.6 | 41.8 |
GMM |
1.6
|
10.6
|
2.6
|
39.1
|
2.5
|
13.5
|
4.4
|
37.2
|
1.5
| 8.5 |
2.1
|
25.6
|
2.4
| 10.3 | 4.2 | 25.1 |
LLR |
1.7
|
10.6
|
2.5
| 39.8 |
2.7
|
13.6
|
4.4
| 40.4 |
1.4
|
7.3
|
2.0
|
25.6
|
2.2
|
8.8
|
3.8
|
24.0
|
KDE | 1.8 | 10.8 | 3.7 |
39.2
|
2.7
| 15.6 | 5.7 |
37.3
| 1.6 | 8.3 | 3.6 | 48.8 |
2.4
| 11.7 | 4.9 | 44.2 |
RankSVM |
1.7
| 10.7 |
2.6
| 39.8 | 2.8 |
13.6
| 4.5 | 40.4 | 1.6 |
7.0
|
2.1
|
25.6
| 2.7 |
8.7
|
4.1
|
24.1
|
Fusion rule | Bi-modal (gait and head) | Multi-modal (gait, head, and height) | ||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Q
H
H85
|
Q
H
L85
|
Q
L
H85
|
Q
L
L85
|
Q
H
H55
|
Q
H
L55
|
Q
L
H55
|
Q
L
L55
|
Q
H
H85
|
Q
H
L85
|
Q
L
H85
|
Q
L
L85
|
Q
H
H55
|
Q
H
L55
|
Q
L
H55
|
Q
L
L55
| |
Sum | 3.2 | 82.7 | 10.3 | 92 | 5.5 | 86.6 | 11.3 | 92.4 | 2.5 | 78.0 | 10.4 | 89.9 | 4.3 | 83.2 | 11.9 | 90.8 |
Min | 7.4 | 38.4 | 12.3 | 92.9 | 9.5 | 51.5 | 11.8 | 92.8 | 7.4 | 89.9 | 12.3 | 92.9 | 9.5 | 82.7 | 11.8 | 92.8 |
SVM |
2.0
| 87.5 | 5.1 | 95.5 |
3.6
| 84.9 | 10.9 | 96.6 |
1.7
| 74.6 | 3.8 | 93.4 |
3.0
| 76.3 | 9.7 | 95.6 |
GMM |
1.9
|
36.6
| 4.7 |
89.9
|
3.7
|
49.7
|
9.3
|
90.2
| 1.8 | 45.0 | 3.6 |
86.0
| 3.3 | 53.3 | 9.3 | 89.5 |
LLR | 2.2 | 37.8 |
4.3
| 92.2 | 3.9 |
51.4
| 9.4 | 92.2 |
1.7
| 29.1 |
3.2
| 88.5 | 3.5 |
43.3
|
8.6
|
87.7
|
KDE | 2.1 |
37.1
| 6.7 |
90.7
| 3.9 | 99.7 | 10.7 |
91.6
| 1.9 |
26.8
| 6.9 | 95.1 |
3.2
| 99.0 | 11.3 | 92.4 |
RankSVM | 2.2 | 37.9 |
4.4
| 92.1 | 4.4 | 51.9 |
9.3
| 92.2 | 1.9 |
26.5
|
3.5
|
88.3
| 4.1 |
40.6
|
8.6
|
88.0
|
Fusion rule | Bi-modal (gait and head) | Multi-modal (gait, head, and height) | ||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Q
H
H85
|
Q
H
L85
|
Q
L
H85
|
Q
L
L85
|
Q
H
H55
|
Q
H
L55
|
Q
L
H55
|
Q
L
L55
|
Q
H
H85
|
Q
H
L85
|
Q
L
H85
|
Q
L
L85
|
Q
H
H55
|
Q
H
L55
|
Q
L
H55
|
Q
L
L55
| |
Sum | 1.0 | 56.6 | 2.5 | 73.3 | 1.6 | 64.4 | 3.7 | 75.5 | 0.6 | 45.9 | 1.7 | 65.8 | 1.3 | 54.7 | 2.1 | 68.0 |
Min | 0.9 | 11.5 | 2.2 | 77.1 |
1.1
| 17.9 | 4.4 | 70.2 | 0.9 | 40.2 | 2.2 | 75.4 | 1.1 | 32.9 | 4.4 | 70.2 |
SVM | 1.6 | 61.6 | 2.5 | 82.5 | 2.4 | 54.3 | 6.3 | 86.2 | 1.3 | 34.2 | 2.3 | 75.4 | 2.3 | 34.2 | 6.0 | 79.3 |
GMM |
0.6
|
11.0
|
0.9
|
69.2
|
1.1
|
17.2
|
2.6
|
66.2
| 0.6 | 6.5 | 0.9 |
53.0
|
0.9
| 11.6 | 2.0 |
52.1
|
LLR |
0.7
|
11.2
|
0.9
| 73.1 |
1.1
|
17.4
|
2.5
| 74.0 |
0.5
|
5.0
|
0.6
|
53.5
|
0.7
|
7.5
|
1.9
| 55.0 |
KDE | 0.9 | 11.4 | 2.3 |
69.3
| 1.6 | 24.5 | 4.1 |
66.1
| 0.6 | 7.1 | 2.0 | 82.8 | 1.2 | 14.4 | 3.1 | 73.9 |
RankSVM | 0.8 |
11.2
|
0.9
| 73.1 | 1.2 | 17.5 |
2.6
| 74.0 |
0.5
|
5.1
|
0.6
|
53.5
|
0.9
|
7.4
|
1.9
|
54.7
|
Fusion rule | Bi-modal (gait and head) | Multi-modal (gait, head, and height) | ||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Q
H
H85
|
Q
H
L85
|
Q
L
H85
|
Q
L
L85
|
Q
H
H55
|
Q
H
L55
|
Q
L
H55
|
Q
L
L55
|
Q
H
H85
|
Q
H
L85
|
Q
L
H85
|
Q
L
L85
|
Q
H
H55
|
Q
H
L55
|
Q
L
H55
|
Q
L
L55
| |
Sum | 0.5 | 20.1 | 1.1 | 35.6 | 0.7 | 25.2 | 1.5 | 37.3 | 0.3 | 13.9 | 0.8 | 27.0 | 0.4 | 17.7 | 0.9 | 27.8 |
Min | 0.6 | 4.6 | 0.9 | 39.6 | 0.7 | 6.7 | 1.5 | 36.8 | 0.5 | 9.7 | 0.9 | 24.5 | 0.6 | 8.4 | 1.5 | 29.6 |
SVM | 0.8 | 26.6 | 1.0 | 46.5 | 1.4 | 22.4 | 3.4 | 50.0 | 0.8 | 10.5 | 0.8 | 32.4 | 1.3 | 9.6 | 3.1 | 38.4 |
GMM |
0.3
|
4.5
| 0.6 |
33.7
|
0.5
|
6.4
|
1.1
|
32.1
| 0.3 | 3.1 | 0.4 |
16.6
|
0.3
| 4.3 |
0.8
| 15.9 |
LLR |
0.3
|
4.5
|
0.4
| 35.0 |
0.5
|
6.6
|
1.0
| 36.1 |
0.2
|
2.2
|
0.3
|
17.3
|
0.3
|
3.2
|
0.7
|
15.8
|
KDE |
0.3
| 4.8 | 0.7 |
33.9
| 0.6 | 10.6 | 1.6 |
32.3
| 0.3 | 2.8 | 0.7 | 48.9 | 0.5 | 7.6 | 1.1 | 41.6 |
RankSVM | 0.4 |
4.5
|
0.4
| 35.0 |
0.5
|
6.6
|
1.1
| 36.1 |
0.2
|
2.3
|
0.3
|
17.3
|
0.3
|
3.2
|
0.8
|
15.8
|
Fusion rule | Bi-modal (gait and head) | Multi-modal (gait, head, and height) | ||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Q
H
H85
|
Q
H
L85
|
Q
L
H85
|
Q
L
L85
|
Q
H
H55
|
Q
H
L55
|
Q
L
H55
|
Q
L
L55
|
Q
H
H85
|
Q
H
L85
|
Q
L
H85
|
Q
L
L85
|
Q
H
H55
|
Q
H
L55
|
Q
L
H55
|
Q
L
L55
| |
Sum | 2.1 | 28.6 | 4.3 | 39.9 | 3.3 | 32.6 | 5.3 | 41.1 | 1.8 | 22.6 | 4.0 | 33.9 | 2.6 | 26.1 | 4.7 | 34.6 |
Min | 3.9 | 10.7 | 5.1 | 43.5 | 4.4 | 13.9 | 5.4 | 38.9 | 3.9 | 15.0 | 5.1 | 30.1 | 4.4 | 14.4 | 5.4 | 32.7 |
SVM |
1.5
| 32.8 | 2.8 | 45.1 |
2.3
| 28.4 | 5.2 | 46.5 |
1.3
| 17.2 | 2.2 | 37.2 |
2.0
| 16.3 | 4.9 | 40.0 |
GMM |
1.5
|
10.5
|
2.5
|
38.5
|
2.3
|
13.5
|
4.3
|
36.3
|
1.4
| 8.1 |
2.1
|
24.4
|
2.2
| 9.7 |
4.1
| 23.6 |
LLR | 1.6 |
10.6
|
2.5
| 39.6 | 2.5 |
13.6
|
4.3
| 40.0 |
1.4
|
7.3
|
2.0
|
24.9
| 2.3 |
8.8
|
3.7
|
23.1
|
KDE |
1.5
| 10.7 | 3.4 |
38.5
| 2.5 | 15.6 | 5.2 |
36.4
|
1.4
| 8.2 | 3.5 | 50.0 |
2.2
| 11.7 | 4.8 | 50.0 |
RankSVM | 1.6 |
10.6
| 2.6 | 39.6 | 2.6 | 13.7 | 4.5 | 40.0 | 1.5 |
7.0
| 2.2 | 25.0 | 2.5 |
8.7
|
4.1
|
23.2
|
Bi-modal (gait and head) | Multi-modal (gait, head, and height) | |||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Fusion rule | Rank-1[%] | |||||||||||||||
Q
H
H85
|
Q
H
L85
|
Q
L
H85
|
Q
L
L85
|
Q
H
H55
|
Q
H
L55
|
Q
L
H55
|
Q
L
L55
|
Q
H
H85
|
Q
H
L85
|
Q
L
H85
|
Q
L
L85
|
Q
H
H55
|
Q
H
L55
|
Q
L
H55
|
Q
L
L55
| |
Sum | 96.3 | 14.3 | 88.0 | 4.1 | 94.9 | 9.2 | 86.6 | 4.0 | 97.2 | 17.5 | 85.4 | 4.8 | 96.1 | 11.7 | 82.3 | 4.7 |
Min | 91.8 |
54.9
| 85.0 |
6.0
| 90.7 |
43.6
| 84.3 |
5.0
| 91.7 | 5.4 | 85.0 |
5.9
| 90.7 | 12.1 | 84.3 | 5.0 |
SVM | 96.8 | 10.1 | 90.9 | 2.2 | 95.4 | 10.0 | 84.7 | 1.5 | 97.3 | 16.0 | 91.3 | 3.4 | 96.1 | 14.0 | 85.4 | 1.7 |
GMM |
97.2
|
54.5
| 91.0 |
5.8
|
96.2
|
41.4
| 87.4 |
5.3
| 97.0 | 41.3 | 90.3 | 5.0 | 96.3 | 30.9 | 84.6 | 4.1 |
LLR |
97.2
| 53.0 |
92.5
| 3.9 |
96.4
| 40.5 |
88.8
| 4.0 |
97.7
| 52.8 |
91.4
|
5.2
|
96.8
|
39.1
|
86.8
|
5.2
|
KDE | 96.5 | 51.3 | 88.1 | 5.3 | 94.9 | 15.9 | 84.1 | 4.1 | 97.1 |
58.1
| 86.5 | 2.0 | 95.8 | 20.4 | 82.5 | 2.8 |
RankSVM |
97.2
| 52.8 |
92.6
| 4.0 |
96.2
| 39.7 |
88.7
| 4.0 |
97.7
|
56.2
|
91.6
| 5.1 |
96.5
|
42.4
|
87.4
|
5.1
|
Rank-5[%] | ||||||||||||||||
Sum | 98.2 | 22.2 | 95.8 | 8.3 | 97.5 | 14.7 | 94.1 | 7.7 | 98.9 | 28.0 | 94.3 |
10.6
| 98.4 | 19.3 | 93.5 | 10.2 |
Min | 96.6 |
72.9
| 93.2 | 10.2 | 96.0 |
64.8
| 91.0 |
10.4
| 96.4 | 9.9 | 93.2 | 9.9 | 96.0 | 17.2 | 91.0 | 10.4 |
SVM | 97.9 | 17.2 | 95.4 | 4.5 | 97.0 | 18.9 | 90.5 | 3.1 | 98.4 | 29.4 | 96.0 | 7.1 | 97.1 | 26.8 | 91.9 | 3.8 |
GMM |
98.7
|
72.7
| 96.1 |
11.6
|
98.1
|
63.6
| 94.0 |
11.3
| 98.6 | 58.5 | 96.1 |
12.1
| 98.3 | 50.0 | 94.0 | 10.9 |
LLR |
98.7
| 71.1 |
97.0
| 8.1 |
98.1
| 61.4 |
95.1
| 8.0 |
99.1
| 73.1 |
97.1
| 10.5 |
98.9
|
62.0
|
95.8
|
12.1
|
KDE | 97.9 | 70.5 | 93.1 |
10.9
| 96.7 | 35.6 | 90.5 | 9.9 | 98.2 |
77.2
| 92.9 | 4.4 | 97.1 | 42.4 | 90.7 | 6.8 |
RankSVM |
98.7
| 70.9 |
96.9
| 8.2 |
98.1
| 60.4 |
95.0
| 8.0 |
99.1
|
76.3
|
97.2
|
10.6
|
98.6
|
66.6
|
95.8
|
11.9
|
Fusion rule | Training set | EER [%] | FRR 1%
[%] | FRR 10%
[%] | AUC [%] | HTER [%] | Rank-1 [%] | Rank-5 [%] |
---|---|---|---|---|---|---|---|---|
Sum |
Q
H
H85
| 33.2 | 74.5 | 50.4 | 23.3 | 41.2 | 38.5 | 50.6 |
GMM | 26.4 | 76.4 | 40.1 | 19.5 | 32.5 | 26.0 | 38.7 | |
LLR | 25.8 | 71.1 | 43.5 | 16.8 | 34.2 |
41.8
|
56.1
| |
RankSVM | 28.8 | 72.2 | 46.1 | 18.4 | 37.2 |
40.9
| 54.4 | |
GMM (Q-stack) | Set 1 | 49.9 | 99.0 | 89.9 | 49.9 | 49.9 | 0.1 | 0.5 |
LLR (Q-stack) |
13.0
|
69.8
|
18.9
|
5.5
|
12.5
| 31.1 | 48.1 | |
RankSVM (Q-stack) |
20.9
|
68.4
|
37.4
|
11.0
|
26.1
| 38.7 |
54.6
|
Data set | SR [pixels] | TR [fps] | View [deg] | |
---|---|---|---|---|
Training | Set 1 | 640 × 480, 213 × 160, 128 × 96, 80 × 60 | 30, 10, 7.5, 5, 3, 1 | 85, 55 |
Set 2 | 640 × 480, 213 × 160, 128 × 96, 80 × 60 | 30, 1 | ||
Set 3 | 640 × 480, 213 × 160, 128 × 96, 80 × 60 | 10, 7.5, 5, 3 | ||
Set 4 | 640 × 480, 213 × 160, 128 × 96, 80 × 60 | 7.5, 5 | ||
Set 5 | 640 × 480, 80 × 60 | 30, 10, 7.5, 5, 3, 1 | ||
Set 6 | 640 × 480, 80 × 60 | 30, 1 | ||
Set 7 | 640 × 480, 80 × 60 | 10, 7.5, 5, 3 | ||
Set 8 | 640 × 480, 80 × 60 | 7.5, 5 | ||
Set 9 | 213 × 160, 128 × 96 | 30, 10, 7.5, 5, 3, 1 | ||
Set 10 | 213 × 160, 128 × 96 | 30, 1 | ||
Set 11 | 213 × 160, 128 × 96 | 10, 7.5, 5, 3 | ||
Set 12 | 213 × 160, 128 × 96 | 7.5, 5 | ||
Test | 320 × 240, 160 × 120, 106 × 80 | 15, 6, 3.75, 2 | 75, 65 |
Fusion rule | Training set | EER [%] | FRR 1%
[%] | FRR 10%
[%] | AUC [%] | HTER [%] | Rank-1 [%] | Rank-5 [%] |
---|---|---|---|---|---|---|---|---|
LLR (Q-stack) | Set 1 |
13.0
| 69.8 | 18.9 |
5.5
|
12.5
| 31.1 | 48.1 |
Set 2 |
13.0
| 73.9 | 19.3 | 5.7 | 14.6 | 29.1 | 45.8 | |
Set 3 | 13.8 | 53.7 |
18.2
| 5.9 | 15.7 | 40.2 | 55.9 | |
Set 4 | 15.8 |
50.6
| 21.8 | 7.3 | 19.2 |
41.7
|
56.7
| |
Set 5 | 13.1 | 69.2 | 18.9 |
5.5
| 12.6 | 32.2 | 49.3 | |
Set 6 | 13.3 | 74.3 | 19.7 | 5.8 | 13.5 | 30.0 | 47.0 | |
Set 7 | 14.1 | 52.2 | 18.6 | 6.1 | 16.6 | 41.2 | 56.9 | |
Set 8 | 16.2 |
49.3
| 22.4 | 7.7 | 20.3 |
42.3
|
57.5
| |
Set 9 |
12.9
| 69.3 | 18.8 |
5.4
|
12.4
| 29.5 | 46.3 | |
Set 10 |
13.0
| 73.6 | 19.0 | 5.7 | 14.0 | 27.5 | 43.6 | |
Set 11 | 13.4 | 53.6 |
17.7
| 5.6 | 15.0 | 39.3 | 55.1 | |
Set 12 | 15.2 | 50.9 | 20.8 | 6.9 | 18.0 | 41.1 | 56.2 |