MINEX Test Results

False Non-Match Rates at a fixed False Match Rate of 0.01

NF=2 A B C D F G 1A 1C 1D 1E 1F 1G 1H 1I 1J 1K 1L 1N 1O 1P 1Q 1R 1S 1T 1U 1V 1W 1X 1Z 2A 2C 2D
A 0.0011 0.0095 0.0077 0.0022 0.0078 0.0050 0.0260 0.0071 0.0941 0.0036 0.0051 0.0051 0.0541 0.0063 0.0067 0.0798 0.0028 0.0178 0.0061 0.0111 0.0090 0.0065 0.0548 0.0072 0.0092 0.0128 0.0051 0.0366 0.0157 0.0077 0.0048 0.0043
B 0.0027 0.0026 0.0070 0.0017 0.0069 0.0019 0.0200 0.0054 0.0312 0.0021 0.0044 0.0044 0.0583 0.0044 0.0042 0.0499 0.0025 0.0157 0.0072 0.0047 0.0047 0.0044 0.1335 0.0037 0.0104 0.0083 0.0031 0.0730 0.0180 0.0070 0.0035 0.0041
C 0.0054 0.0062 0.0032 0.0025 0.0033 0.0042 0.0194 0.0061 0.0294 0.0033 0.0058 0.0058 0.1347 0.0065 0.0037 0.0705 0.0031 0.0129 0.0222 0.0052 0.0044 0.0063 0.2995 0.0039 0.0178 0.0097 0.0030 0.1393 0.0248 0.0032 0.0064 0.0045
D 0.0022 0.0048 0.0048 0.0012 0.0047 0.0037 0.0231 0.0070 0.0372 0.0015 0.0052 0.0052 0.0511 0.0049 0.0036 0.0738 0.0029 0.0133 0.0112 0.0049 0.0046 0.0049 0.0887 0.0035 0.0104 0.0100 0.0031 0.0553 0.0123 0.0048 0.0045 0.0048
E 0.0026 0.0061 0.0057 0.0030 0.0056 0.0035 0.0324 0.0057 0.0369 0.0038 0.0038 0.0038 0.0579 0.0082 0.0048 0.0894 0.0032 0.0095 0.0121 0.0111 0.0098 0.0086 0.1207 0.0026 0.0135 0.0113 0.0048 0.0667 0.0188 0.0057 0.0053 0.0031
F 0.0054 0.0063 0.0033 0.0025 0.0033 0.0041 0.0192 0.0062 0.0297 0.0033 0.0057 0.0057 0.1336 0.0065 0.0038 0.0703 0.0031 0.0128 0.0222 0.0053 0.0044 0.0062 0.2947 0.0039 0.0180 0.0098 0.0030 0.1408 0.0245 0.0033 0.0065 0.0045
G 0.0042 0.0031 0.0082 0.0023 0.0082 0.0008 0.0225 0.0040 0.0279 0.0023 0.0042 0.0042 0.0670 0.0047 0.0043 0.0637 0.0028 0.0126 0.0082 0.0054 0.0060 0.0049 0.1175 0.0040 0.0120 0.0075 0.0033 0.0696 0.0244 0.0082 0.0032 0.0059
N 0.0062 0.0078 0.0086 0.0045 0.0086 0.0059 0.0270 0.0092 0.0452 0.0048 0.0053 0.0053 0.0614 0.0070 0.0061 0.0781 0.0043 0.0166 0.0147 0.0118 0.0114 0.0071 0.1253 0.0068 0.0155 0.0154 0.0073 0.0695 0.0260 0.0086 0.0059 0.0041
1A 0.0338 0.0326 0.0387 0.0280 0.0391 0.0277 0.0399 0.0465  
1B 0.0177 0.0246 0.0188 0.0106 0.0187 0.0122  
1C 0.0028 0.0053 0.0033 0.0022 0.0034 0.0016 0.0257 0.0021 0.0219 0.0029 0.0038 0.0038 0.0753 0.0082 0.0030 0.0680 0.0025 0.0059 0.0136 0.0078 0.0062 0.0090 0.3557 0.0015 0.0134 0.0065 0.0030 0.1413 0.0246 0.0033 0.0049 0.0036
1D 0.0093 0.0063 0.0094 0.0040 0.0097 0.0027 0.0076 0.0241 0.0053 0.0074 0.0074 0.0717 0.0072 0.0066 0.0738 0.0048 0.0164 0.0171 0.0059 0.0072 0.0072 0.1702 0.0081 0.0167 0.0101 0.0053 0.0937 0.0357 0.0094 0.0057 0.0053
1F 0.0043 0.0072 0.0089 0.0042 0.0088 0.0050 0.0085 0.0047 0.0042 0.0042 0.0521 0.0056 0.0061 0.0644 0.0030 0.0174 0.0094 0.0110 0.0088 0.0058 0.0979 0.0079 0.0119 0.0142 0.0050 0.0547 0.0241 0.0089 0.0050 0.0036
1G 0.0043 0.0073 0.0089 0.0042 0.0089 0.0050 0.0085 0.0047 0.0042 0.0042 0.0522 0.0056 0.0061 0.0645 0.0030 0.0174 0.0094 0.0111 0.0088 0.0058 0.0980 0.0079 0.0119 0.0143 0.0050 0.0548 0.0241 0.0089 0.0050 0.0036
1H 0.0081 0.0195 0.0312 0.0115 0.0308 0.0092 0.0264 0.0131 0.0130 0.0130 0.0540  
1I 0.0109 0.0103 0.0211 0.0079 0.0208 0.0044 0.0185 0.0090 0.0084 0.0084 0.0041  
1J 0.0085 0.0052 0.0042 0.0025 0.0041 0.0021 0.0060 0.0030 0.0059 0.0059 0.0049 0.0026 0.0486 0.0028 0.0120 0.0202 0.0046 0.0038 0.0052 0.3199 0.0033 0.0192 0.0093 0.0028 0.1648 0.0212 0.0042 0.0051 0.0051
1K 0.0155 0.0143 0.0233 0.0146 0.0235 0.0059 0.0157 0.0120 0.0111 0.0111 0.0076 0.0116 0.0370  
1L 0.0018 0.0042 0.0045 0.0017 0.0044 0.0021 0.0045 0.0025 0.0031 0.0031 0.0046 0.0036 0.0016 0.0099 0.0073 0.0072 0.0053 0.0050 0.0905 0.0029 0.0099 0.0094 0.0030 0.0466 0.0145 0.0045 0.0037 0.0028
1M 0.0040 0.0078 0.0054 0.0020 0.0055 0.0032 0.0064 0.0022 0.0058 0.0058 0.0060 0.0033 0.0033 0.0120 0.0186 0.0056 0.0033 0.0058 0.2277 0.0043 0.0154 0.0101 0.0023 0.1197 0.0145 0.0054 0.0050 0.0067
1N 0.0061 0.0083 0.0043 0.0027 0.0043 0.0027 0.0048 0.0035 0.0054 0.0054 0.0071 0.0039 0.0034 0.0074 0.0216 0.0071 0.0058 0.0076 0.1976 0.0030 0.0141 0.0095 0.0033 0.0951 0.0333 0.0043 0.0058 0.0036
1O 0.0082 0.0101 0.0289 0.0124 0.0286 0.0031 0.0150 0.0095 0.0087 0.0087 0.0054 0.0124 0.0048 0.0052  
1P 0.0149 0.0062 0.0119 0.0052 0.0119 0.0028 0.0154 0.0077 0.0101 0.0101 0.0069 0.0078 0.0061 0.0105 0.0044  
1R 0.0114 0.0118 0.0232 0.0084 0.0230 0.0065 0.0223 0.0102 0.0100 0.0100 0.0060 0.0111 0.0060 0.0056 0.1615  
1S 0.0145 0.0532 0.0249 0.0535 0.0634 0.0591 0.0325 0.0364 0.0364 0.0374 0.0478 0.0296 0.0338 0.0884  
1T 0.0029 0.0032 0.0018 0.0033 0.0029 0.0040 0.0022 0.0041 0.0041 0.0071 0.0028 0.0026 0.0069 0.0013 0.0151 0.0081 0.0027 0.0796 0.0159 0.0032 0.0050 0.0027
1U 0.0042 0.0175 0.0069 0.0174 0.0083 0.0203 0.0089 0.0100 0.0100 0.0116 0.0150 0.0065 0.0113 0.0233 0.0101  
1X 0.0130 0.0444 0.0178 0.0445 0.0287 0.0355 0.0187 0.0227 0.0227 0.0193 0.0325 0.0170 0.0184 0.0635 0.0175 0.0537  
1Y 0.0035 0.0048 0.0019 0.0048 0.0034 0.0062 0.0023 0.0055 0.0055 0.0056 0.0033 0.0031 0.0053 0.0039 0.0023 0.0123 0.0048 0.0047 0.0061
1Z 0.0050 0.0117 0.0035 0.0115 0.0067 0.0150 0.0034 0.0078 0.0078 0.0057 0.0065 0.0045 0.0054 0.0154 0.0045 0.0174  
2A 0.0054 0.0032 0.0025 0.0033 0.0042 0.0061 0.0033 0.0058 0.0058 0.0065 0.0039 0.0031 0.0063 0.0039 0.0030 0.0032 0.0064 0.0045
2B 0.0158 0.0218 0.0125 0.0218 0.0069 0.0227 0.0120 0.0118 0.0118 0.0081 0.0147 0.0076 0.0079 0.0290 0.0115 0.0218  
2C 0.0027 0.0073 0.0023 0.0074 0.0016 0.0049 0.0026 0.0033 0.0033 0.0027 0.0040 0.0022 0.0028 0.0050 0.0030 0.0073 0.0025 0.0026
2D 0.0062 0.0092 0.0048 0.0092 0.0046 0.0075 0.0050 0.0043 0.0043 0.0048 0.0061 0.0033 0.0053 0.0068 0.0050 0.0092 0.0044 0.0032
VTB 0.0081 0.0139 0.0274 0.0104 0.0271 0.0047 0.0230 0.0156 0.1294 0.0085 0.0106 0.0106 0.0601 0.0083 0.0139 0.0646 0.0070 0.0442   0.0165 0.0136 0.0089 0.0782 0.0287 0.0158 0.0190 0.0094 0.0646 0.0566 0.0274 0.0070 0.0084
Table 1: Results for all ongoing MINEX vendors.
NF=2 A B C D F G 1C 1E 1F 1G 1I 1J 1L 1R 1T 1W 2A 2C 2D Mean Median
A 0.0011 0.0095 0.0077 0.0022 0.0078 0.0050 0.0071 0.0036 0.0051 0.0051 0.0063 0.0067 0.0028 0.0065 0.0072 0.0051 0.0077 0.0048 0.0043 0.0056 0.0051
B 0.0027 0.0026 0.0070 0.0017 0.0069 0.0019 0.0054 0.0021 0.0044 0.0044 0.0044 0.0042 0.0025 0.0044 0.0037 0.0031 0.0070 0.0035 0.0041 0.0040 0.0041
C 0.0054 0.0062 0.0032 0.0025 0.0033 0.0042 0.0061 0.0033 0.0058 0.0058 0.0065 0.0037 0.0031 0.0063 0.0039 0.0030 0.0032 0.0064 0.0045 0.0045 0.0042
D 0.0022 0.0048 0.0048 0.0012 0.0047 0.0037 0.0070 0.0015 0.0052 0.0052 0.0049 0.0036 0.0029 0.0049 0.0035 0.0031 0.0048 0.0045 0.0048 0.0041 0.0047
E 0.0026 0.0061 0.0057 0.0030 0.0056 0.0035 0.0057 0.0038 0.0038 0.0038 0.0082 0.0048 0.0032 0.0086 0.0026 0.0048 0.0057 0.0053 0.0031 0.0047 0.0048
F 0.0054 0.0063 0.0033 0.0025 0.0033 0.0041 0.0062 0.0033 0.0057 0.0057 0.0065 0.0038 0.0031 0.0062 0.0039 0.0030 0.0033 0.0065 0.0045 0.0046 0.0041
G 0.0042 0.0031 0.0082 0.0023 0.0082 0.0008 0.0040 0.0023 0.0042 0.0042 0.0047 0.0043 0.0028 0.0049 0.0040 0.0033 0.0082 0.0032 0.0059 0.0044 0.0042
N 0.0062 0.0078 0.0086 0.0045 0.0086 0.0059 0.0092 0.0048 0.0053 0.0053 0.0070 0.0061 0.0043 0.0071 0.0068 0.0073 0.0086 0.0059 0.0041 0.0065 0.0062
1C 0.0028 0.0053 0.0033 0.0022 0.0034 0.0016 0.0021 0.0029 0.0038 0.0038 0.0082 0.0030 0.0025 0.0090 0.0015 0.0030 0.0033 0.0049 0.0036 0.0037 0.0033
1D 0.0093 0.0063 0.0094 0.0040 0.0097 0.0027 0.0076 0.0053 0.0074 0.0074 0.0072 0.0066 0.0048 0.0072 0.0081 0.0053 0.0094 0.0057 0.0053 0.0068 0.0072
1F 0.0043 0.0072 0.0089 0.0042 0.0088 0.0050 0.0085 0.0047 0.0042 0.0042 0.0056 0.0061 0.0030 0.0058 0.0079 0.0050 0.0089 0.0050 0.0036 0.0058 0.0050
1G 0.0043 0.0073 0.0089 0.0042 0.0089 0.0050 0.0085 0.0047 0.0042 0.0042 0.0056 0.0061 0.0030 0.0058 0.0079 0.0050 0.0089 0.0050 0.0036 0.0058 0.0050
1J 0.0085 0.0052 0.0042 0.0025 0.0041 0.0021 0.0060 0.0030 0.0059 0.0059 0.0049 0.0026 0.0028 0.0052 0.0033 0.0028 0.0042 0.0051 0.0051 0.0044 0.0042
1L 0.0018 0.0042 0.0045 0.0017 0.0044 0.0021 0.0045 0.0025 0.0031 0.0031 0.0046 0.0036 0.0016 0.0050 0.0029 0.0030 0.0045 0.0037 0.0028 0.0033 0.0031
1M 0.0040 0.0078 0.0054 0.0020 0.0055 0.0032 0.0064 0.0022 0.0058 0.0058 0.0060 0.0033 0.0033 0.0058 0.0043 0.0023 0.0054 0.0050 0.0067 0.0047 0.0054
1N 0.0061 0.0083 0.0043 0.0027 0.0043 0.0027 0.0048 0.0035 0.0054 0.0054 0.0071 0.0039 0.0034 0.0076 0.0030 0.0033 0.0043 0.0058 0.0036 0.0047 0.0043
1T 0.0029 0.0032 0.0018 0.0033 0.0029 0.0040 0.0022 0.0041 0.0041 0.0071 0.0028 0.0026 0.0069 0.0013 0.0027 0.0032 0.0032 0.0027 0.0034 0.0031
1Y 0.0035 0.0048 0.0019 0.0048 0.0034 0.0062 0.0023 0.0055 0.0055 0.0056 0.0033 0.0031 0.0053 0.0039 0.0023 0.0048 0.0047 0.0061 0.0043 0.0048
2A 0.0054 0.0032 0.0025 0.0033 0.0042 0.0061 0.0033 0.0058 0.0058 0.0065 0.0039 0.0031 0.0063 0.0039 0.0030 0.0032 0.0064 0.0045 0.0045 0.0041
2C 0.0027 0.0073 0.0023 0.0074 0.0016 0.0049 0.0026 0.0033 0.0033 0.0027 0.0040 0.0022 0.0028 0.0050 0.0030 0.0073 0.0025 0.0026 0.0038 0.0029
2D 0.0062   0.0092 0.0048 0.0092 0.0046 0.0075 0.0050 0.0043 0.0043 0.0048 0.0061 0.0033 0.0053 0.0068 0.0050 0.0092 0.0044 0.0032 0.0057 0.0050
Mean 0.0044 0.0061 0.0060 0.0027 0.0060 0.0033 0.0061 0.0033 0.0049 0.0049 0.0059 0.0044 0.0030 0.0060 0.0045 0.0037 0.0060 0.0048 0.0042
Median 0.0042 0.0063 0.0054 0.0025 0.0055 0.0034 0.0061 0.0033 0.0051 0.0051 0.0060 0.0039 0.0030 0.0058 0.0039 0.0031 0.0054 0.0050 0.0041
Table 2: Results for compliant ongoing MINEX vendors only.
NOTES:
  • Some elements in Table 1 are blank because once a product is shown to be non-compliant it is no longer used in future testing.
  • Tables created using 2-finger POEBVA data.
  • Left most column lists SDK code for enrollment template generator.
  • Top most row lists the SDK code for matcher + verification template generator.
  • Yellow boxes are same SDK for all three (matcher, verification template generator, enrollment template generator).
  • Red text denotes noncompliance.

  • The entries in the table are false non-match rates measured over 125,000 genuine comparisons. This sample size is atypically large and was used to ensure statistical significance of the results. The significance test required in ISO/IEC 19795-4 Interoperability Performance Testing indicates that this sample size is sufficient to be 95% certain that any entry in the table below 0.00954 is actually below 0.01 (as required by, for example, NIST SP 800-76). For a 99% confidence level this limit reduces to 0.00935. NIST considers that the higher error rates in this table reflect degraded interoperability that should be immediately addressed primarily by algorithmic improvement of the template generators.

Key

    SDK Code Organization NameNotes
    ACogent Systems Incorporated
    BDermalog Identification Systems GMBH
    CBioscrypt Incorporated
    DSagem Morpho Incorporated
    ENeurotechnologija
    FInnovatrics
    GNEC Corporation
    NCross Match Technologies
    1AStartek Engineering Incorporated
    1BAware IncorporatedTemplate Generator Only
    1CIdentix Incorporated
    1DPrecise Biometrics
    1ESagem Morpho IncorporatedMatcher Only: Used D Template Generator
    1FXTec, Inc.
    1GSecuGen Corporation
    1HUltra-Scan Corporation
    1IStartek Engineering Incorporated
    1JBIO-key International, Inc.
    1KAntheus Technology
    1LMotorola
    1MAware, Inc.Template Generator Only
    1NSonda Technologies Ltd.
    1OGriaule Tecnologia Ltda
    1PPrecise Biometrics
    1QAware, Inc.Matcher Only: Used 1M Template Generator
    1RStartek Engineering Incorporated
    1SSecure Design KK
    1TNeurotechnologija
    1UUltra-Scan Corporation
    1VPrecise BiometricsMatcher Only: Used 1D Template Generator
    1WAware, Inc.Matcher Only: Used 1M Template Generator
    1XSecure Design KK
    1YAware, Inc.Template Generator Only
    1ZGriaule Tecnologia Ltda
    2AImageWare
    2BNITGen Co., Ltd.Template Generator Only
    2CStartek Engineering Incorporated
    2DBiovision
    VTBNIST

-----------------------------
MINEX is a project of NIST's Information Technology Laboratory's Information Access Division
NIST is an agency of the U.S. Commerce Department's Technology Administration.
Contact webmaster@magi.nist.gov with corrections/comments.
NIST Privacy Policy/Security Notice NIST Disclaimer FOIA
Created April 18, 2006.
Updated July 24, 2008.