clip4str_base_6e9fe947ac_log.txt

Benchmark (Subset) set:
| Dataset   | # samples | Accuracy | 1 - NED | Confidence | Label Length |
|:---------:|----------:|---------:|--------:|-----------:|-------------:|
| IIIT5k    |      3000 |    99.50 |   99.88 |      97.98 |         5.09 |
| SVT       |       647 |    98.30 |   99.59 |      97.05 |         5.86 |
| IC13_1015 |      1015 |    98.62 |   99.59 |      97.81 |         5.32 |
| IC15_1811 |      1811 |    91.39 |   97.19 |      95.21 |         5.38 |
| IC15_2077 |      2077 |    91.14 |   96.97 |      94.71 |         5.33 |
| SVTP      |       645 |    97.98 |   99.50 |      96.99 |         5.87 |
| CUTE80    |       288 |    98.96 |   99.36 |      98.09 |         5.53 |
| HOST      |      2416 |    79.30 |   94.30 |      88.73 |         5.37 |
| WOST      |      2416 |    88.78 |   96.82 |      92.93 |         5.40 |
|-----------|-----------|----------|---------|------------|--------------|
| Combined  |     14315 |    91.85 |   97.60 |      94.65 |         5.35 |


Benchmark set:
| Dataset   | # samples | Accuracy | 1 - NED | Confidence | Label Length |
|:---------:|----------:|---------:|--------:|-----------:|-------------:|
| IIIT5k    |      3000 |    99.50 |   99.88 |      97.98 |         5.09 |
| SVT       |       647 |    98.30 |   99.59 |      97.05 |         5.86 |
| IC13_1015 |      1015 |    98.62 |   99.59 |      97.81 |         5.32 |
| IC15_1811 |      1811 |    91.39 |   97.19 |      95.21 |         5.38 |
| IC15_2077 |      2077 |    91.14 |   96.97 |      94.71 |         5.33 |
| SVTP      |       645 |    97.98 |   99.50 |      96.99 |         5.87 |
| CUTE80    |       288 |    98.96 |   99.36 |      98.09 |         5.53 |
| HOST      |      2416 |    79.30 |   94.30 |      88.73 |         5.37 |
| WOST      |      2416 |    88.78 |   96.82 |      92.93 |         5.40 |
|-----------|-----------|----------|---------|------------|--------------|
| Combined  |     14315 |    91.85 |   97.60 |      94.65 |         5.35 |


New set:
| Dataset  | # samples | Accuracy | 1 - NED | Confidence | Label Length |
|:--------:|----------:|---------:|--------:|-----------:|-------------:|
| ArT      |     35149 |    85.81 |   95.34 |      93.74 |         5.41 |
| COCOv1.4 |      9825 |    81.29 |   93.94 |      88.58 |         5.92 |
| Uber     |     80551 |    92.05 |   96.71 |      93.27 |         5.36 |
|----------|-----------|----------|---------|------------|--------------|
| Combined |    125525 |    89.46 |   96.11 |      93.03 |         5.42 |


Time: Total 654.3242173194885s, Average 4.6790919430741456ms. Total samples 139840.