File size: 2,607 Bytes
a70545b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 |
Benchmark (Subset) set: | Dataset | # samples | Accuracy | 1 - NED | Confidence | Label Length | |:---------:|----------:|---------:|--------:|-----------:|-------------:| | IIIT5k | 3000 | 99.67 | 99.94 | 97.54 | 5.09 | | SVT | 647 | 98.61 | 99.64 | 96.93 | 5.87 | | IC13_1015 | 1015 | 98.92 | 99.59 | 97.82 | 5.32 | | IC15_1811 | 1811 | 91.61 | 97.55 | 94.25 | 5.37 | | IC15_2077 | 2077 | 91.09 | 97.14 | 93.47 | 5.33 | | SVTP | 645 | 98.45 | 99.61 | 96.26 | 5.86 | | CUTE80 | 288 | 99.65 | 99.65 | 97.26 | 5.53 | | HOST | 2416 | 80.55 | 94.82 | 86.80 | 5.37 | | WOST | 2416 | 89.98 | 97.16 | 91.79 | 5.39 | |-----------|-----------|----------|---------|------------|--------------| | Combined | 14315 | 92.39 | 97.84 | 93.68 | 5.35 | Benchmark set: | Dataset | # samples | Accuracy | 1 - NED | Confidence | Label Length | |:---------:|----------:|---------:|--------:|-----------:|-------------:| | IIIT5k | 3000 | 99.67 | 99.94 | 97.54 | 5.09 | | SVT | 647 | 98.61 | 99.64 | 96.93 | 5.87 | | IC13_1015 | 1015 | 98.92 | 99.59 | 97.82 | 5.32 | | IC15_1811 | 1811 | 91.61 | 97.55 | 94.25 | 5.37 | | IC15_2077 | 2077 | 91.09 | 97.14 | 93.47 | 5.33 | | SVTP | 645 | 98.45 | 99.61 | 96.26 | 5.86 | | CUTE80 | 288 | 99.65 | 99.65 | 97.26 | 5.53 | | HOST | 2416 | 80.55 | 94.82 | 86.80 | 5.37 | | WOST | 2416 | 89.98 | 97.16 | 91.79 | 5.39 | |-----------|-----------|----------|---------|------------|--------------| | Combined | 14315 | 92.39 | 97.84 | 93.68 | 5.35 | New set: | Dataset | # samples | Accuracy | 1 - NED | Confidence | Label Length | |:--------:|----------:|---------:|--------:|-----------:|-------------:| | ArT | 35149 | 86.24 | 95.52 | 92.95 | 5.41 | | COCOv1.4 | 9825 | 82.47 | 94.29 | 87.33 | 5.91 | | Uber | 80551 | 91.19 | 96.40 | 91.74 | 5.36 | |----------|-----------|----------|---------|------------|--------------| | Combined | 125525 | 89.12 | 95.99 | 91.73 | 5.42 | Time: Total 4061.6468493938446s, Average 29.044957447038364ms. Total samples 139840. |