File size: 2,606 Bytes
a70545b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 |
Benchmark (Subset) set: | Dataset | # samples | Accuracy | 1 - NED | Confidence | Label Length | |:---------:|----------:|---------:|--------:|-----------:|-------------:| | IIIT5k | 3000 | 99.50 | 99.88 | 97.98 | 5.09 | | SVT | 647 | 98.30 | 99.59 | 97.05 | 5.86 | | IC13_1015 | 1015 | 98.62 | 99.59 | 97.81 | 5.32 | | IC15_1811 | 1811 | 91.39 | 97.19 | 95.21 | 5.38 | | IC15_2077 | 2077 | 91.14 | 96.97 | 94.71 | 5.33 | | SVTP | 645 | 97.98 | 99.50 | 96.99 | 5.87 | | CUTE80 | 288 | 98.96 | 99.36 | 98.09 | 5.53 | | HOST | 2416 | 79.30 | 94.30 | 88.73 | 5.37 | | WOST | 2416 | 88.78 | 96.82 | 92.93 | 5.40 | |-----------|-----------|----------|---------|------------|--------------| | Combined | 14315 | 91.85 | 97.60 | 94.65 | 5.35 | Benchmark set: | Dataset | # samples | Accuracy | 1 - NED | Confidence | Label Length | |:---------:|----------:|---------:|--------:|-----------:|-------------:| | IIIT5k | 3000 | 99.50 | 99.88 | 97.98 | 5.09 | | SVT | 647 | 98.30 | 99.59 | 97.05 | 5.86 | | IC13_1015 | 1015 | 98.62 | 99.59 | 97.81 | 5.32 | | IC15_1811 | 1811 | 91.39 | 97.19 | 95.21 | 5.38 | | IC15_2077 | 2077 | 91.14 | 96.97 | 94.71 | 5.33 | | SVTP | 645 | 97.98 | 99.50 | 96.99 | 5.87 | | CUTE80 | 288 | 98.96 | 99.36 | 98.09 | 5.53 | | HOST | 2416 | 79.30 | 94.30 | 88.73 | 5.37 | | WOST | 2416 | 88.78 | 96.82 | 92.93 | 5.40 | |-----------|-----------|----------|---------|------------|--------------| | Combined | 14315 | 91.85 | 97.60 | 94.65 | 5.35 | New set: | Dataset | # samples | Accuracy | 1 - NED | Confidence | Label Length | |:--------:|----------:|---------:|--------:|-----------:|-------------:| | ArT | 35149 | 85.81 | 95.34 | 93.74 | 5.41 | | COCOv1.4 | 9825 | 81.29 | 93.94 | 88.58 | 5.92 | | Uber | 80551 | 92.05 | 96.71 | 93.27 | 5.36 | |----------|-----------|----------|---------|------------|--------------| | Combined | 125525 | 89.46 | 96.11 | 93.03 | 5.42 | Time: Total 654.3242173194885s, Average 4.6790919430741456ms. Total samples 139840. |