diff --git "a/checkpoint-2135/README.md" "b/checkpoint-2135/README.md" --- "a/checkpoint-2135/README.md" +++ "b/checkpoint-2135/README.md" @@ -56,94 +56,80 @@ tags: - dataset_size:32500 - loss:GISTEmbedLoss widget: -- source_sentence: Vermont South is bordered by Mitcham to the north , Nunawading - and Forest Hill to the west , Vermont to the south and Wantirna and Ringwood to - the east . +- source_sentence: What was the name of Jed's nephew in The Beverly Hillbillies? sentences: - - Vermont South is bordered to the north of Mitcham , to the west by Nunawading - and Forest Hill , to the south by Vermont and to the east by Wantirna and Ringwood - . - - Ocean waves are among the most impressive waves in the world. They clearly show - that waves transfer energy. In the case of ocean waves, energy is transferred - through matter. But some waves, called electromagnetic waves, can transfer energy - without traveling through matter. These waves can travel through space. You can - read more about electromagnetic waves in the chapter "Electromagnetic Radiation. - " Waves that transfer energy through matter are the focus of the present chapter. - These waves are called mechanical waves. - - Mosque–Cathedral of Córdoba The building is most notable for its arcaded hypostyle - hall, with 856 columns of jasper, onyx, marble, and granite. These were made from - pieces of the Roman temple which had occupied the site previously, as well as - other destroyed Roman buildings, such as the Mérida amphitheatre. The double arches - were a new introduction to architecture, permitting higher ceilings than would - otherwise be possible with relatively low columns. The double arches consist of - a lower horseshoe arch and an upper semi-circular arch. The famous alternating - red and white voussoirs of the arches were inspired by those in the Dome of the - Rock.[31] and also resemble those of the Aachen Cathedral, which were built almost - at the same time. Horseshoe arches were known in the Iberian Peninsula since late - Antiquity, as can be seen on the 3rd-century "Estela de los Flavios", now in the - arqueological museum of León. A centrally located honey-combed dome has blue tiles - decorated with stars. -- source_sentence: What are single-celled organisms that lack a nucleus? + - Jed Clampett - The Beverly Hillbillies Characters - ShareTV Buddy Ebsen began + his career as a dancer in the late 1920s in a Broadway chorus. He later formed + a vaudeville ... Character Bio Although he had received little formal education, + Jed Clampett had a good deal of common sense. A good-natured man, he is the apparent + head of the family. Jed's wife (Elly May's mother) died, but is referred to in + the episode "Duke Steals A Wife" as Rose Ellen. Jed was shown to be an expert + marksman and was extremely loyal to his family and kinfolk. The huge oil pool + in the swamp he owned was the beginning of his rags-to-riches journey to Beverly + Hills. Although he longed for the old ways back in the hills, he made the best + of being in Beverly Hills. Whenever he had anything on his mind, he would sit + on the curbstone of his mansion and whittle until he came up with the answer. + Jedediah, the version of Jed's name used in the 1993 Beverly Hillbillies theatrical + movie, was never mentioned in the original television series (though coincidentally, + on Ebsen's subsequent series, Barnaby Jones, Barnaby's nephew J.R. was also named + Jedediah). In one episode Jed and Granny reminisce about seeing Buddy Ebsen and + Vilma Ebsen—a joking reference to the Ebsens' song and dance act. Jed appears + in all 274 episodes. Episode Screenshots + - a stove generates heat for cooking usually + - Miss Marple series by Agatha Christie Miss Marple series 43 works, 13 primary + works Mystery series in order of publication. Miss Marple is introduced in The + Murder at the Vicarage but the books can be read in any order. Mixed short story + collections are included if some are Marple, often have horror, supernatural, + maybe detective Poirot, Pyne, or Quin. Note that "Nemesis" should be read AFTER + "A Caribbean Holiday" +- source_sentence: A recording of folk songs done for the Columbia society in 1942 + was largely arranged by Pjetër Dungu . sentences: - - a dog standing near a street sign on a dirt road - - "Prokaryotes are single-celled organisms that lack a nucleus.. Prokaryotes All\ - \ bacteria are prokaryotes. \n bacteria are single-celled organisms that lack\ - \ a nucleus." - - 1 cup rice uncooked = 7 oz / 200 g = 600 g ( 5 cups / 21 oz in weight) cooked - [2] (Will serve 5 people). 1 pound of rice = 2 1/4 to 2 1/2 cups uncooked = 11 - cups cooked (Will serve 11 people). -- source_sentence: In the UK television series ‘On The Buses’, what is the first name - of Inspector Blake? + - Someone cooking drugs in a spoon over a candle + - A recording of folk songs made for the Columbia society in 1942 was largely arranged + by Pjetër Dungu . + - A Murder of Crows, A Parliament of Owls What do You Call a Group of Birds? Do + you know what a group of Ravens is called? What about a group of peacocks, snipe + or hummingbirds? Here is a list of Bird Collectives, terms that you can use to + describe a group of birds. Birds in general +- source_sentence: A person in a kitchen looking at the oven. sentences: - - How Long Does Vicodin Stay in Your System? While the effects of Vicodin last around - 4 hours, traces of the drug can remain in your system for up to 72 hours. In some - adults you can still find traces of the drug in your system after 5 days. A person's - weight, diet, age and level of body fat will contribute to how quickly your body - is able to process and rid itself of the drug. In general, the higher your metabolism - rate, the sooner traces of the drug will be eliminated. - - 'Stephen Lewis - IMDb IMDb Actor | Writer Stephen Lewis, will be chiefly remembered - for the comedy catchphrase: "I ''ate you Butler!" He delivered it week after week - in the hit sitcom On The Buses, a saucy slice of life that ran on ITV from 1969 - to 1973. Lewis was Cyril "Blakey" Blake, a bus inspector with a Hitler moustache - and delusions of grandeur. His nemesis was Stan Butler, a driver ... See full - bio » Born:' - - 'Definition of Dysuria Our Symptoms article on Burning Urination provides a comprehensive - look at the possible causes and treatments of Burning Urination. Definition of - Dysuria Dysuria: Pain during urination, or difficulty urinating. Dysuria is usually - caused by inflammation of the urethra, frequently as a result of infection. Last - Editorial Review: 5/13/2016' -- source_sentence: 'Two cups of black coffee sitting next to a coffee pot. ' + - "staying warm has a positive impact on an animal 's survival. Furry animals grow\ + \ thicker coats to keep warm in the winter. \n Furry animals grow thicker coats\ + \ which has a positive impact on their survival. " + - A woman In the kitchen opening her oven. + - EE has apologised after a fault left some of its customers unable to use the internet + on their mobile devices. +- source_sentence: Air can be separated into several elements. sentences: - - As of 19 March , more than 225,000 cases of COVID-19 have been reported in over - 150 countries and territories , resulting in more than 9,200 deaths and 85,000 - recoveries . - - Other than gametes, normal human cells have a total of 46 chromosomes per cell. - - two small cups filled with coffee next to a silver coffee pot -- source_sentence: Larry Lurex was the original stage name of which late singer? + - Which of the following substances can be separated into several elements? + - 'Funny Interesting Facts Humor Strange: Carl and the Passions changed band name + to what Carl and the Passions changed band name to what Beach Boys Carl and the + Passions - "So Tough" is the fifteenth studio album released by The Beach Boys + in 1972. In its initial release, it was the second disc of a two-album set with + Pet Sounds (which The Beach Boys were able to license from Capitol Records). Unfortunately, + due to the fact that Carl and the Passions - "So Tough" was a transitional album + that saw the departure of one member and the introduction of two new ones, making + it wildly inconsistent in terms of type of material present, it paled next to + their 1966 classic and was seen as something of a disappointment in its time of + release. The title of the album itself was a reference to an early band Carl Wilson + had been in as a teenager (some say a possible early name for the Beach Boys). + It was also the first album released under a new deal with Warner Bros. that allowed + the company to distribute all future Beach Boys product in foreign as well as + domestic markets.' + - Which statement correctly describes a relationship between two human body systems? +- source_sentence: What do outdoor plants require to survive? sentences: - - Larry Lurex Story - Freddie Mercury Net Worth Larry Lurex Story Read more... Freddie - Mercury Freddie Mercury Net Worth is $100 Million. Freddie Mercury was born in - Zanzibar and has an estimated net worth of $100 million dollars. As the lead singer - and songwriter with the hugely successful British band, Queen, Freddie Mercury - wrote many hit. Freddie Mercury (born Farrok... Freddie Mercury Net Worth is $100 - Million. Freddie Mercury Net Worth is $100 Million. Freddie Mercury was born in - Zanzibar and has an estimated net worth of $100 million dollars. As the lead singer - and songwriter with the hugely successful British band, Queen, Freddie Mercury - wrote many hit Freddie Mercury , 5 September 1946 - 24 November 1991) was a British - musician, singer and songwriter, best known as the lead vocalist and lyricist - of the rock band Queen. As a performer, he was known for his flamboyant stage - persona and powerful vocals over a four-octave range. As a songwriter, Mercury - composed many hits for Queen, including "Bohemian Rhapsody", "Killer Queen", "Somebody - to Love", "Don't Stop Me Now", "Crazy Little Thing Called Love" and "We Are the - Champions". In addition to his work with Queen, he led a solo career, and also - occasionally served as a producer and guest musician for other artists. He died - of bronchopneumonia brought on by AIDS on 24 November 1991, only one day after - publicly acknowledging he had the disease. Mercury was a Parsi born in Zanzibar - and grew up there and in India until his mid-teens. He has been referred to as - "Britain's first Asian rock star". In 2002, Mercury was placed ... - - The everyday beverage coffee is a commodity second only to oil in worldwide trade. - - more than 680,000 cases of COVID-19 have been reported in over 190 countries and - territories , resulting in approximately 31,900 deaths . + - "a plants require water for survival. If no rain or watering, the plant dies.\ + \ \n Outdoor plants require rain to survive." + - (Vegan) soups are nutritious. In addition to them being easy to digest, most the + time, soups are made from nutrient-dense ingredients like herbs, spices, vegetables, + and beans. Because the soup is full of those nutrients AND that it's easy to digest, + your body is able to absorb more of those nutrients into your system. + - If you do the math, there are 11,238,513 possible combinations of five white balls + (without order mattering). Multiply that by the 26 possible red balls, and you + get 292,201,338 possible Powerball number combinations. At $2 per ticket, you'd + need $584,402,676 to buy every single combination and guarantee a win. model-index: - name: SentenceTransformer based on microsoft/deberta-v3-small results: @@ -155,34 +141,34 @@ model-index: type: sts-test metrics: - type: pearson_cosine - value: 0.6620027075959773 + value: 0.6486131885836244 name: Pearson Cosine - type: spearman_cosine - value: 0.6712350889173807 + value: 0.6575633100547399 name: Spearman Cosine - type: pearson_manhattan - value: 0.6792900086102078 + value: 0.6665880327992885 name: Pearson Manhattan - type: spearman_manhattan - value: 0.6752350909143282 + value: 0.6619746656463971 name: Spearman Manhattan - type: pearson_euclidean - value: 0.6760063290032935 + value: 0.6614666062012153 name: Pearson Euclidean - type: spearman_euclidean - value: 0.6714677059740932 + value: 0.6579358195545618 name: Spearman Euclidean - type: pearson_dot - value: 0.6601968030872636 + value: 0.6455690772643841 name: Pearson Dot - type: spearman_dot - value: 0.6700788953280725 + value: 0.6538646630520021 name: Spearman Dot - type: pearson_max - value: 0.6792900086102078 + value: 0.6665880327992885 name: Pearson Max - type: spearman_max - value: 0.6752350909143282 + value: 0.6619746656463971 name: Spearman Max - task: type: binary-classification @@ -192,109 +178,109 @@ model-index: type: allNLI-dev metrics: - type: cosine_accuracy - value: 0.701171875 + value: 0.693359375 name: Cosine Accuracy - type: cosine_accuracy_threshold - value: 0.9141938090324402 + value: 0.9265936613082886 name: Cosine Accuracy Threshold - type: cosine_f1 - value: 0.5469728601252609 + value: 0.5537848605577689 name: Cosine F1 - type: cosine_f1_threshold - value: 0.8089991807937622 + value: 0.8162949085235596 name: Cosine F1 Threshold - type: cosine_precision - value: 0.42810457516339867 + value: 0.42249240121580545 name: Cosine Precision - type: cosine_recall - value: 0.7572254335260116 + value: 0.8034682080924855 name: Cosine Recall - type: cosine_ap - value: 0.5178189449379189 + value: 0.5135607855999773 name: Cosine Ap - type: dot_accuracy - value: 0.701171875 + value: 0.693359375 name: Dot Accuracy - type: dot_accuracy_threshold - value: 701.9563598632812 + value: 708.295166015625 name: Dot Accuracy Threshold - type: dot_f1 - value: 0.5492662473794548 + value: 0.5542168674698795 name: Dot F1 - type: dot_f1_threshold - value: 619.0263671875 + value: 624.698974609375 name: Dot F1 Threshold - type: dot_precision - value: 0.4309210526315789 + value: 0.4246153846153846 name: Dot Precision - type: dot_recall - value: 0.7572254335260116 + value: 0.7976878612716763 name: Dot Recall - type: dot_ap - value: 0.5185120023725823 + value: 0.5122623119148267 name: Dot Ap - type: manhattan_accuracy - value: 0.697265625 + value: 0.689453125 name: Manhattan Accuracy - type: manhattan_accuracy_threshold - value: 243.82118225097656 + value: 221.28228759765625 name: Manhattan Accuracy Threshold - type: manhattan_f1 - value: 0.5536480686695279 + value: 0.5553235908141962 name: Manhattan F1 - type: manhattan_f1_threshold - value: 353.4998474121094 + value: 342.06512451171875 name: Manhattan F1 Threshold - type: manhattan_precision - value: 0.4402730375426621 + value: 0.434640522875817 name: Manhattan Precision - type: manhattan_recall - value: 0.7456647398843931 + value: 0.7687861271676301 name: Manhattan Recall - type: manhattan_ap - value: 0.5208045922745452 + value: 0.5111987819682724 name: Manhattan Ap - type: euclidean_accuracy - value: 0.701171875 + value: 0.693359375 name: Euclidean Accuracy - type: euclidean_accuracy_threshold - value: 11.46473503112793 + value: 10.592409133911133 name: Euclidean Accuracy Threshold - type: euclidean_f1 - value: 0.5458422174840084 + value: 0.5537848605577689 name: Euclidean F1 - type: euclidean_f1_threshold - value: 16.86907958984375 + value: 16.733966827392578 name: Euclidean F1 Threshold - type: euclidean_precision - value: 0.43243243243243246 + value: 0.42249240121580545 name: Euclidean Precision - type: euclidean_recall - value: 0.7398843930635838 + value: 0.8034682080924855 name: Euclidean Recall - type: euclidean_ap - value: 0.5178582923548423 + value: 0.5133305497190137 name: Euclidean Ap - type: max_accuracy - value: 0.701171875 + value: 0.693359375 name: Max Accuracy - type: max_accuracy_threshold - value: 701.9563598632812 + value: 708.295166015625 name: Max Accuracy Threshold - type: max_f1 - value: 0.5536480686695279 + value: 0.5553235908141962 name: Max F1 - type: max_f1_threshold - value: 619.0263671875 + value: 624.698974609375 name: Max F1 Threshold - type: max_precision - value: 0.4402730375426621 + value: 0.434640522875817 name: Max Precision - type: max_recall - value: 0.7572254335260116 + value: 0.8034682080924855 name: Max Recall - type: max_ap - value: 0.5208045922745452 + value: 0.5135607855999773 name: Max Ap - task: type: binary-classification @@ -304,109 +290,109 @@ model-index: type: Qnli-dev metrics: - type: cosine_accuracy - value: 0.658203125 + value: 0.673828125 name: Cosine Accuracy - type: cosine_accuracy_threshold - value: 0.8023818731307983 + value: 0.7969574928283691 name: Cosine Accuracy Threshold - type: cosine_f1 - value: 0.6916802610114192 + value: 0.6907216494845361 name: Cosine F1 - type: cosine_f1_threshold - value: 0.7310751676559448 + value: 0.759760856628418 name: Cosine F1 Threshold - type: cosine_precision - value: 0.5623342175066313 + value: 0.5809248554913294 name: Cosine Precision - type: cosine_recall - value: 0.8983050847457628 + value: 0.8516949152542372 name: Cosine Recall - type: cosine_ap - value: 0.6886786340579703 + value: 0.6978522990819034 name: Cosine Ap - type: dot_accuracy - value: 0.66015625 + value: 0.66796875 name: Dot Accuracy - type: dot_accuracy_threshold - value: 615.7371826171875 + value: 604.6656494140625 name: Dot Accuracy Threshold - type: dot_f1 - value: 0.6916802610114192 + value: 0.6900175131348512 name: Dot F1 - type: dot_f1_threshold - value: 558.3238525390625 + value: 584.50830078125 name: Dot F1 Threshold - type: dot_precision - value: 0.5623342175066313 + value: 0.5880597014925373 name: Dot Precision - type: dot_recall - value: 0.8983050847457628 + value: 0.8347457627118644 name: Dot Recall - type: dot_ap - value: 0.6875993155505726 + value: 0.6961098574484125 name: Dot Ap - type: manhattan_accuracy - value: 0.677734375 + value: 0.6796875 name: Manhattan Accuracy - type: manhattan_accuracy_threshold - value: 363.1766052246094 + value: 363.2380065917969 name: Manhattan Accuracy Threshold - type: manhattan_f1 - value: 0.6951026856240127 + value: 0.6950092421441774 name: Manhattan F1 - type: manhattan_f1_threshold - value: 436.8890075683594 + value: 384.6904296875 name: Manhattan F1 Threshold - type: manhattan_precision - value: 0.5541561712846348 + value: 0.6163934426229508 name: Manhattan Precision - type: manhattan_recall - value: 0.9322033898305084 + value: 0.7966101694915254 name: Manhattan Recall - type: manhattan_ap - value: 0.7003574987662966 + value: 0.7071976338822723 name: Manhattan Ap - type: euclidean_accuracy - value: 0.662109375 + value: 0.673828125 name: Euclidean Accuracy - type: euclidean_accuracy_threshold - value: 17.46044158935547 + value: 17.583419799804688 name: Euclidean Accuracy Threshold - type: euclidean_f1 - value: 0.6906710310965629 + value: 0.6917808219178082 name: Euclidean F1 - type: euclidean_f1_threshold - value: 20.146350860595703 + value: 19.166725158691406 name: Euclidean F1 Threshold - type: euclidean_precision - value: 0.5626666666666666 + value: 0.5804597701149425 name: Euclidean Precision - type: euclidean_recall - value: 0.8940677966101694 + value: 0.8559322033898306 name: Euclidean Recall - type: euclidean_ap - value: 0.6887027301873778 + value: 0.6979529403637269 name: Euclidean Ap - type: max_accuracy - value: 0.677734375 + value: 0.6796875 name: Max Accuracy - type: max_accuracy_threshold - value: 615.7371826171875 + value: 604.6656494140625 name: Max Accuracy Threshold - type: max_f1 - value: 0.6951026856240127 + value: 0.6950092421441774 name: Max F1 - type: max_f1_threshold - value: 558.3238525390625 + value: 584.50830078125 name: Max F1 Threshold - type: max_precision - value: 0.5626666666666666 + value: 0.6163934426229508 name: Max Precision - type: max_recall - value: 0.9322033898305084 + value: 0.8559322033898306 name: Max Recall - type: max_ap - value: 0.7003574987662966 + value: 0.7071976338822723 name: Max Ap --- @@ -438,6 +424,8 @@ This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [m SentenceTransformer( (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: DebertaV2Model (1): AdvancedWeightedPooling( + (alpha_dropout_layer): Dropout(p=0.01, inplace=False) + (gate_dropout_layer): Dropout(p=0.05, inplace=False) (linear_cls_pj): Linear(in_features=768, out_features=768, bias=True) (linear_cls_Qpj): Linear(in_features=768, out_features=768, bias=True) (linear_mean_pj): Linear(in_features=768, out_features=768, bias=True) @@ -472,9 +460,9 @@ from sentence_transformers import SentenceTransformer model = SentenceTransformer("bobox/DeBERTa3-s-CustomPoolin-toytest2-step1-checkpoints-tmp") # Run inference sentences = [ - 'Larry Lurex was the original stage name of which late singer?', - 'Larry Lurex Story - Freddie Mercury Net Worth Larry Lurex Story Read more... Freddie Mercury Freddie Mercury Net Worth is $100 Million. Freddie Mercury was born in Zanzibar and has an estimated net worth of $100 million dollars. As the lead singer and songwriter with the hugely successful British band, Queen, Freddie Mercury wrote many hit. Freddie Mercury (born Farrok... Freddie Mercury Net Worth is $100 Million. Freddie Mercury Net Worth is $100 Million. Freddie Mercury was born in Zanzibar and has an estimated net worth of $100 million dollars. As the lead singer and songwriter with the hugely successful British band, Queen, Freddie Mercury wrote many hit Freddie Mercury , 5 September 1946 - 24 November 1991) was a British musician, singer and songwriter, best known as the lead vocalist and lyricist of the rock band Queen. As a performer, he was known for his flamboyant stage persona and powerful vocals over a four-octave range. As a songwriter, Mercury composed many hits for Queen, including "Bohemian Rhapsody", "Killer Queen", "Somebody to Love", "Don\'t Stop Me Now", "Crazy Little Thing Called Love" and "We Are the Champions". In addition to his work with Queen, he led a solo career, and also occasionally served as a producer and guest musician for other artists. He died of bronchopneumonia brought on by AIDS on 24 November 1991, only one day after publicly acknowledging he had the disease. Mercury was a Parsi born in Zanzibar and grew up there and in India until his mid-teens. He has been referred to as "Britain\'s first Asian rock star". In 2002, Mercury was placed ...', - 'The everyday beverage coffee is a commodity second only to oil in worldwide trade.', + 'What do outdoor plants require to survive?', + 'a plants require water for survival. If no rain or watering, the plant dies. \n Outdoor plants require rain to survive.', + "(Vegan) soups are nutritious. In addition to them being easy to digest, most the time, soups are made from nutrient-dense ingredients like herbs, spices, vegetables, and beans. Because the soup is full of those nutrients AND that it's easy to digest, your body is able to absorb more of those nutrients into your system.", ] embeddings = model.encode(sentences) print(embeddings.shape) @@ -520,16 +508,16 @@ You can finetune this model on your own dataset. | Metric | Value | |:--------------------|:-----------| -| pearson_cosine | 0.662 | -| **spearman_cosine** | **0.6712** | -| pearson_manhattan | 0.6793 | -| spearman_manhattan | 0.6752 | -| pearson_euclidean | 0.676 | -| spearman_euclidean | 0.6715 | -| pearson_dot | 0.6602 | -| spearman_dot | 0.6701 | -| pearson_max | 0.6793 | -| spearman_max | 0.6752 | +| pearson_cosine | 0.6486 | +| **spearman_cosine** | **0.6576** | +| pearson_manhattan | 0.6666 | +| spearman_manhattan | 0.662 | +| pearson_euclidean | 0.6615 | +| spearman_euclidean | 0.6579 | +| pearson_dot | 0.6456 | +| spearman_dot | 0.6539 | +| pearson_max | 0.6666 | +| spearman_max | 0.662 | #### Binary Classification * Dataset: `allNLI-dev` @@ -537,41 +525,41 @@ You can finetune this model on your own dataset. | Metric | Value | |:-----------------------------|:-----------| -| cosine_accuracy | 0.7012 | -| cosine_accuracy_threshold | 0.9142 | -| cosine_f1 | 0.547 | -| cosine_f1_threshold | 0.809 | -| cosine_precision | 0.4281 | -| cosine_recall | 0.7572 | -| cosine_ap | 0.5178 | -| dot_accuracy | 0.7012 | -| dot_accuracy_threshold | 701.9564 | -| dot_f1 | 0.5493 | -| dot_f1_threshold | 619.0264 | -| dot_precision | 0.4309 | -| dot_recall | 0.7572 | -| dot_ap | 0.5185 | -| manhattan_accuracy | 0.6973 | -| manhattan_accuracy_threshold | 243.8212 | -| manhattan_f1 | 0.5536 | -| manhattan_f1_threshold | 353.4998 | -| manhattan_precision | 0.4403 | -| manhattan_recall | 0.7457 | -| manhattan_ap | 0.5208 | -| euclidean_accuracy | 0.7012 | -| euclidean_accuracy_threshold | 11.4647 | -| euclidean_f1 | 0.5458 | -| euclidean_f1_threshold | 16.8691 | -| euclidean_precision | 0.4324 | -| euclidean_recall | 0.7399 | -| euclidean_ap | 0.5179 | -| max_accuracy | 0.7012 | -| max_accuracy_threshold | 701.9564 | -| max_f1 | 0.5536 | -| max_f1_threshold | 619.0264 | -| max_precision | 0.4403 | -| max_recall | 0.7572 | -| **max_ap** | **0.5208** | +| cosine_accuracy | 0.6934 | +| cosine_accuracy_threshold | 0.9266 | +| cosine_f1 | 0.5538 | +| cosine_f1_threshold | 0.8163 | +| cosine_precision | 0.4225 | +| cosine_recall | 0.8035 | +| cosine_ap | 0.5136 | +| dot_accuracy | 0.6934 | +| dot_accuracy_threshold | 708.2952 | +| dot_f1 | 0.5542 | +| dot_f1_threshold | 624.699 | +| dot_precision | 0.4246 | +| dot_recall | 0.7977 | +| dot_ap | 0.5123 | +| manhattan_accuracy | 0.6895 | +| manhattan_accuracy_threshold | 221.2823 | +| manhattan_f1 | 0.5553 | +| manhattan_f1_threshold | 342.0651 | +| manhattan_precision | 0.4346 | +| manhattan_recall | 0.7688 | +| manhattan_ap | 0.5112 | +| euclidean_accuracy | 0.6934 | +| euclidean_accuracy_threshold | 10.5924 | +| euclidean_f1 | 0.5538 | +| euclidean_f1_threshold | 16.734 | +| euclidean_precision | 0.4225 | +| euclidean_recall | 0.8035 | +| euclidean_ap | 0.5133 | +| max_accuracy | 0.6934 | +| max_accuracy_threshold | 708.2952 | +| max_f1 | 0.5553 | +| max_f1_threshold | 624.699 | +| max_precision | 0.4346 | +| max_recall | 0.8035 | +| **max_ap** | **0.5136** | #### Binary Classification * Dataset: `Qnli-dev` @@ -579,41 +567,41 @@ You can finetune this model on your own dataset. | Metric | Value | |:-----------------------------|:-----------| -| cosine_accuracy | 0.6582 | -| cosine_accuracy_threshold | 0.8024 | -| cosine_f1 | 0.6917 | -| cosine_f1_threshold | 0.7311 | -| cosine_precision | 0.5623 | -| cosine_recall | 0.8983 | -| cosine_ap | 0.6887 | -| dot_accuracy | 0.6602 | -| dot_accuracy_threshold | 615.7372 | -| dot_f1 | 0.6917 | -| dot_f1_threshold | 558.3239 | -| dot_precision | 0.5623 | -| dot_recall | 0.8983 | -| dot_ap | 0.6876 | -| manhattan_accuracy | 0.6777 | -| manhattan_accuracy_threshold | 363.1766 | -| manhattan_f1 | 0.6951 | -| manhattan_f1_threshold | 436.889 | -| manhattan_precision | 0.5542 | -| manhattan_recall | 0.9322 | -| manhattan_ap | 0.7004 | -| euclidean_accuracy | 0.6621 | -| euclidean_accuracy_threshold | 17.4604 | -| euclidean_f1 | 0.6907 | -| euclidean_f1_threshold | 20.1464 | -| euclidean_precision | 0.5627 | -| euclidean_recall | 0.8941 | -| euclidean_ap | 0.6887 | -| max_accuracy | 0.6777 | -| max_accuracy_threshold | 615.7372 | -| max_f1 | 0.6951 | -| max_f1_threshold | 558.3239 | -| max_precision | 0.5627 | -| max_recall | 0.9322 | -| **max_ap** | **0.7004** | +| cosine_accuracy | 0.6738 | +| cosine_accuracy_threshold | 0.797 | +| cosine_f1 | 0.6907 | +| cosine_f1_threshold | 0.7598 | +| cosine_precision | 0.5809 | +| cosine_recall | 0.8517 | +| cosine_ap | 0.6979 | +| dot_accuracy | 0.668 | +| dot_accuracy_threshold | 604.6656 | +| dot_f1 | 0.69 | +| dot_f1_threshold | 584.5083 | +| dot_precision | 0.5881 | +| dot_recall | 0.8347 | +| dot_ap | 0.6961 | +| manhattan_accuracy | 0.6797 | +| manhattan_accuracy_threshold | 363.238 | +| manhattan_f1 | 0.695 | +| manhattan_f1_threshold | 384.6904 | +| manhattan_precision | 0.6164 | +| manhattan_recall | 0.7966 | +| manhattan_ap | 0.7072 | +| euclidean_accuracy | 0.6738 | +| euclidean_accuracy_threshold | 17.5834 | +| euclidean_f1 | 0.6918 | +| euclidean_f1_threshold | 19.1667 | +| euclidean_precision | 0.5805 | +| euclidean_recall | 0.8559 | +| euclidean_ap | 0.698 | +| max_accuracy | 0.6797 | +| max_accuracy_threshold | 604.6656 | +| max_f1 | 0.695 | +| max_f1_threshold | 584.5083 | +| max_precision | 0.6164 | +| max_recall | 0.8559 | +| **max_ap** | **0.7072** |