diff --git "a/checkpoint-3048/README.md" "b/checkpoint-3048/README.md" --- "a/checkpoint-3048/README.md" +++ "b/checkpoint-3048/README.md" @@ -56,94 +56,80 @@ tags: - dataset_size:32500 - loss:GISTEmbedLoss widget: -- source_sentence: Vermont South is bordered by Mitcham to the north , Nunawading - and Forest Hill to the west , Vermont to the south and Wantirna and Ringwood to - the east . +- source_sentence: What was the name of Jed's nephew in The Beverly Hillbillies? sentences: - - Vermont South is bordered to the north of Mitcham , to the west by Nunawading - and Forest Hill , to the south by Vermont and to the east by Wantirna and Ringwood - . - - Ocean waves are among the most impressive waves in the world. They clearly show - that waves transfer energy. In the case of ocean waves, energy is transferred - through matter. But some waves, called electromagnetic waves, can transfer energy - without traveling through matter. These waves can travel through space. You can - read more about electromagnetic waves in the chapter "Electromagnetic Radiation. - " Waves that transfer energy through matter are the focus of the present chapter. - These waves are called mechanical waves. - - Mosque–Cathedral of Córdoba The building is most notable for its arcaded hypostyle - hall, with 856 columns of jasper, onyx, marble, and granite. These were made from - pieces of the Roman temple which had occupied the site previously, as well as - other destroyed Roman buildings, such as the Mérida amphitheatre. The double arches - were a new introduction to architecture, permitting higher ceilings than would - otherwise be possible with relatively low columns. The double arches consist of - a lower horseshoe arch and an upper semi-circular arch. The famous alternating - red and white voussoirs of the arches were inspired by those in the Dome of the - Rock.[31] and also resemble those of the Aachen Cathedral, which were built almost - at the same time. Horseshoe arches were known in the Iberian Peninsula since late - Antiquity, as can be seen on the 3rd-century "Estela de los Flavios", now in the - arqueological museum of León. A centrally located honey-combed dome has blue tiles - decorated with stars. -- source_sentence: What are single-celled organisms that lack a nucleus? + - Jed Clampett - The Beverly Hillbillies Characters - ShareTV Buddy Ebsen began + his career as a dancer in the late 1920s in a Broadway chorus. He later formed + a vaudeville ... Character Bio Although he had received little formal education, + Jed Clampett had a good deal of common sense. A good-natured man, he is the apparent + head of the family. Jed's wife (Elly May's mother) died, but is referred to in + the episode "Duke Steals A Wife" as Rose Ellen. Jed was shown to be an expert + marksman and was extremely loyal to his family and kinfolk. The huge oil pool + in the swamp he owned was the beginning of his rags-to-riches journey to Beverly + Hills. Although he longed for the old ways back in the hills, he made the best + of being in Beverly Hills. Whenever he had anything on his mind, he would sit + on the curbstone of his mansion and whittle until he came up with the answer. + Jedediah, the version of Jed's name used in the 1993 Beverly Hillbillies theatrical + movie, was never mentioned in the original television series (though coincidentally, + on Ebsen's subsequent series, Barnaby Jones, Barnaby's nephew J.R. was also named + Jedediah). In one episode Jed and Granny reminisce about seeing Buddy Ebsen and + Vilma Ebsen—a joking reference to the Ebsens' song and dance act. Jed appears + in all 274 episodes. Episode Screenshots + - a stove generates heat for cooking usually + - Miss Marple series by Agatha Christie Miss Marple series 43 works, 13 primary + works Mystery series in order of publication. Miss Marple is introduced in The + Murder at the Vicarage but the books can be read in any order. Mixed short story + collections are included if some are Marple, often have horror, supernatural, + maybe detective Poirot, Pyne, or Quin. Note that "Nemesis" should be read AFTER + "A Caribbean Holiday" +- source_sentence: A recording of folk songs done for the Columbia society in 1942 + was largely arranged by Pjetër Dungu . sentences: - - a dog standing near a street sign on a dirt road - - "Prokaryotes are single-celled organisms that lack a nucleus.. Prokaryotes All\ - \ bacteria are prokaryotes. \n bacteria are single-celled organisms that lack\ - \ a nucleus." - - 1 cup rice uncooked = 7 oz / 200 g = 600 g ( 5 cups / 21 oz in weight) cooked - [2] (Will serve 5 people). 1 pound of rice = 2 1/4 to 2 1/2 cups uncooked = 11 - cups cooked (Will serve 11 people). -- source_sentence: In the UK television series ‘On The Buses’, what is the first name - of Inspector Blake? + - Someone cooking drugs in a spoon over a candle + - A recording of folk songs made for the Columbia society in 1942 was largely arranged + by Pjetër Dungu . + - A Murder of Crows, A Parliament of Owls What do You Call a Group of Birds? Do + you know what a group of Ravens is called? What about a group of peacocks, snipe + or hummingbirds? Here is a list of Bird Collectives, terms that you can use to + describe a group of birds. Birds in general +- source_sentence: A person in a kitchen looking at the oven. sentences: - - How Long Does Vicodin Stay in Your System? While the effects of Vicodin last around - 4 hours, traces of the drug can remain in your system for up to 72 hours. In some - adults you can still find traces of the drug in your system after 5 days. A person's - weight, diet, age and level of body fat will contribute to how quickly your body - is able to process and rid itself of the drug. In general, the higher your metabolism - rate, the sooner traces of the drug will be eliminated. - - 'Stephen Lewis - IMDb IMDb Actor | Writer Stephen Lewis, will be chiefly remembered - for the comedy catchphrase: "I ''ate you Butler!" He delivered it week after week - in the hit sitcom On The Buses, a saucy slice of life that ran on ITV from 1969 - to 1973. Lewis was Cyril "Blakey" Blake, a bus inspector with a Hitler moustache - and delusions of grandeur. His nemesis was Stan Butler, a driver ... See full - bio » Born:' - - 'Definition of Dysuria Our Symptoms article on Burning Urination provides a comprehensive - look at the possible causes and treatments of Burning Urination. Definition of - Dysuria Dysuria: Pain during urination, or difficulty urinating. Dysuria is usually - caused by inflammation of the urethra, frequently as a result of infection. Last - Editorial Review: 5/13/2016' -- source_sentence: 'Two cups of black coffee sitting next to a coffee pot. ' + - "staying warm has a positive impact on an animal 's survival. Furry animals grow\ + \ thicker coats to keep warm in the winter. \n Furry animals grow thicker coats\ + \ which has a positive impact on their survival. " + - A woman In the kitchen opening her oven. + - EE has apologised after a fault left some of its customers unable to use the internet + on their mobile devices. +- source_sentence: Air can be separated into several elements. sentences: - - As of 19 March , more than 225,000 cases of COVID-19 have been reported in over - 150 countries and territories , resulting in more than 9,200 deaths and 85,000 - recoveries . - - Other than gametes, normal human cells have a total of 46 chromosomes per cell. - - two small cups filled with coffee next to a silver coffee pot -- source_sentence: Larry Lurex was the original stage name of which late singer? + - Which of the following substances can be separated into several elements? + - 'Funny Interesting Facts Humor Strange: Carl and the Passions changed band name + to what Carl and the Passions changed band name to what Beach Boys Carl and the + Passions - "So Tough" is the fifteenth studio album released by The Beach Boys + in 1972. In its initial release, it was the second disc of a two-album set with + Pet Sounds (which The Beach Boys were able to license from Capitol Records). Unfortunately, + due to the fact that Carl and the Passions - "So Tough" was a transitional album + that saw the departure of one member and the introduction of two new ones, making + it wildly inconsistent in terms of type of material present, it paled next to + their 1966 classic and was seen as something of a disappointment in its time of + release. The title of the album itself was a reference to an early band Carl Wilson + had been in as a teenager (some say a possible early name for the Beach Boys). + It was also the first album released under a new deal with Warner Bros. that allowed + the company to distribute all future Beach Boys product in foreign as well as + domestic markets.' + - Which statement correctly describes a relationship between two human body systems? +- source_sentence: What do outdoor plants require to survive? sentences: - - Larry Lurex Story - Freddie Mercury Net Worth Larry Lurex Story Read more... Freddie - Mercury Freddie Mercury Net Worth is $100 Million. Freddie Mercury was born in - Zanzibar and has an estimated net worth of $100 million dollars. As the lead singer - and songwriter with the hugely successful British band, Queen, Freddie Mercury - wrote many hit. Freddie Mercury (born Farrok... Freddie Mercury Net Worth is $100 - Million. Freddie Mercury Net Worth is $100 Million. Freddie Mercury was born in - Zanzibar and has an estimated net worth of $100 million dollars. As the lead singer - and songwriter with the hugely successful British band, Queen, Freddie Mercury - wrote many hit Freddie Mercury , 5 September 1946 - 24 November 1991) was a British - musician, singer and songwriter, best known as the lead vocalist and lyricist - of the rock band Queen. As a performer, he was known for his flamboyant stage - persona and powerful vocals over a four-octave range. As a songwriter, Mercury - composed many hits for Queen, including "Bohemian Rhapsody", "Killer Queen", "Somebody - to Love", "Don't Stop Me Now", "Crazy Little Thing Called Love" and "We Are the - Champions". In addition to his work with Queen, he led a solo career, and also - occasionally served as a producer and guest musician for other artists. He died - of bronchopneumonia brought on by AIDS on 24 November 1991, only one day after - publicly acknowledging he had the disease. Mercury was a Parsi born in Zanzibar - and grew up there and in India until his mid-teens. He has been referred to as - "Britain's first Asian rock star". In 2002, Mercury was placed ... - - The everyday beverage coffee is a commodity second only to oil in worldwide trade. - - more than 680,000 cases of COVID-19 have been reported in over 190 countries and - territories , resulting in approximately 31,900 deaths . + - "a plants require water for survival. If no rain or watering, the plant dies.\ + \ \n Outdoor plants require rain to survive." + - (Vegan) soups are nutritious. In addition to them being easy to digest, most the + time, soups are made from nutrient-dense ingredients like herbs, spices, vegetables, + and beans. Because the soup is full of those nutrients AND that it's easy to digest, + your body is able to absorb more of those nutrients into your system. + - If you do the math, there are 11,238,513 possible combinations of five white balls + (without order mattering). Multiply that by the 26 possible red balls, and you + get 292,201,338 possible Powerball number combinations. At $2 per ticket, you'd + need $584,402,676 to buy every single combination and guarantee a win. model-index: - name: SentenceTransformer based on microsoft/deberta-v3-small results: @@ -155,34 +141,34 @@ model-index: type: sts-test metrics: - type: pearson_cosine - value: 0.6549476499152822 + value: 0.6709134867652243 name: Pearson Cosine - type: spearman_cosine - value: 0.6617045917839 + value: 0.6758937399794869 name: Spearman Cosine - type: pearson_manhattan - value: 0.6703075464471974 + value: 0.6857895258959846 name: Pearson Manhattan - type: spearman_manhattan - value: 0.664562675843923 + value: 0.6790772999636097 name: Spearman Manhattan - type: pearson_euclidean - value: 0.6669531190153849 + value: 0.682301685365551 name: Pearson Euclidean - type: spearman_euclidean - value: 0.6619002890499646 + value: 0.6764461943013637 name: Spearman Euclidean - type: pearson_dot - value: 0.654094600699473 + value: 0.6691751223113676 name: Pearson Dot - type: spearman_dot - value: 0.6611669948808051 + value: 0.672994753266552 name: Spearman Dot - type: pearson_max - value: 0.6703075464471974 + value: 0.6857895258959846 name: Pearson Max - type: spearman_max - value: 0.664562675843923 + value: 0.6790772999636097 name: Spearman Max - task: type: binary-classification @@ -195,106 +181,106 @@ model-index: value: 0.6953125 name: Cosine Accuracy - type: cosine_accuracy_threshold - value: 0.9145020246505737 + value: 0.9157084226608276 name: Cosine Accuracy Threshold - type: cosine_f1 - value: 0.560364464692483 + value: 0.5553145336225597 name: Cosine F1 - type: cosine_f1_threshold - value: 0.8175112009048462 + value: 0.8242306113243103 name: Cosine F1 Threshold - type: cosine_precision - value: 0.462406015037594 + value: 0.4444444444444444 name: Cosine Precision - type: cosine_recall - value: 0.7109826589595376 + value: 0.7398843930635838 name: Cosine Recall - type: cosine_ap - value: 0.5212810979375195 + value: 0.5141008524462632 name: Cosine Ap - type: dot_accuracy value: 0.693359375 name: Dot Accuracy - type: dot_accuracy_threshold - value: 700.8072509765625 + value: 701.5110473632812 name: Dot Accuracy Threshold - type: dot_f1 - value: 0.5540540540540541 + value: 0.5533769063180829 name: Dot F1 - type: dot_f1_threshold - value: 623.1869506835938 + value: 629.531982421875 name: Dot F1 Threshold - type: dot_precision - value: 0.45387453874538747 + value: 0.44405594405594406 name: Dot Precision - type: dot_recall - value: 0.7109826589595376 + value: 0.7341040462427746 name: Dot Recall - type: dot_ap - value: 0.5186569295484549 + value: 0.5138197724822148 name: Dot Ap - type: manhattan_accuracy value: 0.69140625 name: Manhattan Accuracy - type: manhattan_accuracy_threshold - value: 245.1360626220703 + value: 229.85313415527344 name: Manhattan Accuracy Threshold - type: manhattan_f1 - value: 0.5584415584415584 + value: 0.5631929046563192 name: Manhattan F1 - type: manhattan_f1_threshold - value: 360.3310546875 + value: 344.6240539550781 name: Manhattan F1 Threshold - type: manhattan_precision - value: 0.4463667820069204 + value: 0.4568345323741007 name: Manhattan Precision - type: manhattan_recall - value: 0.7456647398843931 + value: 0.7341040462427746 name: Manhattan Recall - type: manhattan_ap - value: 0.5193808341055445 + value: 0.5124222610401596 name: Manhattan Ap - type: euclidean_accuracy value: 0.6953125 name: Euclidean Accuracy - type: euclidean_accuracy_threshold - value: 11.445773124694824 + value: 11.348623275756836 name: Euclidean Accuracy Threshold - type: euclidean_f1 - value: 0.560364464692483 + value: 0.5541125541125541 name: Euclidean F1 - type: euclidean_f1_threshold - value: 16.688749313354492 + value: 16.391315460205078 name: Euclidean F1 Threshold - type: euclidean_precision - value: 0.462406015037594 + value: 0.4429065743944637 name: Euclidean Precision - type: euclidean_recall - value: 0.7109826589595376 + value: 0.7398843930635838 name: Euclidean Recall - type: euclidean_ap - value: 0.5209866197717024 + value: 0.5140792717603242 name: Euclidean Ap - type: max_accuracy value: 0.6953125 name: Max Accuracy - type: max_accuracy_threshold - value: 700.8072509765625 + value: 701.5110473632812 name: Max Accuracy Threshold - type: max_f1 - value: 0.560364464692483 + value: 0.5631929046563192 name: Max F1 - type: max_f1_threshold - value: 623.1869506835938 + value: 629.531982421875 name: Max F1 Threshold - type: max_precision - value: 0.462406015037594 + value: 0.4568345323741007 name: Max Precision - type: max_recall - value: 0.7456647398843931 + value: 0.7398843930635838 name: Max Recall - type: max_ap - value: 0.5212810979375195 + value: 0.5141008524462632 name: Max Ap - task: type: binary-classification @@ -304,109 +290,109 @@ model-index: type: Qnli-dev metrics: - type: cosine_accuracy - value: 0.6796875 + value: 0.67578125 name: Cosine Accuracy - type: cosine_accuracy_threshold - value: 0.7960593700408936 + value: 0.7804532051086426 name: Cosine Accuracy Threshold - type: cosine_f1 - value: 0.6924315619967794 + value: 0.6888111888111887 name: Cosine F1 - type: cosine_f1_threshold - value: 0.7081151008605957 + value: 0.7391257286071777 name: Cosine F1 Threshold - type: cosine_precision - value: 0.5584415584415584 + value: 0.5863095238095238 name: Cosine Precision - type: cosine_recall - value: 0.9110169491525424 + value: 0.8347457627118644 name: Cosine Recall - type: cosine_ap - value: 0.7039872572986636 + value: 0.7024806206418001 name: Cosine Ap - type: dot_accuracy - value: 0.677734375 + value: 0.671875 name: Dot Accuracy - type: dot_accuracy_threshold - value: 606.1690063476562 + value: 589.8578491210938 name: Dot Accuracy Threshold - type: dot_f1 - value: 0.6939443535188216 + value: 0.6887417218543046 name: Dot F1 - type: dot_f1_threshold - value: 547.9747314453125 + value: 549.0986328125 name: Dot F1 Threshold - type: dot_precision - value: 0.5653333333333334 + value: 0.5652173913043478 name: Dot Precision - type: dot_recall - value: 0.8983050847457628 + value: 0.8813559322033898 name: Dot Recall - type: dot_ap - value: 0.7003540936136716 + value: 0.6993628011203765 name: Dot Ap - type: manhattan_accuracy - value: 0.697265625 + value: 0.689453125 name: Manhattan Accuracy - type: manhattan_accuracy_threshold - value: 376.2118835449219 + value: 383.89593505859375 name: Manhattan Accuracy Threshold - type: manhattan_f1 - value: 0.6949429037520392 + value: 0.6876090750436299 name: Manhattan F1 - type: manhattan_f1_threshold - value: 439.9166564941406 + value: 419.38165283203125 name: Manhattan F1 Threshold - type: manhattan_precision - value: 0.5649867374005305 + value: 0.5845697329376854 name: Manhattan Precision - type: manhattan_recall - value: 0.902542372881356 + value: 0.8347457627118644 name: Manhattan Recall - type: manhattan_ap - value: 0.7133804101994428 + value: 0.7092608588336894 name: Manhattan Ap - type: euclidean_accuracy - value: 0.6796875 + value: 0.677734375 name: Euclidean Accuracy - type: euclidean_accuracy_threshold - value: 17.620656967163086 + value: 18.17205238342285 name: Euclidean Accuracy Threshold - type: euclidean_f1 - value: 0.6935483870967742 + value: 0.6893039049235994 name: Euclidean F1 - type: euclidean_f1_threshold - value: 20.996856689453125 + value: 20.12609100341797 name: Euclidean F1 Threshold - type: euclidean_precision - value: 0.5598958333333334 + value: 0.5750708215297451 name: Euclidean Precision - type: euclidean_recall - value: 0.9110169491525424 + value: 0.8601694915254238 name: Euclidean Recall - type: euclidean_ap - value: 0.7045153090257912 + value: 0.7030782182119286 name: Euclidean Ap - type: max_accuracy - value: 0.697265625 + value: 0.689453125 name: Max Accuracy - type: max_accuracy_threshold - value: 606.1690063476562 + value: 589.8578491210938 name: Max Accuracy Threshold - type: max_f1 - value: 0.6949429037520392 + value: 0.6893039049235994 name: Max F1 - type: max_f1_threshold - value: 547.9747314453125 + value: 549.0986328125 name: Max F1 Threshold - type: max_precision - value: 0.5653333333333334 + value: 0.5863095238095238 name: Max Precision - type: max_recall - value: 0.9110169491525424 + value: 0.8813559322033898 name: Max Recall - type: max_ap - value: 0.7133804101994428 + value: 0.7092608588336894 name: Max Ap --- @@ -438,6 +424,8 @@ This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [m SentenceTransformer( (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: DebertaV2Model (1): AdvancedWeightedPooling( + (alpha_dropout_layer): Dropout(p=0.01, inplace=False) + (gate_dropout_layer): Dropout(p=0.05, inplace=False) (linear_cls_pj): Linear(in_features=768, out_features=768, bias=True) (linear_cls_Qpj): Linear(in_features=768, out_features=768, bias=True) (linear_mean_pj): Linear(in_features=768, out_features=768, bias=True) @@ -472,9 +460,9 @@ from sentence_transformers import SentenceTransformer model = SentenceTransformer("bobox/DeBERTa3-s-CustomPoolin-toytest2-step1-checkpoints-tmp") # Run inference sentences = [ - 'Larry Lurex was the original stage name of which late singer?', - 'Larry Lurex Story - Freddie Mercury Net Worth Larry Lurex Story Read more... Freddie Mercury Freddie Mercury Net Worth is $100 Million. Freddie Mercury was born in Zanzibar and has an estimated net worth of $100 million dollars. As the lead singer and songwriter with the hugely successful British band, Queen, Freddie Mercury wrote many hit. Freddie Mercury (born Farrok... Freddie Mercury Net Worth is $100 Million. Freddie Mercury Net Worth is $100 Million. Freddie Mercury was born in Zanzibar and has an estimated net worth of $100 million dollars. As the lead singer and songwriter with the hugely successful British band, Queen, Freddie Mercury wrote many hit Freddie Mercury , 5 September 1946 - 24 November 1991) was a British musician, singer and songwriter, best known as the lead vocalist and lyricist of the rock band Queen. As a performer, he was known for his flamboyant stage persona and powerful vocals over a four-octave range. As a songwriter, Mercury composed many hits for Queen, including "Bohemian Rhapsody", "Killer Queen", "Somebody to Love", "Don\'t Stop Me Now", "Crazy Little Thing Called Love" and "We Are the Champions". In addition to his work with Queen, he led a solo career, and also occasionally served as a producer and guest musician for other artists. He died of bronchopneumonia brought on by AIDS on 24 November 1991, only one day after publicly acknowledging he had the disease. Mercury was a Parsi born in Zanzibar and grew up there and in India until his mid-teens. He has been referred to as "Britain\'s first Asian rock star". In 2002, Mercury was placed ...', - 'The everyday beverage coffee is a commodity second only to oil in worldwide trade.', + 'What do outdoor plants require to survive?', + 'a plants require water for survival. If no rain or watering, the plant dies. \n Outdoor plants require rain to survive.', + "(Vegan) soups are nutritious. In addition to them being easy to digest, most the time, soups are made from nutrient-dense ingredients like herbs, spices, vegetables, and beans. Because the soup is full of those nutrients AND that it's easy to digest, your body is able to absorb more of those nutrients into your system.", ] embeddings = model.encode(sentences) print(embeddings.shape) @@ -520,16 +508,16 @@ You can finetune this model on your own dataset. | Metric | Value | |:--------------------|:-----------| -| pearson_cosine | 0.6549 | -| **spearman_cosine** | **0.6617** | -| pearson_manhattan | 0.6703 | -| spearman_manhattan | 0.6646 | -| pearson_euclidean | 0.667 | -| spearman_euclidean | 0.6619 | -| pearson_dot | 0.6541 | -| spearman_dot | 0.6612 | -| pearson_max | 0.6703 | -| spearman_max | 0.6646 | +| pearson_cosine | 0.6709 | +| **spearman_cosine** | **0.6759** | +| pearson_manhattan | 0.6858 | +| spearman_manhattan | 0.6791 | +| pearson_euclidean | 0.6823 | +| spearman_euclidean | 0.6764 | +| pearson_dot | 0.6692 | +| spearman_dot | 0.673 | +| pearson_max | 0.6858 | +| spearman_max | 0.6791 | #### Binary Classification * Dataset: `allNLI-dev` @@ -538,40 +526,40 @@ You can finetune this model on your own dataset. | Metric | Value | |:-----------------------------|:-----------| | cosine_accuracy | 0.6953 | -| cosine_accuracy_threshold | 0.9145 | -| cosine_f1 | 0.5604 | -| cosine_f1_threshold | 0.8175 | -| cosine_precision | 0.4624 | -| cosine_recall | 0.711 | -| cosine_ap | 0.5213 | +| cosine_accuracy_threshold | 0.9157 | +| cosine_f1 | 0.5553 | +| cosine_f1_threshold | 0.8242 | +| cosine_precision | 0.4444 | +| cosine_recall | 0.7399 | +| cosine_ap | 0.5141 | | dot_accuracy | 0.6934 | -| dot_accuracy_threshold | 700.8073 | -| dot_f1 | 0.5541 | -| dot_f1_threshold | 623.187 | -| dot_precision | 0.4539 | -| dot_recall | 0.711 | -| dot_ap | 0.5187 | +| dot_accuracy_threshold | 701.511 | +| dot_f1 | 0.5534 | +| dot_f1_threshold | 629.532 | +| dot_precision | 0.4441 | +| dot_recall | 0.7341 | +| dot_ap | 0.5138 | | manhattan_accuracy | 0.6914 | -| manhattan_accuracy_threshold | 245.1361 | -| manhattan_f1 | 0.5584 | -| manhattan_f1_threshold | 360.3311 | -| manhattan_precision | 0.4464 | -| manhattan_recall | 0.7457 | -| manhattan_ap | 0.5194 | +| manhattan_accuracy_threshold | 229.8531 | +| manhattan_f1 | 0.5632 | +| manhattan_f1_threshold | 344.6241 | +| manhattan_precision | 0.4568 | +| manhattan_recall | 0.7341 | +| manhattan_ap | 0.5124 | | euclidean_accuracy | 0.6953 | -| euclidean_accuracy_threshold | 11.4458 | -| euclidean_f1 | 0.5604 | -| euclidean_f1_threshold | 16.6887 | -| euclidean_precision | 0.4624 | -| euclidean_recall | 0.711 | -| euclidean_ap | 0.521 | +| euclidean_accuracy_threshold | 11.3486 | +| euclidean_f1 | 0.5541 | +| euclidean_f1_threshold | 16.3913 | +| euclidean_precision | 0.4429 | +| euclidean_recall | 0.7399 | +| euclidean_ap | 0.5141 | | max_accuracy | 0.6953 | -| max_accuracy_threshold | 700.8073 | -| max_f1 | 0.5604 | -| max_f1_threshold | 623.187 | -| max_precision | 0.4624 | -| max_recall | 0.7457 | -| **max_ap** | **0.5213** | +| max_accuracy_threshold | 701.511 | +| max_f1 | 0.5632 | +| max_f1_threshold | 629.532 | +| max_precision | 0.4568 | +| max_recall | 0.7399 | +| **max_ap** | **0.5141** | #### Binary Classification * Dataset: `Qnli-dev` @@ -579,41 +567,41 @@ You can finetune this model on your own dataset. | Metric | Value | |:-----------------------------|:-----------| -| cosine_accuracy | 0.6797 | -| cosine_accuracy_threshold | 0.7961 | -| cosine_f1 | 0.6924 | -| cosine_f1_threshold | 0.7081 | -| cosine_precision | 0.5584 | -| cosine_recall | 0.911 | -| cosine_ap | 0.704 | -| dot_accuracy | 0.6777 | -| dot_accuracy_threshold | 606.169 | -| dot_f1 | 0.6939 | -| dot_f1_threshold | 547.9747 | -| dot_precision | 0.5653 | -| dot_recall | 0.8983 | -| dot_ap | 0.7004 | -| manhattan_accuracy | 0.6973 | -| manhattan_accuracy_threshold | 376.2119 | -| manhattan_f1 | 0.6949 | -| manhattan_f1_threshold | 439.9167 | -| manhattan_precision | 0.565 | -| manhattan_recall | 0.9025 | -| manhattan_ap | 0.7134 | -| euclidean_accuracy | 0.6797 | -| euclidean_accuracy_threshold | 17.6207 | -| euclidean_f1 | 0.6935 | -| euclidean_f1_threshold | 20.9969 | -| euclidean_precision | 0.5599 | -| euclidean_recall | 0.911 | -| euclidean_ap | 0.7045 | -| max_accuracy | 0.6973 | -| max_accuracy_threshold | 606.169 | -| max_f1 | 0.6949 | -| max_f1_threshold | 547.9747 | -| max_precision | 0.5653 | -| max_recall | 0.911 | -| **max_ap** | **0.7134** | +| cosine_accuracy | 0.6758 | +| cosine_accuracy_threshold | 0.7805 | +| cosine_f1 | 0.6888 | +| cosine_f1_threshold | 0.7391 | +| cosine_precision | 0.5863 | +| cosine_recall | 0.8347 | +| cosine_ap | 0.7025 | +| dot_accuracy | 0.6719 | +| dot_accuracy_threshold | 589.8578 | +| dot_f1 | 0.6887 | +| dot_f1_threshold | 549.0986 | +| dot_precision | 0.5652 | +| dot_recall | 0.8814 | +| dot_ap | 0.6994 | +| manhattan_accuracy | 0.6895 | +| manhattan_accuracy_threshold | 383.8959 | +| manhattan_f1 | 0.6876 | +| manhattan_f1_threshold | 419.3817 | +| manhattan_precision | 0.5846 | +| manhattan_recall | 0.8347 | +| manhattan_ap | 0.7093 | +| euclidean_accuracy | 0.6777 | +| euclidean_accuracy_threshold | 18.1721 | +| euclidean_f1 | 0.6893 | +| euclidean_f1_threshold | 20.1261 | +| euclidean_precision | 0.5751 | +| euclidean_recall | 0.8602 | +| euclidean_ap | 0.7031 | +| max_accuracy | 0.6895 | +| max_accuracy_threshold | 589.8578 | +| max_f1 | 0.6893 | +| max_f1_threshold | 549.0986 | +| max_precision | 0.5863 | +| max_recall | 0.8814 | +| **max_ap** | **0.7093** |