diff --git "a/checkpoint-2440/README.md" "b/checkpoint-2440/README.md" --- "a/checkpoint-2440/README.md" +++ "b/checkpoint-2440/README.md" @@ -56,94 +56,80 @@ tags: - dataset_size:32500 - loss:GISTEmbedLoss widget: -- source_sentence: Vermont South is bordered by Mitcham to the north , Nunawading - and Forest Hill to the west , Vermont to the south and Wantirna and Ringwood to - the east . +- source_sentence: What was the name of Jed's nephew in The Beverly Hillbillies? sentences: - - Vermont South is bordered to the north of Mitcham , to the west by Nunawading - and Forest Hill , to the south by Vermont and to the east by Wantirna and Ringwood - . - - Ocean waves are among the most impressive waves in the world. They clearly show - that waves transfer energy. In the case of ocean waves, energy is transferred - through matter. But some waves, called electromagnetic waves, can transfer energy - without traveling through matter. These waves can travel through space. You can - read more about electromagnetic waves in the chapter "Electromagnetic Radiation. - " Waves that transfer energy through matter are the focus of the present chapter. - These waves are called mechanical waves. - - Mosque–Cathedral of Córdoba The building is most notable for its arcaded hypostyle - hall, with 856 columns of jasper, onyx, marble, and granite. These were made from - pieces of the Roman temple which had occupied the site previously, as well as - other destroyed Roman buildings, such as the Mérida amphitheatre. The double arches - were a new introduction to architecture, permitting higher ceilings than would - otherwise be possible with relatively low columns. The double arches consist of - a lower horseshoe arch and an upper semi-circular arch. The famous alternating - red and white voussoirs of the arches were inspired by those in the Dome of the - Rock.[31] and also resemble those of the Aachen Cathedral, which were built almost - at the same time. Horseshoe arches were known in the Iberian Peninsula since late - Antiquity, as can be seen on the 3rd-century "Estela de los Flavios", now in the - arqueological museum of León. A centrally located honey-combed dome has blue tiles - decorated with stars. -- source_sentence: What are single-celled organisms that lack a nucleus? + - Jed Clampett - The Beverly Hillbillies Characters - ShareTV Buddy Ebsen began + his career as a dancer in the late 1920s in a Broadway chorus. He later formed + a vaudeville ... Character Bio Although he had received little formal education, + Jed Clampett had a good deal of common sense. A good-natured man, he is the apparent + head of the family. Jed's wife (Elly May's mother) died, but is referred to in + the episode "Duke Steals A Wife" as Rose Ellen. Jed was shown to be an expert + marksman and was extremely loyal to his family and kinfolk. The huge oil pool + in the swamp he owned was the beginning of his rags-to-riches journey to Beverly + Hills. Although he longed for the old ways back in the hills, he made the best + of being in Beverly Hills. Whenever he had anything on his mind, he would sit + on the curbstone of his mansion and whittle until he came up with the answer. + Jedediah, the version of Jed's name used in the 1993 Beverly Hillbillies theatrical + movie, was never mentioned in the original television series (though coincidentally, + on Ebsen's subsequent series, Barnaby Jones, Barnaby's nephew J.R. was also named + Jedediah). In one episode Jed and Granny reminisce about seeing Buddy Ebsen and + Vilma Ebsen—a joking reference to the Ebsens' song and dance act. Jed appears + in all 274 episodes. Episode Screenshots + - a stove generates heat for cooking usually + - Miss Marple series by Agatha Christie Miss Marple series 43 works, 13 primary + works Mystery series in order of publication. Miss Marple is introduced in The + Murder at the Vicarage but the books can be read in any order. Mixed short story + collections are included if some are Marple, often have horror, supernatural, + maybe detective Poirot, Pyne, or Quin. Note that "Nemesis" should be read AFTER + "A Caribbean Holiday" +- source_sentence: A recording of folk songs done for the Columbia society in 1942 + was largely arranged by Pjetër Dungu . sentences: - - a dog standing near a street sign on a dirt road - - "Prokaryotes are single-celled organisms that lack a nucleus.. Prokaryotes All\ - \ bacteria are prokaryotes. \n bacteria are single-celled organisms that lack\ - \ a nucleus." - - 1 cup rice uncooked = 7 oz / 200 g = 600 g ( 5 cups / 21 oz in weight) cooked - [2] (Will serve 5 people). 1 pound of rice = 2 1/4 to 2 1/2 cups uncooked = 11 - cups cooked (Will serve 11 people). -- source_sentence: In the UK television series ‘On The Buses’, what is the first name - of Inspector Blake? + - Someone cooking drugs in a spoon over a candle + - A recording of folk songs made for the Columbia society in 1942 was largely arranged + by Pjetër Dungu . + - A Murder of Crows, A Parliament of Owls What do You Call a Group of Birds? Do + you know what a group of Ravens is called? What about a group of peacocks, snipe + or hummingbirds? Here is a list of Bird Collectives, terms that you can use to + describe a group of birds. Birds in general +- source_sentence: A person in a kitchen looking at the oven. sentences: - - How Long Does Vicodin Stay in Your System? While the effects of Vicodin last around - 4 hours, traces of the drug can remain in your system for up to 72 hours. In some - adults you can still find traces of the drug in your system after 5 days. A person's - weight, diet, age and level of body fat will contribute to how quickly your body - is able to process and rid itself of the drug. In general, the higher your metabolism - rate, the sooner traces of the drug will be eliminated. - - 'Stephen Lewis - IMDb IMDb Actor | Writer Stephen Lewis, will be chiefly remembered - for the comedy catchphrase: "I ''ate you Butler!" He delivered it week after week - in the hit sitcom On The Buses, a saucy slice of life that ran on ITV from 1969 - to 1973. Lewis was Cyril "Blakey" Blake, a bus inspector with a Hitler moustache - and delusions of grandeur. His nemesis was Stan Butler, a driver ... See full - bio » Born:' - - 'Definition of Dysuria Our Symptoms article on Burning Urination provides a comprehensive - look at the possible causes and treatments of Burning Urination. Definition of - Dysuria Dysuria: Pain during urination, or difficulty urinating. Dysuria is usually - caused by inflammation of the urethra, frequently as a result of infection. Last - Editorial Review: 5/13/2016' -- source_sentence: 'Two cups of black coffee sitting next to a coffee pot. ' + - "staying warm has a positive impact on an animal 's survival. Furry animals grow\ + \ thicker coats to keep warm in the winter. \n Furry animals grow thicker coats\ + \ which has a positive impact on their survival. " + - A woman In the kitchen opening her oven. + - EE has apologised after a fault left some of its customers unable to use the internet + on their mobile devices. +- source_sentence: Air can be separated into several elements. sentences: - - As of 19 March , more than 225,000 cases of COVID-19 have been reported in over - 150 countries and territories , resulting in more than 9,200 deaths and 85,000 - recoveries . - - Other than gametes, normal human cells have a total of 46 chromosomes per cell. - - two small cups filled with coffee next to a silver coffee pot -- source_sentence: Larry Lurex was the original stage name of which late singer? + - Which of the following substances can be separated into several elements? + - 'Funny Interesting Facts Humor Strange: Carl and the Passions changed band name + to what Carl and the Passions changed band name to what Beach Boys Carl and the + Passions - "So Tough" is the fifteenth studio album released by The Beach Boys + in 1972. In its initial release, it was the second disc of a two-album set with + Pet Sounds (which The Beach Boys were able to license from Capitol Records). Unfortunately, + due to the fact that Carl and the Passions - "So Tough" was a transitional album + that saw the departure of one member and the introduction of two new ones, making + it wildly inconsistent in terms of type of material present, it paled next to + their 1966 classic and was seen as something of a disappointment in its time of + release. The title of the album itself was a reference to an early band Carl Wilson + had been in as a teenager (some say a possible early name for the Beach Boys). + It was also the first album released under a new deal with Warner Bros. that allowed + the company to distribute all future Beach Boys product in foreign as well as + domestic markets.' + - Which statement correctly describes a relationship between two human body systems? +- source_sentence: What do outdoor plants require to survive? sentences: - - Larry Lurex Story - Freddie Mercury Net Worth Larry Lurex Story Read more... Freddie - Mercury Freddie Mercury Net Worth is $100 Million. Freddie Mercury was born in - Zanzibar and has an estimated net worth of $100 million dollars. As the lead singer - and songwriter with the hugely successful British band, Queen, Freddie Mercury - wrote many hit. Freddie Mercury (born Farrok... Freddie Mercury Net Worth is $100 - Million. Freddie Mercury Net Worth is $100 Million. Freddie Mercury was born in - Zanzibar and has an estimated net worth of $100 million dollars. As the lead singer - and songwriter with the hugely successful British band, Queen, Freddie Mercury - wrote many hit Freddie Mercury , 5 September 1946 - 24 November 1991) was a British - musician, singer and songwriter, best known as the lead vocalist and lyricist - of the rock band Queen. As a performer, he was known for his flamboyant stage - persona and powerful vocals over a four-octave range. As a songwriter, Mercury - composed many hits for Queen, including "Bohemian Rhapsody", "Killer Queen", "Somebody - to Love", "Don't Stop Me Now", "Crazy Little Thing Called Love" and "We Are the - Champions". In addition to his work with Queen, he led a solo career, and also - occasionally served as a producer and guest musician for other artists. He died - of bronchopneumonia brought on by AIDS on 24 November 1991, only one day after - publicly acknowledging he had the disease. Mercury was a Parsi born in Zanzibar - and grew up there and in India until his mid-teens. He has been referred to as - "Britain's first Asian rock star". In 2002, Mercury was placed ... - - The everyday beverage coffee is a commodity second only to oil in worldwide trade. - - more than 680,000 cases of COVID-19 have been reported in over 190 countries and - territories , resulting in approximately 31,900 deaths . + - "a plants require water for survival. If no rain or watering, the plant dies.\ + \ \n Outdoor plants require rain to survive." + - (Vegan) soups are nutritious. In addition to them being easy to digest, most the + time, soups are made from nutrient-dense ingredients like herbs, spices, vegetables, + and beans. Because the soup is full of those nutrients AND that it's easy to digest, + your body is able to absorb more of those nutrients into your system. + - If you do the math, there are 11,238,513 possible combinations of five white balls + (without order mattering). Multiply that by the 26 possible red balls, and you + get 292,201,338 possible Powerball number combinations. At $2 per ticket, you'd + need $584,402,676 to buy every single combination and guarantee a win. model-index: - name: SentenceTransformer based on microsoft/deberta-v3-small results: @@ -155,34 +141,34 @@ model-index: type: sts-test metrics: - type: pearson_cosine - value: 0.6552902390696351 + value: 0.6631509770031139 name: Pearson Cosine - type: spearman_cosine - value: 0.6644033613533696 + value: 0.6695385238467715 name: Spearman Cosine - type: pearson_manhattan - value: 0.6720928689273424 + value: 0.6807913115534869 name: Pearson Manhattan - type: spearman_manhattan - value: 0.6672981861989953 + value: 0.6746454482942351 name: Spearman Manhattan - type: pearson_euclidean - value: 0.6686392487670392 + value: 0.6756013936756754 name: Pearson Euclidean - type: spearman_euclidean - value: 0.6643764210940122 + value: 0.6697092051577183 name: Spearman Euclidean - type: pearson_dot - value: 0.6546625093787101 + value: 0.6607555540270089 name: Pearson Dot - type: spearman_dot - value: 0.6645467891461292 + value: 0.6666498299239565 name: Spearman Dot - type: pearson_max - value: 0.6720928689273424 + value: 0.6807913115534869 name: Pearson Max - type: spearman_max - value: 0.6672981861989953 + value: 0.6746454482942351 name: Spearman Max - task: type: binary-classification @@ -192,109 +178,109 @@ model-index: type: allNLI-dev metrics: - type: cosine_accuracy - value: 0.693359375 + value: 0.697265625 name: Cosine Accuracy - type: cosine_accuracy_threshold - value: 0.9163593053817749 + value: 0.9179866909980774 name: Cosine Accuracy Threshold - type: cosine_f1 - value: 0.5478424015009381 + value: 0.5533769063180829 name: Cosine F1 - type: cosine_f1_threshold - value: 0.7880935668945312 + value: 0.8282407522201538 name: Cosine F1 Threshold - type: cosine_precision - value: 0.40555555555555556 + value: 0.44405594405594406 name: Cosine Precision - type: cosine_recall - value: 0.8439306358381503 + value: 0.7341040462427746 name: Cosine Recall - type: cosine_ap - value: 0.5156280201012031 + value: 0.5023677428864256 name: Cosine Ap - type: dot_accuracy - value: 0.693359375 + value: 0.6953125 name: Dot Accuracy - type: dot_accuracy_threshold - value: 698.921142578125 + value: 702.9041748046875 name: Dot Accuracy Threshold - type: dot_f1 - value: 0.5457943925233645 + value: 0.5533769063180829 name: Dot F1 - type: dot_f1_threshold - value: 599.6630859375 + value: 631.9176635742188 name: Dot F1 Threshold - type: dot_precision - value: 0.40331491712707185 + value: 0.44405594405594406 name: Dot Precision - type: dot_recall - value: 0.8439306358381503 + value: 0.7341040462427746 name: Dot Recall - type: dot_ap - value: 0.5147433660036644 + value: 0.5005776281820205 name: Dot Ap - type: manhattan_accuracy - value: 0.69140625 + value: 0.689453125 name: Manhattan Accuracy - type: manhattan_accuracy_threshold - value: 247.3362274169922 + value: 237.93911743164062 name: Manhattan Accuracy Threshold - type: manhattan_f1 - value: 0.5513307984790875 + value: 0.5550660792951542 name: Manhattan F1 - type: manhattan_f1_threshold - value: 376.1918640136719 + value: 339.4214782714844 name: Manhattan F1 Threshold - type: manhattan_precision - value: 0.41076487252124644 + value: 0.4483985765124555 name: Manhattan Precision - type: manhattan_recall - value: 0.838150289017341 + value: 0.7283236994219653 name: Manhattan Recall - type: manhattan_ap - value: 0.5162044992927799 + value: 0.502842113525952 name: Manhattan Ap - type: euclidean_accuracy - value: 0.693359375 + value: 0.697265625 name: Euclidean Accuracy - type: euclidean_accuracy_threshold - value: 11.29690933227539 + value: 11.191230773925781 name: Euclidean Accuracy Threshold - type: euclidean_f1 - value: 0.5478424015009381 + value: 0.5533769063180829 name: Euclidean F1 - type: euclidean_f1_threshold - value: 17.960678100585938 + value: 16.181026458740234 name: Euclidean F1 Threshold - type: euclidean_precision - value: 0.40555555555555556 + value: 0.44405594405594406 name: Euclidean Precision - type: euclidean_recall - value: 0.8439306358381503 + value: 0.7341040462427746 name: Euclidean Recall - type: euclidean_ap - value: 0.5155161734618426 + value: 0.5028917478226242 name: Euclidean Ap - type: max_accuracy - value: 0.693359375 + value: 0.697265625 name: Max Accuracy - type: max_accuracy_threshold - value: 698.921142578125 + value: 702.9041748046875 name: Max Accuracy Threshold - type: max_f1 - value: 0.5513307984790875 + value: 0.5550660792951542 name: Max F1 - type: max_f1_threshold - value: 599.6630859375 + value: 631.9176635742188 name: Max F1 Threshold - type: max_precision - value: 0.41076487252124644 + value: 0.4483985765124555 name: Max Precision - type: max_recall - value: 0.8439306358381503 + value: 0.7341040462427746 name: Max Recall - type: max_ap - value: 0.5162044992927799 + value: 0.5028917478226242 name: Max Ap - task: type: binary-classification @@ -304,109 +290,109 @@ model-index: type: Qnli-dev metrics: - type: cosine_accuracy - value: 0.67578125 + value: 0.681640625 name: Cosine Accuracy - type: cosine_accuracy_threshold - value: 0.8218872547149658 + value: 0.7885782718658447 name: Cosine Accuracy Threshold - type: cosine_f1 - value: 0.6914378029079159 + value: 0.6894197952218429 name: Cosine F1 - type: cosine_f1_threshold - value: 0.7249837517738342 + value: 0.7466418743133545 name: Cosine F1 Threshold - type: cosine_precision - value: 0.5587467362924282 + value: 0.5771428571428572 name: Cosine Precision - type: cosine_recall - value: 0.9067796610169492 + value: 0.8559322033898306 name: Cosine Recall - type: cosine_ap - value: 0.6982356648607996 + value: 0.7002236719885953 name: Cosine Ap - type: dot_accuracy - value: 0.681640625 + value: 0.6796875 name: Dot Accuracy - type: dot_accuracy_threshold - value: 619.56884765625 + value: 598.7392578125 name: Dot Accuracy Threshold - type: dot_f1 - value: 0.6903225806451613 + value: 0.6869712351945855 name: Dot F1 - type: dot_f1_threshold - value: 551.586669921875 + value: 566.3282470703125 name: Dot F1 Threshold - type: dot_precision - value: 0.5572916666666666 + value: 0.571830985915493 name: Dot Precision - type: dot_recall - value: 0.9067796610169492 + value: 0.8601694915254238 name: Dot Recall - type: dot_ap - value: 0.694508632045775 + value: 0.6980666596688423 name: Dot Ap - type: manhattan_accuracy value: 0.685546875 name: Manhattan Accuracy - type: manhattan_accuracy_threshold - value: 360.5780029296875 + value: 369.89447021484375 name: Manhattan Accuracy Threshold - type: manhattan_f1 - value: 0.6902086677367576 + value: 0.6902356902356903 name: Manhattan F1 - type: manhattan_f1_threshold - value: 433.43255615234375 + value: 421.6947021484375 name: Manhattan F1 Threshold - type: manhattan_precision - value: 0.5555555555555556 + value: 0.5726256983240223 name: Manhattan Precision - type: manhattan_recall - value: 0.9110169491525424 + value: 0.8686440677966102 name: Manhattan Recall - type: manhattan_ap - value: 0.709700437823957 + value: 0.7083138482854554 name: Manhattan Ap - type: euclidean_accuracy - value: 0.677734375 + value: 0.68359375 name: Euclidean Accuracy - type: euclidean_accuracy_threshold - value: 16.517976760864258 + value: 18.127986907958984 name: Euclidean Accuracy Threshold - type: euclidean_f1 - value: 0.6914378029079159 + value: 0.6903553299492386 name: Euclidean F1 - type: euclidean_f1_threshold - value: 20.45012664794922 + value: 19.754405975341797 name: Euclidean F1 Threshold - type: euclidean_precision - value: 0.5587467362924282 + value: 0.5746478873239437 name: Euclidean Precision - type: euclidean_recall - value: 0.9067796610169492 + value: 0.864406779661017 name: Euclidean Recall - type: euclidean_ap - value: 0.698306251672151 + value: 0.7003054512799944 name: Euclidean Ap - type: max_accuracy value: 0.685546875 name: Max Accuracy - type: max_accuracy_threshold - value: 619.56884765625 + value: 598.7392578125 name: Max Accuracy Threshold - type: max_f1 - value: 0.6914378029079159 + value: 0.6903553299492386 name: Max F1 - type: max_f1_threshold - value: 551.586669921875 + value: 566.3282470703125 name: Max F1 Threshold - type: max_precision - value: 0.5587467362924282 + value: 0.5771428571428572 name: Max Precision - type: max_recall - value: 0.9110169491525424 + value: 0.8686440677966102 name: Max Recall - type: max_ap - value: 0.709700437823957 + value: 0.7083138482854554 name: Max Ap --- @@ -438,6 +424,8 @@ This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [m SentenceTransformer( (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: DebertaV2Model (1): AdvancedWeightedPooling( + (alpha_dropout_layer): Dropout(p=0.01, inplace=False) + (gate_dropout_layer): Dropout(p=0.05, inplace=False) (linear_cls_pj): Linear(in_features=768, out_features=768, bias=True) (linear_cls_Qpj): Linear(in_features=768, out_features=768, bias=True) (linear_mean_pj): Linear(in_features=768, out_features=768, bias=True) @@ -472,9 +460,9 @@ from sentence_transformers import SentenceTransformer model = SentenceTransformer("bobox/DeBERTa3-s-CustomPoolin-toytest2-step1-checkpoints-tmp") # Run inference sentences = [ - 'Larry Lurex was the original stage name of which late singer?', - 'Larry Lurex Story - Freddie Mercury Net Worth Larry Lurex Story Read more... Freddie Mercury Freddie Mercury Net Worth is $100 Million. Freddie Mercury was born in Zanzibar and has an estimated net worth of $100 million dollars. As the lead singer and songwriter with the hugely successful British band, Queen, Freddie Mercury wrote many hit. Freddie Mercury (born Farrok... Freddie Mercury Net Worth is $100 Million. Freddie Mercury Net Worth is $100 Million. Freddie Mercury was born in Zanzibar and has an estimated net worth of $100 million dollars. As the lead singer and songwriter with the hugely successful British band, Queen, Freddie Mercury wrote many hit Freddie Mercury , 5 September 1946 - 24 November 1991) was a British musician, singer and songwriter, best known as the lead vocalist and lyricist of the rock band Queen. As a performer, he was known for his flamboyant stage persona and powerful vocals over a four-octave range. As a songwriter, Mercury composed many hits for Queen, including "Bohemian Rhapsody", "Killer Queen", "Somebody to Love", "Don\'t Stop Me Now", "Crazy Little Thing Called Love" and "We Are the Champions". In addition to his work with Queen, he led a solo career, and also occasionally served as a producer and guest musician for other artists. He died of bronchopneumonia brought on by AIDS on 24 November 1991, only one day after publicly acknowledging he had the disease. Mercury was a Parsi born in Zanzibar and grew up there and in India until his mid-teens. He has been referred to as "Britain\'s first Asian rock star". In 2002, Mercury was placed ...', - 'The everyday beverage coffee is a commodity second only to oil in worldwide trade.', + 'What do outdoor plants require to survive?', + 'a plants require water for survival. If no rain or watering, the plant dies. \n Outdoor plants require rain to survive.', + "(Vegan) soups are nutritious. In addition to them being easy to digest, most the time, soups are made from nutrient-dense ingredients like herbs, spices, vegetables, and beans. Because the soup is full of those nutrients AND that it's easy to digest, your body is able to absorb more of those nutrients into your system.", ] embeddings = model.encode(sentences) print(embeddings.shape) @@ -520,16 +508,16 @@ You can finetune this model on your own dataset. | Metric | Value | |:--------------------|:-----------| -| pearson_cosine | 0.6553 | -| **spearman_cosine** | **0.6644** | -| pearson_manhattan | 0.6721 | -| spearman_manhattan | 0.6673 | -| pearson_euclidean | 0.6686 | -| spearman_euclidean | 0.6644 | -| pearson_dot | 0.6547 | -| spearman_dot | 0.6645 | -| pearson_max | 0.6721 | -| spearman_max | 0.6673 | +| pearson_cosine | 0.6632 | +| **spearman_cosine** | **0.6695** | +| pearson_manhattan | 0.6808 | +| spearman_manhattan | 0.6746 | +| pearson_euclidean | 0.6756 | +| spearman_euclidean | 0.6697 | +| pearson_dot | 0.6608 | +| spearman_dot | 0.6666 | +| pearson_max | 0.6808 | +| spearman_max | 0.6746 | #### Binary Classification * Dataset: `allNLI-dev` @@ -537,41 +525,41 @@ You can finetune this model on your own dataset. | Metric | Value | |:-----------------------------|:-----------| -| cosine_accuracy | 0.6934 | -| cosine_accuracy_threshold | 0.9164 | -| cosine_f1 | 0.5478 | -| cosine_f1_threshold | 0.7881 | -| cosine_precision | 0.4056 | -| cosine_recall | 0.8439 | -| cosine_ap | 0.5156 | -| dot_accuracy | 0.6934 | -| dot_accuracy_threshold | 698.9211 | -| dot_f1 | 0.5458 | -| dot_f1_threshold | 599.6631 | -| dot_precision | 0.4033 | -| dot_recall | 0.8439 | -| dot_ap | 0.5147 | -| manhattan_accuracy | 0.6914 | -| manhattan_accuracy_threshold | 247.3362 | -| manhattan_f1 | 0.5513 | -| manhattan_f1_threshold | 376.1919 | -| manhattan_precision | 0.4108 | -| manhattan_recall | 0.8382 | -| manhattan_ap | 0.5162 | -| euclidean_accuracy | 0.6934 | -| euclidean_accuracy_threshold | 11.2969 | -| euclidean_f1 | 0.5478 | -| euclidean_f1_threshold | 17.9607 | -| euclidean_precision | 0.4056 | -| euclidean_recall | 0.8439 | -| euclidean_ap | 0.5155 | -| max_accuracy | 0.6934 | -| max_accuracy_threshold | 698.9211 | -| max_f1 | 0.5513 | -| max_f1_threshold | 599.6631 | -| max_precision | 0.4108 | -| max_recall | 0.8439 | -| **max_ap** | **0.5162** | +| cosine_accuracy | 0.6973 | +| cosine_accuracy_threshold | 0.918 | +| cosine_f1 | 0.5534 | +| cosine_f1_threshold | 0.8282 | +| cosine_precision | 0.4441 | +| cosine_recall | 0.7341 | +| cosine_ap | 0.5024 | +| dot_accuracy | 0.6953 | +| dot_accuracy_threshold | 702.9042 | +| dot_f1 | 0.5534 | +| dot_f1_threshold | 631.9177 | +| dot_precision | 0.4441 | +| dot_recall | 0.7341 | +| dot_ap | 0.5006 | +| manhattan_accuracy | 0.6895 | +| manhattan_accuracy_threshold | 237.9391 | +| manhattan_f1 | 0.5551 | +| manhattan_f1_threshold | 339.4215 | +| manhattan_precision | 0.4484 | +| manhattan_recall | 0.7283 | +| manhattan_ap | 0.5028 | +| euclidean_accuracy | 0.6973 | +| euclidean_accuracy_threshold | 11.1912 | +| euclidean_f1 | 0.5534 | +| euclidean_f1_threshold | 16.181 | +| euclidean_precision | 0.4441 | +| euclidean_recall | 0.7341 | +| euclidean_ap | 0.5029 | +| max_accuracy | 0.6973 | +| max_accuracy_threshold | 702.9042 | +| max_f1 | 0.5551 | +| max_f1_threshold | 631.9177 | +| max_precision | 0.4484 | +| max_recall | 0.7341 | +| **max_ap** | **0.5029** | #### Binary Classification * Dataset: `Qnli-dev` @@ -579,41 +567,41 @@ You can finetune this model on your own dataset. | Metric | Value | |:-----------------------------|:-----------| -| cosine_accuracy | 0.6758 | -| cosine_accuracy_threshold | 0.8219 | -| cosine_f1 | 0.6914 | -| cosine_f1_threshold | 0.725 | -| cosine_precision | 0.5587 | -| cosine_recall | 0.9068 | -| cosine_ap | 0.6982 | -| dot_accuracy | 0.6816 | -| dot_accuracy_threshold | 619.5688 | -| dot_f1 | 0.6903 | -| dot_f1_threshold | 551.5867 | -| dot_precision | 0.5573 | -| dot_recall | 0.9068 | -| dot_ap | 0.6945 | +| cosine_accuracy | 0.6816 | +| cosine_accuracy_threshold | 0.7886 | +| cosine_f1 | 0.6894 | +| cosine_f1_threshold | 0.7466 | +| cosine_precision | 0.5771 | +| cosine_recall | 0.8559 | +| cosine_ap | 0.7002 | +| dot_accuracy | 0.6797 | +| dot_accuracy_threshold | 598.7393 | +| dot_f1 | 0.687 | +| dot_f1_threshold | 566.3282 | +| dot_precision | 0.5718 | +| dot_recall | 0.8602 | +| dot_ap | 0.6981 | | manhattan_accuracy | 0.6855 | -| manhattan_accuracy_threshold | 360.578 | +| manhattan_accuracy_threshold | 369.8945 | | manhattan_f1 | 0.6902 | -| manhattan_f1_threshold | 433.4326 | -| manhattan_precision | 0.5556 | -| manhattan_recall | 0.911 | -| manhattan_ap | 0.7097 | -| euclidean_accuracy | 0.6777 | -| euclidean_accuracy_threshold | 16.518 | -| euclidean_f1 | 0.6914 | -| euclidean_f1_threshold | 20.4501 | -| euclidean_precision | 0.5587 | -| euclidean_recall | 0.9068 | -| euclidean_ap | 0.6983 | +| manhattan_f1_threshold | 421.6947 | +| manhattan_precision | 0.5726 | +| manhattan_recall | 0.8686 | +| manhattan_ap | 0.7083 | +| euclidean_accuracy | 0.6836 | +| euclidean_accuracy_threshold | 18.128 | +| euclidean_f1 | 0.6904 | +| euclidean_f1_threshold | 19.7544 | +| euclidean_precision | 0.5746 | +| euclidean_recall | 0.8644 | +| euclidean_ap | 0.7003 | | max_accuracy | 0.6855 | -| max_accuracy_threshold | 619.5688 | -| max_f1 | 0.6914 | -| max_f1_threshold | 551.5867 | -| max_precision | 0.5587 | -| max_recall | 0.911 | -| **max_ap** | **0.7097** | +| max_accuracy_threshold | 598.7393 | +| max_f1 | 0.6904 | +| max_f1_threshold | 566.3282 | +| max_precision | 0.5771 | +| max_recall | 0.8686 | +| **max_ap** | **0.7083** |