Hugging Face's logo

research-dump
/
bge-base-en-v1.5_wikiquote_masked_outcome_prediction_masked

Text Classification
setfit
Safetensors
sentence-transformers
bert
generated_from_setfit_trainer
Model card Files Community
hsuvaskakoty commited on
Commit
1128880
·
verified ·
1 Parent(s): 7e37863

Push model using huggingface_hub.

Browse files
Files changed (4) hide show
  1. README.md +8 -16
  2. config_setfit.json +2 -2
  3. model.safetensors +1 -1
  4. model_head.pkl +1 -1
README.md CHANGED
@@ -221,11 +221,11 @@ preds = model("###Instruction: Multi-class classification, answer with one of th
221
 
222
  ### Training Hyperparameters
223
  - batch_size: (8, 2)
224
- - num_epochs: (1, 16)
225
  - max_steps: -1
226
  - sampling_strategy: oversampling
227
- - num_iterations: 50
228
- - body_learning_rate: (0.0001, 0.0001)
229
  - head_learning_rate: 5e-05
230
  - loss: CosineSimilarityLoss
231
  - distance_metric: cosine_distance
@@ -241,19 +241,11 @@ preds = model("###Instruction: Multi-class classification, answer with one of th
241
  ### Training Results
242
  | Epoch | Step | Training Loss | Validation Loss |
243
  |:------:|:----:|:-------------:|:---------------:|
244
- | 0.0002 | 1 | 0.1901 | - |
245
- | 0.0826 | 500 | 0.082 | 0.2417 |
246
- | 0.1653 | 1000 | 0.0218 | 0.2966 |
247
- | 0.2479 | 1500 | 0.0155 | 0.1619 |
248
- | 0.3306 | 2000 | 0.0145 | 0.3421 |
249
- | 0.4132 | 2500 | 0.0084 | 0.4203 |
250
- | 0.4959 | 3000 | 0.0027 | 0.3658 |
251
- | 0.5785 | 3500 | 0.0034 | 0.4218 |
252
- | 0.6612 | 4000 | 0.0028 | 0.3360 |
253
- | 0.7438 | 4500 | 0.0008 | 0.3293 |
254
- | 0.8264 | 5000 | 0.0011 | 0.2751 |
255
- | 0.9091 | 5500 | 0.0007 | 0.2849 |
256
- | 0.9917 | 6000 | 0.0008 | 0.2839 |
257
 
258
  ### Framework Versions
259
  - Python: 3.10.12
 
221
 
222
  ### Training Hyperparameters
223
  - batch_size: (8, 2)
224
+ - num_epochs: (2, 2)
225
  - max_steps: -1
226
  - sampling_strategy: oversampling
227
+ - num_iterations: 10
228
+ - body_learning_rate: (1e-05, 1e-05)
229
  - head_learning_rate: 5e-05
230
  - loss: CosineSimilarityLoss
231
  - distance_metric: cosine_distance
 
241
  ### Training Results
242
  | Epoch | Step | Training Loss | Validation Loss |
243
  |:------:|:----:|:-------------:|:---------------:|
244
+ | 0.0008 | 1 | 0.2005 | - |
245
+ | 0.4132 | 500 | 0.118 | 0.1672 |
246
+ | 0.8264 | 1000 | 0.0064 | 0.2326 |
247
+ | 1.2397 | 1500 | 0.0052 | 0.1932 |
248
+ | 1.6529 | 2000 | 0.0037 | 0.2023 |
 
 
 
 
 
 
 
 
249
 
250
  ### Framework Versions
251
  - Python: 3.10.12
config_setfit.json CHANGED
@@ -1,4 +1,4 @@
1
  {
2
- "normalize_embeddings": false,
3
- "labels": null
4
  }
 
1
  {
2
+ "labels": null,
3
+ "normalize_embeddings": false
4
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:75dbdc7a3b0da99bce62989554ba294c185f2a3b0c998d3dc3243f82ff342072
3
  size 437951328
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37fb300a163e3c8fb1b970442982cbaa6d945981abcae7c88859908b6e024180
3
  size 437951328
model_head.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7e706d39dff45caf878fb9e263c84fac281d40065dabd2251e74516bc2ae8b7d
3
  size 31631
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7f466ef67933a911902d497d8c084ab99d511a3b55648ca9cbe48ac1f137913
3
  size 31631