Shobhank-iiitdwd
commited on
Commit
路
6b1f37a
1
Parent(s):
8939d80
Update README.md
Browse files
README.md
CHANGED
@@ -39,7 +39,7 @@ model-index:
|
|
39 |
**Published**: Dec 8th, 2021
|
40 |
|
41 |
## Details
|
42 |
-
- haystack's intermediate layer and prediction layer distillation features were used for training
|
43 |
|
44 |
## Hyperparameters
|
45 |
### Intermediate layer distillation
|
|
|
39 |
**Published**: Dec 8th, 2021
|
40 |
|
41 |
## Details
|
42 |
+
- haystack's intermediate layer and prediction layer distillation features were used for training. bert-base-uncased-squad2 was used as the teacher model and DBERT_General_6L_768D was used as the student model.
|
43 |
|
44 |
## Hyperparameters
|
45 |
### Intermediate layer distillation
|