metadata
language:
- en
license: apache-2.0
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:5086
- loss:MultipleNegativesRankingLoss
base_model: BAAI/bge-base-en-v1.5
widget:
- source_sentence: >
3.1. This Agreement shall be in force for 24 months after the Effective
Date, unless terminated in
advance by either Party with thirty (30) days’ written notice. However,
the obligation of confi-
dentiality and non-use shall survive the termination or expiration of this
Agreement for five (5)
years, with exception of trade secrets, which shall be confidential for an
unlimited period of
time.
.
4. Return and Destruction of Confidential Information
4.1. Recipient shall at the written request of Discloser promptly return
or destroy all the Confidential
Information and copies (save for one copy for record purposes and securely
stored Confidential
.
Information that is created during automatic system back-up) to Discloser
and immediately cease
using the same. Recipient shall provide a written certification to
Discloser regarding such
destruction of Confidential Information.
.
5. Warranties
5.1. Each Party warrants that it has the right to make the disclosures
under this Agreement.
.
5.2. Each Party acknowledges that Confidential Information is provided “as
is” and without any rep-
resentation or warranty, express or implied, as to the accuracy or
completeness of Confidential
Information, including, without limitation, any implied warranty of
merchantability or fitness
.
.
.
.
.
Non-Disclosure Agreement EN_V2.0_gen (002) Page 2 of 4 vo2Datum:
21.09.2021
.
Autor: BELI
Bereich: Legal &
Compliance
.
.
.
7.2.
.
7.3.
.
74.
.
7.5.
.
76.
.
7.7.
for a particular purpose, or any warranty that the use of Confidential
Information will not in-
fringe or violate any patent or other proprietary rights of any third
party.
.
Rights and Licences
The terms and conditions herein constitute the entire agreement and
understanding of the Par-
ties and shall supersede all communications, negotiations, arrangements
and agreements, ei-
ther oral or written, with respect to the subject matter hereof. No
amendments to or modifica-
tions of this Agreement shall be effective unless reduced to writing and
executed by the Parties
hereto.
.
The failure of either Party to enforce any term hereof shall not be deemed
a waiver of any rights
contained herein.
.
This Agreement shall not be assignable by either Party without the prior
written consent of the
other Party, except to Affiliates or in connection with a sale of the
business or substantially all
of the assets of the business to which the Confidential Information
relates.
sentences:
- Absolute Maximum Amount of Liability
- Governing Law
- Termination for Convenience
- source_sentence: >-
MANAGED SERVICE PROVIDER AGREEMENT
This Managed Service Provider Agreement (“Agreement”) is effective as of
the 20th day of
November, 2007 (“Effective Date”) by and between The Toronto-Dominion
Bank, a Canadian
chartered Bank (“TD”), and Flextrack Inc. (“Flextrack”), with its office
at 2323 Yonge St., Suite
600, Toronto, Ontario, M4P 2C9.
77 King St. W., 24" Floor Suite 600 - 2323 Yonge Street Toronto, Ontario
Toronto, Ontario MSK 1A2 M4P 2C9 Attention: Matthew Giliberto Attention:
Peter Carr Email: [email protected] Alternative: | Cynthia Many PC18.5
18.6 18.7 18.8 18.9 18.10 18.11 18.12 Email: [email protected] with a
mandatory copy to: TD Legal Department 66 Wellington Street West, 12th
Floor TD Tower Toronto, Ontario MSK 1A2 Assignment.
sentences:
- Counterparty Name
- Term of Agreement
- Subcontracting
- source_sentence: >-
It is expressly agreed between the parties that if no settlement can be
found between them within a reasonable period of time, and in any case no
later than 2 (two) months following the receipt by one party of the
written claim of the other party, any disputes must be settled by the ICC
(International Chamber of Commerce) Arbitration in Paris, France in
accordance with the Rules of the Court of Arbitration. The number of
arbitrators shall be three. The language of arbitration shall be English.
(f) This Agreement is binding upon and for the benefit of the undersigned
parties, their successors and assigns. This Agreement may not be assigned
by a party without the prior written aoe se t of the other party. Oo he oY
SQN 6 w \CONFIDENTIAL (g) This Agreement may be made in separate
counterparts, each of which is deemed to be an original and together one
and the same agreement. Facsimile signatures are accepted as originals.
The present Agreement and the possible amendments concluded using
facsimile have legal force and the further exchange of the original
documents with signatures by both parties must be provided by a post
courier or registered post service no later than 30 (thirty) days from the
date the present Agreement is made. (h) If any provisions of this
Agreement are held by a court of competent jurisdiction to be illegal,
invalid or unenforceable, the remaining provisions remain in full force
and effect..
9. Addresses for service of legal documents
9.1 The parties choose the following physical addresses at which documents
in legal
proceedings in connection with this agreement may be served (i.e. their
domicilia
citandi et executandi) at:
.
9.1.1 Avacare Global
.
3rd Floor, Super U Complex,Couer de ville,
La Salette Road,Grand Baie-30551, Mauritius
Email: [email protected]
.
Phn No.: +27 83 444 2911
.
9.1.2 . Joint stock company “Grindeks
53 Krustpils Street, Riga, LV-1057, Latvia
Email:
.
Phn No.
.
9.2 Any notice or communication required or permitted to be given in terms
of this
Agreement shall be valid and effective only if in writing but it shall be
competent to
give notice by , email or registered mail.
.
9.3 Any notice to a Party:
.
9.3.1 Sent by prepaid registered post (by airmail if appropriate) in a
correctly
addressed envelope to it at its domicilium citandi et executandi shall be
deemed
to have been received on the seventh business day after posting (unless
the
contrary is proved);
.
9.3.2 Delivered by hand to a responsible person during ordinary business
hours at its
domicilium citandi et executandi shall be deemed to have been received on
the
day of delivery; or
.
9.3.3 Sent by email to its chosen email address shall be deemed to have
been received
irst business day following despatch on condition that a successful
wv tran report is produced (unless the contrary is proved).
“8 \
>
.
4
oft~ CONFIDENTIAL
8. Miscellaneous. (a) It is understood and agreed between the parties that
no failure or delay by a party in exercising any right, power or privilege
hereunder operates as a waiver thereof, nor any single or partial exercise
thereof precludes any other or further exercise thereof or the exercise of
any other right, power or privilege hereunder. (b) This Agreement
constitutes the entire agreement between the parties with respect to the
subject matter hereof, and it is expressly agreed that any and all prior
understandings or agreements between the parties relating to the subject
matter of this Agreement, whether oral or written, are automatically
cancelled by the signing of this Agreement. The terms and conditions set
forth herein may be modified only in a subsequent writing signed by all
parties. (c) The parties acknowledge that monetary damages may not be a
sufficient remedy for unauthorized disclosure of Confidential Information
and that the disclosing party may be entitled, without waiving any other
rights or remedies, to such injunctive or equitable relief as may be
deemed proper by a court of competent jurisdiction. (d) This Agreement is
interpreted and enforced in accordance with the laws of France. (e) In
case of disputes between the parties arising from the enforcement and/or
the interpretation of the Agreement, the parties must try to settle
amicably and rapidly such dispute.
sentences:
- Severability
- Title of Agreement
- Publicity
- source_sentence: >
6.1. Recipient acknowledges that Discloser is and will remain the
exclusive owner of Discloser’s Confidential
Information and all patent, copyright, trademark and other intellectual
property rights in such
Confidential Information. Except for the right to use Discloser’s
Confidential Information for the
Purpose, no other right or license is granted to Recipient by this
Agreement and the disclosure of
Confidential Information does not result in any obligation by Discloser to
grant Recipient any right in
or to such Confidential Information.
.
.
.
Non-Disclosure Agreement Site 2-3Date: 02.04.2020
.
Author: BELI
Department: Legal &
.
Compliance
.
7. Miscellaneous
.
7.1, This Agreement shall be governed by, and construed and enforced in
accordance with the laws of
Switzerland, excluding its conflict of law rules and the Parties consent
to the exclusive jurisdiction of
Switzerland only, with the competent courts of the city of St. Gallen,
Switzerland.
7.6. If one or more provisions of this Agreement are or become invalid, in
whole or in part, this shall not
affect the remaining provisions of this Agreement and each remaining term
of this Agreement shall
be valid and enforced to the full extent permitted by law. The Parties
shall negotiate in a faithful
manner on a ruling to be used instead of the invalid provision and which,
as closely as possible,
reflects the economic intentions of the Parties concluding this Agreement.
sentences:
- Severability
- Governing Law
- Severability
- source_sentence: >
Telstra International HK Limited Waiver of rights 15.8 A condition of this
Agreement, or a right created by it, may only be waived by a party by
giving notice and the failure to exercise or any delay In exercising a
right or remedy provided by this Agreement or by law does not constitute a
waiver of the right or remedy. 15.9 A waiver of a breach of this Agreement
does not waive any other breach. Warranties 15.10 Each party warrants to
the other that entering into and performing its obligations under this
Agreement does not breach any of its contractual obligations to any other
person. 15.11 You warrant that you have not relied on any representations
or warranties by us other than those expressly provided in this Agreement.
Assignment 15.12 Neither party may assign its rights or novate any rights
or obligations under this Agreement without the prior consent of the
other, which will not be unreasonably withheld. Agency 15.13 You may
appoint a third party to act on your behalf in relation to this Agreement
only if and for so long as we consent to you doing so. We may impose
conditions on the giving of our consent and may withdraw our consent at
any time. 15.14 If we consent to you appointing a third party to act on
your behalf in relation to this Agreement, you agree to indemnify us
against all direct and indirect loss, damage, liability, costs or expenses
incurred by us (including to a fourth party) resulting from the
appointment of the third party to act on your behalf including, but not
limited to, any intentional or negligent act or omission by the third
party, whether within or outside the scope of that appointment, such as a
misuse of our confidential information.
15.15 Nothing in clauses 1 5 . 1 3 and 1 5 . 1 4 is intended to waive any
rights or obligations of us or you under this Agreement or to create any
rights or impose any obligations on the third party appointed to act on
your behalf under this Agreement. You remain liable for all of your
obligations under this Agreement, including the payment of all charges for
Services, and acknowledge that we may deal with you or with the third
party (or both) in relation to matters arising under this Agreement. Force
majeure 15.16 Neither party is liable for not performing an obligation in
whole or in part, or for not performing it on time (except an obligation
to pay money), because of a Force Majeure Event. 15.17 If a Force Majeure
Event occurs, that party must: (a) give the other party notice of the
event promptly and an estimate of the non-performance and delay; (b) take
all reasonable steps to overcome the effects of the event (but this does
not require the settlement of industrial disputes or other claims on
unreasonable terms); and (c) resume compliance as soon as practicable
after the event no longer affects that party. Compliance with laws 15.18
In carrying out its obligations under this Agreement, each party must
comply with any relevant statutes, regulations and by-laws which apply in
Hong Kong and the requirements of any government body with authority in
Hong Kong. Third party rights 15.19 A person who is not a party to this
Agreement has no rights under any applicable legislation to enforce any
term or condition in this Agreement..
Telstra International HK Limited
.
I
16 Definitions
.
In this Agreement, unless otherwise indicated:
.
Act - means the Telecommunications Act 1997 (Cth).
.
Availability· means the number of minutes in a month during which a Global Service is not
.
Unavailable.
.
Business Day - means any day other than a Saturday, Sunday or recognised public holiday in Hong
.
Kong.
sentences:
- Assignment
- Auto Renewal Cancellation Notice Period
- Counterparty Name
pipeline_tag: sentence-similarity
library_name: sentence-transformers
metrics:
- cosine_accuracy@1
- cosine_accuracy@3
- cosine_accuracy@5
- cosine_accuracy@10
- cosine_precision@1
- cosine_precision@3
- cosine_precision@5
- cosine_precision@10
- cosine_recall@1
- cosine_recall@3
- cosine_recall@5
- cosine_recall@10
- cosine_ndcg@10
- cosine_mrr@10
- cosine_map@100
model-index:
- name: BGE base En v1.5 Phase 4
results:
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: dim 768
type: dim_768
metrics:
- type: cosine_accuracy@1
value: 0.006329113924050633
name: Cosine Accuracy@1
- type: cosine_accuracy@3
value: 0.022151898734177215
name: Cosine Accuracy@3
- type: cosine_accuracy@5
value: 0.03375527426160337
name: Cosine Accuracy@5
- type: cosine_accuracy@10
value: 0.06223628691983123
name: Cosine Accuracy@10
- type: cosine_precision@1
value: 0.006329113924050633
name: Cosine Precision@1
- type: cosine_precision@3
value: 0.007383966244725738
name: Cosine Precision@3
- type: cosine_precision@5
value: 0.006751054852320675
name: Cosine Precision@5
- type: cosine_precision@10
value: 0.006223628691983123
name: Cosine Precision@10
- type: cosine_recall@1
value: 0.006329113924050633
name: Cosine Recall@1
- type: cosine_recall@3
value: 0.022151898734177215
name: Cosine Recall@3
- type: cosine_recall@5
value: 0.03375527426160337
name: Cosine Recall@5
- type: cosine_recall@10
value: 0.06223628691983123
name: Cosine Recall@10
- type: cosine_ndcg@10
value: 0.028897981166450825
name: Cosine Ndcg@10
- type: cosine_mrr@10
value: 0.01894380818431451
name: Cosine Mrr@10
- type: cosine_map@100
value: 0.032665118839148154
name: Cosine Map@100
BGE base En v1.5 Phase 4
This is a sentence-transformers model finetuned from BAAI/bge-base-en-v1.5. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
Model Details
Model Description
- Model Type: Sentence Transformer
- Base model: BAAI/bge-base-en-v1.5
- Maximum Sequence Length: 512 tokens
- Output Dimensionality: 768 dimensions
- Similarity Function: Cosine Similarity
- Language: en
- License: apache-2.0
Model Sources
- Documentation: Sentence Transformers Documentation
- Repository: Sentence Transformers on GitHub
- Hugging Face: Sentence Transformers on Hugging Face
Full Model Architecture
SentenceTransformer(
(0): Transformer({'max_seq_length': 512, 'do_lower_case': True}) with Transformer model: BertModel
(1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Normalize()
)
Usage
Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
pip install -U sentence-transformers
Then you can load this model and run inference.
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("RishuD7/bge-base-en-v1.5-41-keys-phase-4-exp_v1")
# Run inference
sentences = [
'Telstra International HK Limited Waiver of rights 15.8 A condition of this Agreement, or a right created by it, may only be waived by a party by giving notice and the failure to exercise or any delay In exercising a right or remedy provided by this Agreement or by law does not constitute a waiver of the right or remedy. 15.9 A waiver of a breach of this Agreement does not waive any other breach. Warranties 15.10 Each party warrants to the other that entering into and performing its obligations under this Agreement does not breach any of its contractual obligations to any other person. 15.11 You warrant that you have not relied on any representations or warranties by us other than those expressly provided in this Agreement. Assignment 15.12 Neither party may assign its rights or novate any rights or obligations under this Agreement without the prior consent of the other, which will not be unreasonably withheld. Agency 15.13 You may appoint a third party to act on your behalf in relation to this Agreement only if and for so long as we consent to you doing so. We may impose conditions on the giving of our consent and may withdraw our consent at any time. 15.14 If we consent to you appointing a third party to act on your behalf in relation to this Agreement, you agree to indemnify us against all direct and indirect loss, damage, liability, costs or expenses incurred by us (including to a fourth party) resulting from the appointment of the third party to act on your behalf including, but not limited to, any intentional or negligent act or omission by the third party, whether within or outside the scope of that appointment, such as a misuse of our confidential information.\n15.15 Nothing in clauses 1 5 . 1 3 and 1 5 . 1 4 is intended to waive any rights or obligations of us or you under this Agreement or to create any rights or impose any obligations on the third party appointed to act on your behalf under this Agreement. You remain liable for all of your obligations under this Agreement, including the payment of all charges for Services, and acknowledge that we may deal with you or with the third party (or both) in relation to matters arising under this Agreement. Force majeure 15.16 Neither party is liable for not performing an obligation in whole or in part, or for not performing it on time (except an obligation to pay money), because of a Force Majeure Event. 15.17 If a Force Majeure Event occurs, that party must: (a) give the other party notice of the event promptly and an estimate of the non-performance and delay; (b) take all reasonable steps to overcome the effects of the event (but this does not require the settlement of industrial disputes or other claims on unreasonable terms); and (c) resume compliance as soon as practicable after the event no longer affects that party. Compliance with laws 15.18 In carrying out its obligations under this Agreement, each party must comply with any relevant statutes, regulations and by-laws which apply in Hong Kong and the requirements of any government body with authority in Hong Kong. Third party rights 15.19 A person who is not a party to this Agreement has no rights under any applicable legislation to enforce any term or condition in this Agreement..\n Telstra International HK Limited\n.\n I\n16 Definitions\n.\n In this Agreement, unless otherwise indicated:\n.\n Act - means the Telecommunications Act 1997 (Cth).\n.\n Availability· means the number of minutes in a month during which a Global Service is not\n.\n Unavailable.\n.\n Business Day - means any day other than a Saturday, Sunday or recognised public holiday in Hong\n.\n Kong.\n',
'Assignment',
'Counterparty Name',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
Evaluation
Metrics
Information Retrieval
- Dataset:
dim_768 - Evaluated with
InformationRetrievalEvaluator
| Metric | Value |
|---|---|
| cosine_accuracy@1 | 0.0063 |
| cosine_accuracy@3 | 0.0222 |
| cosine_accuracy@5 | 0.0338 |
| cosine_accuracy@10 | 0.0622 |
| cosine_precision@1 | 0.0063 |
| cosine_precision@3 | 0.0074 |
| cosine_precision@5 | 0.0068 |
| cosine_precision@10 | 0.0062 |
| cosine_recall@1 | 0.0063 |
| cosine_recall@3 | 0.0222 |
| cosine_recall@5 | 0.0338 |
| cosine_recall@10 | 0.0622 |
| cosine_ndcg@10 | 0.0289 |
| cosine_mrr@10 | 0.0189 |
| cosine_map@100 | 0.0327 |
Training Details
Training Dataset
Unnamed Dataset
- Size: 5,086 training samples
- Columns:
positiveandanchor - Approximate statistics based on the first 1000 samples:
positive anchor type string string details - min: 123 tokens
- mean: 352.74 tokens
- max: 512 tokens
- min: 3 tokens
- mean: 5.52 tokens
- max: 11 tokens
- Samples:
positive anchor In no event shall CBRE, Client, or their respective affiliates incur liability under this agreement or otherwise relating to the Services beyond the insurance proceeds available with respect to the particular matter under the Insurance Policies required to be carried by CBRE AND Client under Article 6 above including, if applicable, proceeds of self-insurance. Each party shall and shall cause its affiliates to look solely to such insurance proceeds (and any such proceeds paid through self-insurance) to satisfy its claims against the released parties and agrees that it shall have no right of recovery beyond such proceeds; provided, however, that if insurance proceeds under such policies are not paid because a party has failed to maintain such policies, comply with policy requirements or, in the case of self-insurance, unreasonably denied a claim, such party shall be liable for the amounts that otherwise would have been payable under such policies had such party maintained such policies,...Absolute Maximum Amount of Liability4. Rent.
4.01 From and after the Commencement Date, Tenant shall pay Landlord, without any
setoff or deduction, unless expressly set forth in this Lease, all Base Rent and Additional Rent
due for the Term (collectively referred to as "Rent"). "Additional Rent" means all sums
(exclusive of Base Rent) that Tenant is required to pay Landlord under this Lease. Tenant shall
pay and be liable for all rental, sales and use taxes (but excluding income taxes), if any,
imposed upon or measured by Rent. Base Rent and recurring monthly charges of Additional
Rent shall be due and payable in advance on the first day of each calendar month without
notice or demand, provided that the installment of Base Rent attributable to the first (1st) full
calendar month of the Term following the Abatement Period shall be due concurrently with the
execution of this Lease by Tenant. All other items of Rent shall be due and payable on or
before thirty (30) days after billing by Landlord. Rent shall be made payable...Late Payment ChargesTerm This Agreement shall come into force and shall last unlimited from such date. Either Party may however terminate this Agreement at any time by giving upon thirty (30) days' written notice to the other Party. The Receiving Party's obligations contained in this Agreement to keep confidential and restrict use of the Disclosing Party's Confidential Information shall sur- vive for a period of five (5) years from the date of its termination for any reason whatsoever. lX. Contractual penalty
For the purposes of this Non-Disclosure Agreement, " Confidential Information" includes all technical and/or commercial and/or financial information in the field designated in section 1., which a contracting Party (hereinafter referred to as the "EQ€i1gPedy") makes, or has made, accessible to the other contracting Party (hereinafter referred to as the ".&eiyi!g Partv") in oral, written, tangible or other form (e.9. disk, data carrier) directly or indirectly, in- cluding but not limited to, drawings, ...Termination for Convenience - Loss:
MultipleNegativesRankingLosswith these parameters:{ "scale": 20.0, "similarity_fct": "cos_sim" }
Training Hyperparameters
Non-Default Hyperparameters
eval_strategy: epochper_device_train_batch_size: 32per_device_eval_batch_size: 16gradient_accumulation_steps: 16learning_rate: 2e-05num_train_epochs: 30lr_scheduler_type: cosinewarmup_ratio: 0.1tf32: Falseload_best_model_at_end: Trueoptim: adamw_torch_fusedbatch_sampler: no_duplicates
All Hyperparameters
Click to expand
overwrite_output_dir: Falsedo_predict: Falseeval_strategy: epochprediction_loss_only: Trueper_device_train_batch_size: 32per_device_eval_batch_size: 16per_gpu_train_batch_size: Noneper_gpu_eval_batch_size: Nonegradient_accumulation_steps: 16eval_accumulation_steps: Nonelearning_rate: 2e-05weight_decay: 0.0adam_beta1: 0.9adam_beta2: 0.999adam_epsilon: 1e-08max_grad_norm: 1.0num_train_epochs: 30max_steps: -1lr_scheduler_type: cosinelr_scheduler_kwargs: {}warmup_ratio: 0.1warmup_steps: 0log_level: passivelog_level_replica: warninglog_on_each_node: Truelogging_nan_inf_filter: Truesave_safetensors: Truesave_on_each_node: Falsesave_only_model: Falserestore_callback_states_from_checkpoint: Falseno_cuda: Falseuse_cpu: Falseuse_mps_device: Falseseed: 42data_seed: Nonejit_mode_eval: Falseuse_ipex: Falsebf16: Falsefp16: Falsefp16_opt_level: O1half_precision_backend: autobf16_full_eval: Falsefp16_full_eval: Falsetf32: Falselocal_rank: 0ddp_backend: Nonetpu_num_cores: Nonetpu_metrics_debug: Falsedebug: []dataloader_drop_last: Falsedataloader_num_workers: 0dataloader_prefetch_factor: Nonepast_index: -1disable_tqdm: Falseremove_unused_columns: Truelabel_names: Noneload_best_model_at_end: Trueignore_data_skip: Falsefsdp: []fsdp_min_num_params: 0fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}fsdp_transformer_layer_cls_to_wrap: Noneaccelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}deepspeed: Nonelabel_smoothing_factor: 0.0optim: adamw_torch_fusedoptim_args: Noneadafactor: Falsegroup_by_length: Falselength_column_name: lengthddp_find_unused_parameters: Noneddp_bucket_cap_mb: Noneddp_broadcast_buffers: Falsedataloader_pin_memory: Truedataloader_persistent_workers: Falseskip_memory_metrics: Trueuse_legacy_prediction_loop: Falsepush_to_hub: Falseresume_from_checkpoint: Nonehub_model_id: Nonehub_strategy: every_savehub_private_repo: Falsehub_always_push: Falsegradient_checkpointing: Falsegradient_checkpointing_kwargs: Noneinclude_inputs_for_metrics: Falseeval_do_concat_batches: Truefp16_backend: autopush_to_hub_model_id: Nonepush_to_hub_organization: Nonemp_parameters:auto_find_batch_size: Falsefull_determinism: Falsetorchdynamo: Noneray_scope: lastddp_timeout: 1800torch_compile: Falsetorch_compile_backend: Nonetorch_compile_mode: Nonedispatch_batches: Nonesplit_batches: Noneinclude_tokens_per_second: Falseinclude_num_input_tokens_seen: Falseneftune_noise_alpha: Noneoptim_target_modules: Nonebatch_eval_metrics: Falseprompts: Nonebatch_sampler: no_duplicatesmulti_dataset_batch_sampler: proportional
Training Logs
| Epoch | Step | Training Loss | dim_768_cosine_ndcg@10 |
|---|---|---|---|
| 1.0063 | 10 | 2.1725 | - |
| 2.0126 | 20 | 0.3731 | - |
| 3.0189 | 30 | 0.0406 | - |
| 4.0252 | 40 | 0.0 | - |
| 4.8302 | 48 | - | 0.0230 |
| 1.0063 | 10 | 1.6101 | - |
| 2.0126 | 20 | 0.055 | - |
| 3.0189 | 30 | 0.0016 | - |
| 4.0252 | 40 | 0.0 | - |
| 4.8302 | 48 | - | 0.0242 |
| 1.1761 | 50 | 0.2904 | - |
| 2.1824 | 60 | 0.8168 | - |
| 3.1887 | 70 | 0.0161 | - |
| 4.1950 | 80 | 0.004 | - |
| 5.2013 | 90 | 0.0 | - |
| 5.8050 | 96 | - | 0.0280 |
| 2.3522 | 100 | 0.4037 | - |
| 3.3585 | 110 | 0.3704 | - |
| 4.3648 | 120 | 0.0017 | - |
| 5.3711 | 130 | 0.0003 | - |
| 6.3774 | 140 | 0.0 | - |
| 6.7799 | 144 | - | 0.0293 |
| 3.5283 | 150 | 0.4189 | - |
| 4.5346 | 160 | 0.1746 | - |
| 5.5409 | 170 | 0.0004 | - |
| 6.5472 | 180 | 0.0 | - |
| 7.5535 | 190 | 0.0 | - |
| 7.8553 | 193 | - | 0.0278 |
| 4.7044 | 200 | 0.421 | - |
| 5.7107 | 210 | 0.0661 | - |
| 6.7170 | 220 | 0.0001 | - |
| 7.7233 | 230 | 0.0 | - |
| 8.7296 | 240 | 0.0 | - |
| 8.8302 | 241 | - | 0.0287 |
| 5.8805 | 250 | 0.41 | - |
| 6.8868 | 260 | 0.0111 | - |
| 7.8931 | 270 | 0.0001 | 0.0289 |
- The bold row denotes the saved checkpoint.
Framework Versions
- Python: 3.10.12
- Sentence Transformers: 3.3.0
- Transformers: 4.41.2
- PyTorch: 2.1.2+cu121
- Accelerate: 1.1.1
- Datasets: 2.19.1
- Tokenizers: 0.19.1
Citation
BibTeX
Sentence Transformers
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
MultipleNegativesRankingLoss
@misc{henderson2017efficient,
title={Efficient Natural Language Response Suggestion for Smart Reply},
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
year={2017},
eprint={1705.00652},
archivePrefix={arXiv},
primaryClass={cs.CL}
}