Spaces:

HF-test-lab
/

bulk_embeddings

Runtime error

nbroad HF staff commited on Jul 14, 2023

Commit

c1fd1fe

1 Parent(s): 41912a4

reset texts

Files changed (1) hide show

utils.py CHANGED Viewed

@@ -339,6 +339,7 @@ def batch_embed(
         if len(embeds) > upload_batch_size:
             push_to_repo(repo, last_count, current_count, embeds, texts)
             embeds = []
             last_count = current_count
         # Provide updates

         if len(embeds) > upload_batch_size:
             push_to_repo(repo, last_count, current_count, embeds, texts)
             embeds = []
+            texts = []
             last_count = current_count
         # Provide updates