article_writer / google_search.py

Commit History

add semantic scholar
b51be98

minko186 commited on

initial commit
9a9aac4

minko186 commited on

chore: increase of numbers to scrape; disabled PDF check in scholar model
a6fbfb6

eljanmahammadli commited on

added pagintion to google search, now retrieving more sites
5650543

eljanmahammadli commited on

#feat added simplest scholar mode
fa3e7dd

eljanmahammadli commited on

#perf: quality improvements to website scrape + PDF detect logic
d904dd4

eljanmahammadli commited on

#fix added headers that bypasses response code 418
bf1e0a0

eljanmahammadli commited on

#bugfix response 301 is solved, as we should explicitly set follow_redirects for httpx
6f4a113

eljanmahammadli commited on

remove content_string (not used) + clean unicode non-printable chars + add pymupdf reading for pdf urls
a62cc34

minko186 commited on

enable ai model selection and api key
bf91121

eljanmahammadli commited on

changed split logic to resolve short generated text, more search website and some logging
59fbf6a

eljanmahammadli commited on

format updates + search added to RAG instead
708f094

minko186 commited on