Ever dreamt of ingesting into a vector DB that pile of CSVs, Word documents and presentations laying in some remote folders on your PC?🗂️
text
Ever dreamt of ingesting into a vector DB that pile of CSVs, Word documents and presentations laying in some remote folders on your PC?🗂️
new_line
What if I told you that you can do it within three to six lines of code?🤯
text
What if I told you that you can do it within three to six lines of code?🤯
new_line
Well, with my latest open-source project, 𝐢𝐧𝐠𝐞𝐬𝐭-𝐚𝐧𝐲𝐭𝐡𝐢𝐧𝐠 (
text
Well, with my latest open-source project, 𝐢𝐧𝐠𝐞𝐬𝐭-𝐚𝐧𝐲𝐭𝐡𝐢𝐧𝐠 (
https://github.com/AstraBert/ingest-anything
https://github.com/AstraBert/ingest-anything
link
), you can take all your non-PDF files, convert them to PDF, extract their text, chunk, embed and load them into a vector database, all in one go!🚀
text
), you can take all your non-PDF files, convert them to PDF, extract their text, chunk, embed and load them into a vector database, all in one go!🚀
new_line
How? It's  pretty simple!
text
How? It's  pretty simple!
new_line
📁 The input files are converted into PDF by PdfItDown (
text
📁 The input files are converted into PDF by PdfItDown (
https://github.com/AstraBert/PdfItDown
https://github.com/AstraBert/PdfItDown
link
)
text
)
new_line
 📑 The PDF text is extracted using LlamaIndex readers
text
 📑 The PDF text is extracted using LlamaIndex readers
new_line
🦛 The text is chunked exploiting Chonkie
text
🦛 The text is chunked exploiting Chonkie
new_line
🧮 The chunks are embedded thanks to Sentence Transformers models
text
🧮 The chunks are embedded thanks to Sentence Transformers models
new_line
🗄️ The embeddings are loaded into a Qdrant vector database
text
🗄️ The embeddings are loaded into a Qdrant vector database
new_line
new_line
And you're done!✅
text
And you're done!✅
new_line
Curious of trying it? Install it by running:
text
Curious of trying it? Install it by running:
new_line
new_line
𝘱𝘪𝘱 𝘪𝘯𝘴𝘵𝘢𝘭𝘭 𝘪𝘯𝘨𝘦𝘴𝘵-𝘢𝘯𝘺𝘵𝘩𝘪𝘯𝘨
text
𝘱𝘪𝘱 𝘪𝘯𝘴𝘵𝘢𝘭𝘭 𝘪𝘯𝘨𝘦𝘴𝘵-𝘢𝘯𝘺𝘵𝘩𝘪𝘯𝘨
new_line
new_line
And you can start using it in your python scripts!🐍
text
And you can start using it in your python scripts!🐍
new_line
Don't forget to star it on GitHub and let me know if you have any feedback! ➡️ 
text
Don't forget to star it on GitHub and let me know if you have any feedback! ➡️ 
https://github.com/AstraBert/ingest-anything
https://github.com/AstraBert/ingest-anything
link
Ever dreamt of ingesting into a vector DB that pile of CSVs, Word documents and presentations laying in some remote folders on your PC?🗂️
What if I told you that you can do it within three to six lines of code?🤯
Well, with my latest open-source project, 𝐢𝐧𝐠𝐞𝐬𝐭-𝐚𝐧𝐲𝐭𝐡𝐢𝐧𝐠 (https://github.com/AstraBert/ingest-anything), you can take all your non-PDF files, convert them to PDF, extract their text, chunk, embed and load them into a vector database, all in one go!🚀
How? It's  pretty simple!
📁 The input files are converted into PDF by PdfItDown (https://github.com/AstraBert/PdfItDown)
 📑 The PDF text is extracted using LlamaIndex readers
🦛 The text is chunked exploiting Chonkie
🧮 The chunks are embedded thanks to Sentence Transformers models
🗄️ The embeddings are loaded into a Qdrant vector database

And you're done!✅
Curious of trying it? Install it by running:

𝘱𝘪𝘱 𝘪𝘯𝘴𝘵𝘢𝘭𝘭 𝘪𝘯𝘨𝘦𝘴𝘵-𝘢𝘯𝘺𝘵𝘩𝘪𝘯𝘨

And you can start using it in your python scripts!🐍
Don't forget to star it on GitHub and let me know if you have any feedback! ➡️ https://github.com/AstraBert/ingest-anything
🤗
JLouisBiz John6666 Blackkid2025 KingNish
🔥
JLouisBiz nicolay-r GabPar
❤️
anakin87
6758a9850e3fff481964ca6d
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/EolfJfjW25hC4Bt_hCPq8.png
Jean Louis
JLouisBiz
user
65e330e7edc2f7306e252448
https://cdn-avatars.huggingface.co/v1/production/uploads/65e330e7edc2f7306e252448/oYAOGhbPaXDTbEoJoSLMB.jpeg
Clelia Astra Bertelli
as-cle-bert
user