⚕️ The PubMed Open-Access (OA) subset shares a metadata for 35 Million articles. Suddenly, the existing article parser represents a Hugging Face dataset that was supported up until 2024.  
text
⚕️ The PubMed Open-Access (OA) subset shares a metadata for 35 Million articles. Suddenly, the existing article parser represents a Hugging Face dataset that was supported up until 2024.  
https://huggingface.co/datasets/ncbi/pubmed
ncbi/pubmed
dataset
resource
https://huggingface.co/datasets/ncbi/pubmed
new_line
Moreover, the pubmed data represent a compressed XLM which is beneficial for efficiency but limits processing technique application. 
text
Moreover, the pubmed data represent a compressed XLM which is beneficial for efficiency but limits processing technique application. 
new_line
new_line
📢 To bridge this gap, excited to share pubmed_articles_iter project, which bridges this gap by providing:
text
📢 To bridge this gap, excited to share pubmed_articles_iter project, which bridges this gap by providing:
new_line
☑️ 1. Downloader for the raw files
text
☑️ 1. Downloader for the raw files
new_line
☑️ 2. No-string iterator over pubmed articles, utilized for converting them into JSON. 
text
☑️ 2. No-string iterator over pubmed articles, utilized for converting them into JSON. 
new_line
new_line
👨‍💻 Code: 
text
👨‍💻 Code: 
https://github.com/nicolay-r/pubmed_articles_iter
https://github.com/nicolay-r/pubmed_articles_iter
link
new_line
new_line
⚕️ The PubMed Open-Access (OA) subset shares a metadata for 35 Million articles. Suddenly, the existing article parser represents a Hugging Face dataset that was supported up until 2024.  https://huggingface.co/datasets/ncbi/pubmed
Moreover, the pubmed data represent a compressed XLM which is beneficial for efficiency but limits processing technique application. 

📢 To bridge this gap, excited to share pubmed_articles_iter project, which bridges this gap by providing:
☑️ 1. Downloader for the raw files
☑️ 2. No-string iterator over pubmed articles, utilized for converting them into JSON. 

👨‍💻 Code: https://github.com/nicolay-r/pubmed_articles_iter


👍
John6666 han9