Update on the Newsletter of 🤗 Daily Paper
text
Update on the Newsletter of 🤗 Daily Paper
new_line
new_line
Automatic Korean translation is integrated. In the newspaper, "KO" links appear, and it will bring you to the translated version of full paper. This is done with the following workflow.
text
Automatic Korean translation is integrated. In the newspaper, "KO" links appear, and it will bring you to the translated version of full paper. This is done with the following workflow.
new_line
new_line
1. Grasp the list of arXiv IDs from 🤗 Daily Paper API
text
1. Grasp the list of arXiv IDs from 🤗 Daily Paper API
new_line
2. Distribute a number of sub-list of arXiv IDs to VMs (possibly spot instances since the job ends shortly)
text
2. Distribute a number of sub-list of arXiv IDs to VMs (possibly spot instances since the job ends shortly)
new_line
3. Commit & push the translated paper in HTML to the designated GitHub repository
text
3. Commit & push the translated paper in HTML to the designated GitHub repository
new_line
4. Newsletter will include the links to the HTML of each paper
text
4. Newsletter will include the links to the HTML of each paper
new_line
new_line
Job distribution to a number of VMs are super easily done with [dstack]( 
text
Job distribution to a number of VMs are super easily done with [dstack]( 
https://dstack.ai/
https://dstack.ai/
link
 ), and the translation sub-workflow is done through 1) download PDF of each paper with arxiv-dl package, 2) PDF => text with nougat-ocr package, 3) a custom trained model( 
text
 ), and the translation sub-workflow is done through 1) download PDF of each paper with arxiv-dl package, 2) PDF => text with nougat-ocr package, 3) a custom trained model( 
https://huggingface.co/nlp-with-deeplearning/enko-t5-small-v0
nlp-with-deeplearning/enko-t5-small-v0
model
resource
https://huggingface.co/nlp-with-deeplearning/enko-t5-small-v0
 ) in 🤗 transformers to translate the English text into Korean line by line, and 4) reformat the translation into HTML.
text
 ) in 🤗 transformers to translate the English text into Korean line by line, and 4) reformat the translation into HTML.
new_line
new_line
Many people in Korea are not fluent in English but want to learn about new stuff in AI, so they usually use Google Translate or other services. This is why I made this feature for easier and direct access to the SOTA knowledge. 
text
Many people in Korea are not fluent in English but want to learn about new stuff in AI, so they usually use Google Translate or other services. This is why I made this feature for easier and direct access to the SOTA knowledge. 
new_line
new_line
Are there other countries with the similar needs? If so, it would be wonderful to cooperate to support more languages. Please reach out anyone is interested in this.
text
Are there other countries with the similar needs? If so, it would be wonderful to cooperate to support more languages. Please reach out anyone is interested in this.
new_line
new_line
PS; I always wanted to show the usefulness of open ML models by building a well working end to end product, and this newsletter shows it by featuring T5ForConditionalGeneration (translation), SOLAR LLM (summarization). 
text
PS; I always wanted to show the usefulness of open ML models by building a well working end to end product, and this newsletter shows it by featuring T5ForConditionalGeneration (translation), SOLAR LLM (summarization). 
new_line
new_line
if you want to sub to the newsletter
text
if you want to sub to the newsletter
new_line
: 
text
: 
https://groups.google.com/g/hf-daily-paper-newsletter
https://groups.google.com/g/hf-daily-paper-newsletter
link
new_line
new_line
if you want to look into the source codes
text
if you want to look into the source codes
new_line
: 
text
: 
https://github.com/deep-diver/hf-daily-paper-newsletter
https://github.com/deep-diver/hf-daily-paper-newsletter
link
Update on the Newsletter of 🤗 Daily Paper

Automatic Korean translation is integrated. In the newspaper, "KO" links appear, and it will bring you to the translated version of full paper. This is done with the following workflow.

1. Grasp the list of arXiv IDs from 🤗 Daily Paper API
2. Distribute a number of sub-list of arXiv IDs to VMs (possibly spot instances since the job ends shortly)
3. Commit & push the translated paper in HTML to the designated GitHub repository
4. Newsletter will include the links to the HTML of each paper

Job distribution to a number of VMs are super easily done with [dstack]( https://dstack.ai/ ), and the translation sub-workflow is done through 1) download PDF of each paper with arxiv-dl package, 2) PDF => text with nougat-ocr package, 3) a custom trained model( https://huggingface.co/nlp-with-deeplearning/enko-t5-small-v0 ) in 🤗 transformers to translate the English text into Korean line by line, and 4) reformat the translation into HTML.

Many people in Korea are not fluent in English but want to learn about new stuff in AI, so they usually use Google Translate or other services. This is why I made this feature for easier and direct access to the SOTA knowledge. 

Are there other countries with the similar needs? If so, it would be wonderful to cooperate to support more languages. Please reach out anyone is interested in this.

PS; I always wanted to show the usefulness of open ML models by building a well working end to end product, and this newsletter shows it by featuring T5ForConditionalGeneration (translation), SOLAR LLM (summarization). 

if you want to sub to the newsletter
: https://groups.google.com/g/hf-daily-paper-newsletter

if you want to look into the source codes
: https://github.com/deep-diver/hf-daily-paper-newsletter
❤️
s3nh peterschmidt85 aidystark afrideva clem victor samusenps maywell adamm-hf julien-c shrijayan ysharma dillfrescott JUNGU
👍
chansung Siva1306 adamm-hf dillfrescott
61caeda441f9432649f03ab6
https://cdn-avatars.huggingface.co/v1/production/uploads/61caeda441f9432649f03ab6/IazJBCi7Cr34DgZXZeI4k.jpeg
s3nh
s3nh
user
6538119803519fddb4a17e10
https://cdn-avatars.huggingface.co/v1/production/uploads/6538119803519fddb4a17e10/ffJMkdx-rM7VvLTCM6ri_.jpeg
samusenps
samusenps
user
60d3b57ad7b174177faabd6e
https://cdn-avatars.huggingface.co/v1/production/uploads/1659971187637-60d3b57ad7b174177faabd6e.jpeg
chansung park
chansung
user