Very cool dataset for journalists and historians just dropped: 2.7 million unique public domain U.S. news wire articles (1878-1977) 📰🕰️
text
Very cool dataset for journalists and historians just dropped: 2.7 million unique public domain U.S. news wire articles (1878-1977) 📰🕰️
new_line
new_line
This is a goldmine for tracking historical events & newspaper coverage trends! An example? If we still wonder whether gender diversity in the media is important... "Only 4.6% of disambiguated entity mentions refer to women, and the most mentioned woman is Golda Meir."
text
This is a goldmine for tracking historical events & newspaper coverage trends! An example? If we still wonder whether gender diversity in the media is important... "Only 4.6% of disambiguated entity mentions refer to women, and the most mentioned woman is Golda Meir."
new_line
new_line
Bonus:
text
Bonus:
new_line
- Locations in these articles are georeferenced
text
- Locations in these articles are georeferenced
new_line
- Topics are tagged using customized neural topic classification
text
- Topics are tagged using customized neural topic classification
new_line
- Named entities are recognized,
text
- Named entities are recognized,
new_line
- Individuals are disambiguated to Wikipedia using a novel entity disambiguation model 
text
- Individuals are disambiguated to Wikipedia using a novel entity disambiguation model 
new_line
new_line
Anyone thinking of cool AI projects with this data? Maybe tracking the spread of news stories over time & space?
text
Anyone thinking of cool AI projects with this data? Maybe tracking the spread of news stories over time & space?
new_line
new_line
𝐆𝐨 𝐝𝐞𝐞𝐩𝐞𝐫
text
𝐆𝐨 𝐝𝐞𝐞𝐩𝐞𝐫
new_line
👉 Digg into the dataset: 
text
👉 Digg into the dataset: 
https://huggingface.co/datasets/dell-research-harvard/newswire
dell-research-harvard/newswire
dataset
resource
https://huggingface.co/datasets/dell-research-harvard/newswire
new_line
 👉 Read the paper: 
text
 👉 Read the paper: 
Newswire: A Large-Scale Structured Database of a Century of Historical
  News (2406.09490)
https://huggingface.co/papers/2406.09490
2406.09490
paper
resource
https://huggingface.co/papers/2406.09490
Very cool dataset for journalists and historians just dropped: 2.7 million unique public domain U.S. news wire articles (1878-1977) 📰🕰️

This is a goldmine for tracking historical events & newspaper coverage trends! An example? If we still wonder whether gender diversity in the media is important... "Only 4.6% of disambiguated entity mentions refer to women, and the most mentioned woman is Golda Meir."

Bonus:
- Locations in these articles are georeferenced
- Topics are tagged using customized neural topic classification
- Named entities are recognized,
- Individuals are disambiguated to Wikipedia using a novel entity disambiguation model 

Anyone thinking of cool AI projects with this data? Maybe tracking the spread of news stories over time & space?

𝐆𝐨 𝐝𝐞𝐞𝐩𝐞𝐫
👉 Digg into the dataset: https://huggingface.co/datasets/dell-research-harvard/newswire
 👉 Read the paper: https://huggingface.co/papers/2406.09490
🤝
ZeroWw prithivMLmods Dihelson
🚀
louisbrulenaudet Dihelson