Introducing the japanese-text-difficulty dataset! 🎉
text
Introducing the japanese-text-difficulty dataset! 🎉
new_line
new_line
This dataset gathered texts from Aozora Bunko and marked them with jReadability scores, plus detailed metrics on kanji density, vocabulary, grammar, and sentence structure. 
text
This dataset gathered texts from Aozora Bunko and marked them with jReadability scores, plus detailed metrics on kanji density, vocabulary, grammar, and sentence structure. 
new_line
new_line
This is an excellent dataset if you want to train your LLM to understand the complexities of the Japanese language.
text
This is an excellent dataset if you want to train your LLM to understand the complexities of the Japanese language.
new_line
new_line
https://huggingface.co/datasets/ronantakizawa/japanese-text-difficulty
ronantakizawa/japanese-text-difficulty
dataset
resource
https://huggingface.co/datasets/ronantakizawa/japanese-text-difficulty
new_line
new_line
#dataset #japanese #textdifficulty
text
#dataset #japanese #textdifficulty
Introducing the japanese-text-difficulty dataset! 🎉

This dataset gathered texts from Aozora Bunko and marked them with jReadability scores, plus detailed metrics on kanji density, vocabulary, grammar, and sentence structure. 

This is an excellent dataset if you want to train your LLM to understand the complexities of the Japanese language.

https://huggingface.co/datasets/ronantakizawa/japanese-text-difficulty

#dataset #japanese #textdifficulty
👍
John6666 ronantakizawa