🚀 Exploring Topic Modeling with BERTopic 🤖
text
🚀 Exploring Topic Modeling with BERTopic 🤖
new_line
new_line
When you come across an interesting dataset, you often wonder:
text
When you come across an interesting dataset, you often wonder:
new_line
Which topics frequently appear in these documents? 🤔
text
Which topics frequently appear in these documents? 🤔
new_line
What is this data really about? 📊
text
What is this data really about? 📊
new_line
new_line
Topic modeling helps answer these questions by identifying recurring themes within a collection of documents. This process enables quick and efficient exploratory data analysis.
text
Topic modeling helps answer these questions by identifying recurring themes within a collection of documents. This process enables quick and efficient exploratory data analysis.
new_line
new_line
I’ve been working on an app that leverages BERTopic, a flexible framework designed for topic modeling. Its modularity makes BERTopic powerful, allowing you to switch components with your preferred algorithms. It also supports handling large datasets efficiently by merging models using the BERTopic.merge_models approach. 🔗
text
I’ve been working on an app that leverages BERTopic, a flexible framework designed for topic modeling. Its modularity makes BERTopic powerful, allowing you to switch components with your preferred algorithms. It also supports handling large datasets efficiently by merging models using the BERTopic.merge_models approach. 🔗
new_line
new_line
🔍 How do we make this work?
text
🔍 How do we make this work?
new_line
Here’s the stack we’re using:
text
Here’s the stack we’re using:
new_line
new_line
📂 Data Source ➡️ Hugging Face datasets with DuckDB for retrieval
text
📂 Data Source ➡️ Hugging Face datasets with DuckDB for retrieval
new_line
🧠 Text Embeddings ➡️ Sentence Transformers (all-MiniLM-L6-v2)
text
🧠 Text Embeddings ➡️ Sentence Transformers (all-MiniLM-L6-v2)
new_line
⚡ Dimensionality Reduction ➡️ RAPIDS cuML UMAP for GPU-accelerated performance
text
⚡ Dimensionality Reduction ➡️ RAPIDS cuML UMAP for GPU-accelerated performance
new_line
🔍 Clustering ➡️ RAPIDS cuML HDBSCAN for fast clustering
text
🔍 Clustering ➡️ RAPIDS cuML HDBSCAN for fast clustering
new_line
✂️ Tokenization ➡️ CountVectorizer
text
✂️ Tokenization ➡️ CountVectorizer
new_line
🔧 Representation Tuning ➡️ KeyBERTInspired + Hugging Face Inference Client with Meta-Llama-3-8B-Instruct
text
🔧 Representation Tuning ➡️ KeyBERTInspired + Hugging Face Inference Client with Meta-Llama-3-8B-Instruct
new_line
🌍 Visualization ➡️ Datamapplot library
text
🌍 Visualization ➡️ Datamapplot library
new_line
Check out the space and see how you can quickly generate topics from your dataset: 
text
Check out the space and see how you can quickly generate topics from your dataset: 
https://huggingface.co/spaces/datasets-topics/topics-generator
datasets-topics/topics-generator
space
resource
https://huggingface.co/spaces/datasets-topics/topics-generator
new_line
new_line
Powered by 
text
Powered by 
@MaartenGr
mention
MaartenGr
  - BERTopic 
text
  - BERTopic 
🚀 Exploring Topic Modeling with BERTopic 🤖

When you come across an interesting dataset, you often wonder:
Which topics frequently appear in these documents? 🤔
What is this data really about? 📊

Topic modeling helps answer these questions by identifying recurring themes within a collection of documents. This process enables quick and efficient exploratory data analysis.

I’ve been working on an app that leverages BERTopic, a flexible framework designed for topic modeling. Its modularity makes BERTopic powerful, allowing you to switch components with your preferred algorithms. It also supports handling large datasets efficiently by merging models using the BERTopic.merge_models approach. 🔗

🔍 How do we make this work?
Here’s the stack we’re using:

📂 Data Source ➡️ Hugging Face datasets with DuckDB for retrieval
🧠 Text Embeddings ➡️ Sentence Transformers (all-MiniLM-L6-v2)
⚡ Dimensionality Reduction ➡️ RAPIDS cuML UMAP for GPU-accelerated performance
🔍 Clustering ➡️ RAPIDS cuML HDBSCAN for fast clustering
✂️ Tokenization ➡️ CountVectorizer
🔧 Representation Tuning ➡️ KeyBERTInspired + Hugging Face Inference Client with Meta-Llama-3-8B-Instruct
🌍 Visualization ➡️ Datamapplot library
Check out the space and see how you can quickly generate topics from your dataset: https://huggingface.co/spaces/datasets-topics/topics-generator

Powered by @MaartenGr  - BERTopic 
👍
ijohn07 John6666 edison1 Chao2012 rennokki vinhnx90
❤️
Chao2012 korkakak MaartenGr
🔥
rennokki
🤗
porkz