nothingiisreal/Human_Stories
Viewer • Updated • 3.02k • 29 • 9
How to use Fizzarolli/synthetic-prose-detector-v2 with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-classification", model="Fizzarolli/synthetic-prose-detector-v2") # Load model directly
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tokenizer = AutoTokenizer.from_pretrained("Fizzarolli/synthetic-prose-detector-v2")
model = AutoModelForSequenceClassification.from_pretrained("Fizzarolli/synthetic-prose-detector-v2", device_map="auto")labels should be obvious this time.
performs better on multiple model outputs than my previous attempt. generally can detect zero-shot writing by models such as gpt-4 (as well as turbo and 4o), claude 3, llama 3, etc.
i've seen it getting fooled most-commonly by gemma 2, returning false real writing. perhaps it's a statement on how good gemma 2 is?