Jan Majkutewicz
jmajkutewicz
AI & ML interests
None yet
Organizations
None yet
An Empirical Study of DPO Configuration Choices for LLM Alignment
-
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_hh-rlhf
Text Generation • Updated • 2 -
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_oasst1
Text Generation • Updated • 2 -
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_PKU-SafeRLHF
Text Generation • Updated • 1 -
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_ultrafeedback
Text Generation • Updated • 1
An Empirical Study of DPO Configuration Choices for LLM Alignment
-
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_hh-rlhf
Text Generation • Updated • 2 -
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_oasst1
Text Generation • Updated • 2 -
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_PKU-SafeRLHF
Text Generation • Updated • 1 -
jmajkutewicz/Llama-3.1-Tulu-3-8B-DPO_ultrafeedback
Text Generation • Updated • 1
models 16
jmajkutewicz/pllum-12b-opposing-views-right-wing
Text Generation • Updated • 2
jmajkutewicz/pllum-12b-opposing-views-left-wing
Text Generation • Updated • 1
jmajkutewicz/Qwen3.5-9B-medadapt
Text Generation • 9B • Updated • 8
jmajkutewicz/gemma-4-E2B-medadapt
Text Generation • 5B • Updated • 5
jmajkutewicz/Bielik-11B-v3.0-medadapt
Text Generation • 11B • Updated • 18 • 1
jmajkutewicz/Bielik-4.5B-v3.0-medadapt
Text Generation • 5B • Updated • 11 • 1
jmajkutewicz/zephyr-7b-dpo_dataset-mix
Text Generation • Updated • 1
jmajkutewicz/zephyr-7b-dpo_PKU-SafeRLHF
Text Generation • Updated • 5
jmajkutewicz/zephyr-7b-dpo_ultrafeedback
Text Generation • Updated • 8
jmajkutewicz/zephyr-7b-dpo_hh-rlhf
Text Generation • Updated • 1
datasets 6
jmajkutewicz/sql-create-context
Viewer • Updated • 78.6k • 11
jmajkutewicz/PKU-SafeRLHF-binarized
Viewer • Updated • 82.1k • 11
jmajkutewicz/hh-rlhf-binarized
Viewer • Updated • 169k • 25
jmajkutewicz/oasst1-binarized
Viewer • Updated • 14.9k • 15
jmajkutewicz/SHP-binarized
Viewer • Updated • 121k • 28
jmajkutewicz/WikiPrefs
Viewer • Updated • 65.3k • 15