enable_thinking=False doesn't work
#2
by
color-rabbit
- opened
enable_thinking=False
We provide a hard switch to strictly disable the model's thinking behavior, aligning its functionality with the previous Qwen2.5-Instruct models. This mode is particularly useful in scenarios where disabling thinking is essential for enhancing efficiency.
text = tokenizer.apply_chat_template(
messages,
tokenize=False,
add_generation_prompt=True,
enable_thinking=False # Setting enable_thinking=False disables thinking mode
)
In this mode, the model will not generate any think content and will not include a ... block.
I tried, the block ... still exists.
hi, thanks for reporting. please pull the updated files.
It's solved.
jklj077
changed discussion status to
closed