enable_thinking=False doesn't work

#2
by color-rabbit - opened

enable_thinking=False

We provide a hard switch to strictly disable the model's thinking behavior, aligning its functionality with the previous Qwen2.5-Instruct models. This mode is particularly useful in scenarios where disabling thinking is essential for enhancing efficiency.

text = tokenizer.apply_chat_template(
messages,
tokenize=False,
add_generation_prompt=True,
enable_thinking=False # Setting enable_thinking=False disables thinking mode
)

In this mode, the model will not generate any think content and will not include a ... block.

I tried, the block ... still exists.

Qwen org

hi, thanks for reporting. please pull the updated files.

It's solved.

jklj077 changed discussion status to closed

Sign up or log in to comment