🧠 Stanford paper might be the key to OpenAI o1’s performance: What’s so effective about Chain of Thought? ⇒ it unlocks radically different sequential tasks!
text
🧠 Stanford paper might be the key to OpenAI o1’s performance: What’s so effective about Chain of Thought? ⇒ it unlocks radically different sequential tasks!
new_line
new_line
💭 Reminder: A Chain of Thought (CoT) means that you instruct the model to “think step by step”. Often it’s literally just putting in the prompt “let’s think step by step.”
text
💭 Reminder: A Chain of Thought (CoT) means that you instruct the model to “think step by step”. Often it’s literally just putting in the prompt “let’s think step by step.”
new_line
new_line
🤔 This method has been shown to be unreasonably effective to increase perf on benchmarks. However why it works so well remains unclear.
text
🤔 This method has been shown to be unreasonably effective to increase perf on benchmarks. However why it works so well remains unclear.
new_line
new_line
Here's the scoop: Transformers are amazing at parallel processing, but they've always struggled with tasks that require sequential reasoning. 
text
Here's the scoop: Transformers are amazing at parallel processing, but they've always struggled with tasks that require sequential reasoning. 
new_line
new_line
⛔️ For instance if you ask them the result of 3^2^2^2^…, with 20 iterations, they’ll nearly always fail.
text
⛔️ For instance if you ask them the result of 3^2^2^2^…, with 20 iterations, they’ll nearly always fail.
new_line
new_line
💡 Indeed, researchers prove mathematically, by assimilating transformers networks to logical circuits, that effectively they cannot solve sequential tasks that require more than a certain threshold of sequences.
text
💡 Indeed, researchers prove mathematically, by assimilating transformers networks to logical circuits, that effectively they cannot solve sequential tasks that require more than a certain threshold of sequences.
new_line
new_line
But CoT enables sequential reasoning:
text
But CoT enables sequential reasoning:
new_line
new_line
- 🧱 Each step in the CoT corresponds to simulating one operation in a complex circuit.
text
- 🧱 Each step in the CoT corresponds to simulating one operation in a complex circuit.
new_line
- 🔄 This allows the transformer to "reset" the depth of intermediate outputs, overcoming previous limitations.
text
- 🔄 This allows the transformer to "reset" the depth of intermediate outputs, overcoming previous limitations.
new_line
- 🚀 Thus, with CoT, constant-depth transformers can now solve ANY problem computable by polynomial-size circuits! (That's a huge class of problems in computer science.)
text
- 🚀 Thus, with CoT, constant-depth transformers can now solve ANY problem computable by polynomial-size circuits! (That's a huge class of problems in computer science.)
new_line
- 🔑 Transformers can now handle tricky tasks like iterated squares (computing 3^2^2^2^2) composed permutations and evaluating circuits - stuff that requires serial computation.
text
- 🔑 Transformers can now handle tricky tasks like iterated squares (computing 3^2^2^2^2) composed permutations and evaluating circuits - stuff that requires serial computation.
new_line
- 📊 The improvement is especially dramatic for transformers with a limited depth. Empirical tests on four arithmetic problems showed massive accuracy gains with CoT on inherently serial tasks.
text
- 📊 The improvement is especially dramatic for transformers with a limited depth. Empirical tests on four arithmetic problems showed massive accuracy gains with CoT on inherently serial tasks.
new_line
new_line
Main takeaway: Chain-of-thought isn't just a neat trick - it fundamentally expands what transformer models can do!
text
Main takeaway: Chain-of-thought isn't just a neat trick - it fundamentally expands what transformer models can do!
new_line
new_line
Read the paper 👉 
text
Read the paper 👉 
Chain of Thought Empowers Transformers to Solve Inherently Serial
  Problems (2402.12875)
https://huggingface.co/papers/2402.12875
2402.12875
paper
resource
https://huggingface.co/papers/2402.12875
🧠 Stanford paper might be the key to OpenAI o1’s performance: What’s so effective about Chain of Thought? ⇒ it unlocks radically different sequential tasks!

💭 Reminder: A Chain of Thought (CoT) means that you instruct the model to “think step by step”. Often it’s literally just putting in the prompt “let’s think step by step.”

🤔 This method has been shown to be unreasonably effective to increase perf on benchmarks. However why it works so well remains unclear.

Here's the scoop: Transformers are amazing at parallel processing, but they've always struggled with tasks that require sequential reasoning. 

⛔️ For instance if you ask them the result of 3^2^2^2^…, with 20 iterations, they’ll nearly always fail.

💡 Indeed, researchers prove mathematically, by assimilating transformers networks to logical circuits, that effectively they cannot solve sequential tasks that require more than a certain threshold of sequences.

But CoT enables sequential reasoning:

- 🧱 Each step in the CoT corresponds to simulating one operation in a complex circuit.
- 🔄 This allows the transformer to "reset" the depth of intermediate outputs, overcoming previous limitations.
- 🚀 Thus, with CoT, constant-depth transformers can now solve ANY problem computable by polynomial-size circuits! (That's a huge class of problems in computer science.)
- 🔑 Transformers can now handle tricky tasks like iterated squares (computing 3^2^2^2^2) composed permutations and evaluating circuits - stuff that requires serial computation.
- 📊 The improvement is especially dramatic for transformers with a limited depth. Empirical tests on four arithmetic problems showed massive accuracy gains with CoT on inherently serial tasks.

Main takeaway: Chain-of-thought isn't just a neat trick - it fundamentally expands what transformer models can do!

Read the paper 👉 https://huggingface.co/papers/2402.12875
👀
John6666 k-young AtAndDev Smorty100 Salvor louisbrulenaudet aitimer
🔥
nicolollo Smorty100 osanseviero