🚀 Just published: "OpenEvolve: Open-Source Evolutionary Code Optimization with Real-World GPU Kernel Discovery"
text
🚀 Just published: "OpenEvolve: Open-Source Evolutionary Code Optimization with Real-World GPU Kernel Discovery"
new_line
new_line
We built the first open-source implementation of Google's AlphaEvolve system and used it to automatically discover GPU kernel optimizations that outperform human engineers!
text
We built the first open-source implementation of Google's AlphaEvolve system and used it to automatically discover GPU kernel optimizations that outperform human engineers!
new_line
new_line
Key results:
text
Key results:
new_line
new_line
- 21.8% average decode speed improvement on Apple Silicon
text
- 21.8% average decode speed improvement on Apple Silicon
new_line
- 36.7% improvement on long-context transformer attention
text
- 36.7% improvement on long-context transformer attention
new_line
- Discovered novel vectorization patterns and 2-pass softmax algorithm
text
- Discovered novel vectorization patterns and 2-pass softmax algorithm
new_line
new_line
The system evolved a Metal kernel for Qwen3's Grouped Query Attention from a basic 3-pass implementation into something with sophisticated Apple Silicon optimizations that would take experts months to discover manually. The evolved kernel automatically found the optimal vec<T,8> operations for 128-dim attention heads and fused softmax computation with value accumulation.
text
The system evolved a Metal kernel for Qwen3's Grouped Query Attention from a basic 3-pass implementation into something with sophisticated Apple Silicon optimizations that would take experts months to discover manually. The evolved kernel automatically found the optimal vec<T,8> operations for 128-dim attention heads and fused softmax computation with value accumulation.
new_line
new_line
Really excited about the potential here - imagine evolutionary algorithms automatically discovering optimizations across all our AI infrastructure. What would you want to optimize with this approach?
text
Really excited about the potential here - imagine evolutionary algorithms automatically discovering optimizations across all our AI infrastructure. What would you want to optimize with this approach?
new_line
new_line
Full write-up: 
text
Full write-up: 
https://huggingface.co/blog/codelion/openevolve-gpu-kernel-discovery
https://huggingface.co/blog/codelion/openevolve-gpu-kernel-discovery
link
new_line
new_line
GitHub: 
text
GitHub: 
https://github.com/codelion/openevolve
https://github.com/codelion/openevolve
link
new_line
new_line
#AI #MachineLearning #GPU #OpenSource #Evolution #CodeOptimization #TransformerOptimization
text
#AI #MachineLearning #GPU #OpenSource #Evolution #CodeOptimization #TransformerOptimization
🚀 Just published: "OpenEvolve: Open-Source Evolutionary Code Optimization with Real-World GPU Kernel Discovery"

We built the first open-source implementation of Google's AlphaEvolve system and used it to automatically discover GPU kernel optimizations that outperform human engineers!

Key results:

- 21.8% average decode speed improvement on Apple Silicon
- 36.7% improvement on long-context transformer attention
- Discovered novel vectorization patterns and 2-pass softmax algorithm

The system evolved a Metal kernel for Qwen3's Grouped Query Attention from a basic 3-pass implementation into something with sophisticated Apple Silicon optimizations that would take experts months to discover manually. The evolved kernel automatically found the optimal vec<T,8> operations for 128-dim attention heads and fused softmax computation with value accumulation.

Really excited about the potential here - imagine evolutionary algorithms automatically discovering optimizations across all our AI infrastructure. What would you want to optimize with this approach?

Full write-up: https://huggingface.co/blog/codelion/openevolve-gpu-kernel-discovery

GitHub: https://github.com/codelion/openevolve

#AI #MachineLearning #GPU #OpenSource #Evolution #CodeOptimization #TransformerOptimization
🔥
codelion EladofWar Wei-Wu
🚀
codelion John6666
➕
codelion
666e49c93ae28e1bcf88724b
/avatars/b91e5af5452e93aae22c52c6d16c12c4.svg
Ray Giles
raygiles3
user