The new gpt-4o model seems to a very good coder. OpenAI reported a 90+ score on 
text
The new gpt-4o model seems to a very good coder. OpenAI reported a 90+ score on 
https://huggingface.co/datasets/openai_humaneval
https://huggingface.co/datasets/openai_humaneval
link
text
new_line
new_line
We tried the new model on our 
text
We tried the new model on our 
https://huggingface.co/datasets/patched-codes/static-analysis-eval
patched-codes/static-analysis-eval
dataset
resource
https://huggingface.co/datasets/patched-codes/static-analysis-eval
 which evaluates the model on vulnerability remediation. gpt-4o has reclaimed the top spot on our leaderboard (from 
text
 which evaluates the model on vulnerability remediation. gpt-4o has reclaimed the top spot on our leaderboard (from 
https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct
meta-llama/Meta-Llama-3-70B-Instruct
model
resource
https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct
). 
text
). 
new_line
new_line
You can now use the new model with our open-source framework PatchWork - 
text
You can now use the new model with our open-source framework PatchWork - 
https://github.com/patched-codes/patchwork
https://github.com/patched-codes/patchwork
link
 by passing 
text
 by passing 
model=gpt-4o
`model=gpt-4o`
inline_code
 on the CLI.
text
 on the CLI.
The new gpt-4o model seems to a very good coder. OpenAI reported a 90+ score on https://huggingface.co/datasets/openai_humaneval 

We tried the new model on our https://huggingface.co/datasets/patched-codes/static-analysis-eval which evaluates the model on vulnerability remediation. gpt-4o has reclaimed the top spot on our leaderboard (from https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct). 

You can now use the new model with our open-source framework PatchWork - https://github.com/patched-codes/patchwork by passing `model=gpt-4o` on the CLI.
👍
codelion Taylor658 victor tayo6 odyss3y Abdollahi
🔥
codelion victor DmitryRyumin
🚀
codelion
5f17f0a0925b9863e28ad517
https://cdn-avatars.huggingface.co/v1/production/uploads/5f17f0a0925b9863e28ad517/fXIY5i9RLsIa1v3CCuVtt.jpeg
Victor Mustar
victor
user
62f32eab52ad88c930bb3f3b
https://cdn-avatars.huggingface.co/v1/production/uploads/1677134945205-62f32eab52ad88c930bb3f3b.png
Asankhaya Sharma
codelion
user
641b754d1911d3be6745cce9
https://cdn-avatars.huggingface.co/v1/production/uploads/641b754d1911d3be6745cce9/Ydjcjd4VuNUGj5Cd4QHdB.png
atayloraerospace
Taylor658
user