⚡ My PhD thesis, “Scalable Nested Optimization for Deep Learning,” is now on arXiv! ⚡
text
⚡ My PhD thesis, “Scalable Nested Optimization for Deep Learning,” is now on arXiv! ⚡
new_line
new_line
tl;dr: We develop various optimization tools with highlights, including:
text
tl;dr: We develop various optimization tools with highlights, including:
new_line
· Making the momentum coefficient complex for adversarial games like GANs.
text
· Making the momentum coefficient complex for adversarial games like GANs.
new_line
· Optimizing millions of hyperparameters using implicit differentiation.
text
· Optimizing millions of hyperparameters using implicit differentiation.
new_line
· Tuning hyperparameters using hypernetworks.
text
· Tuning hyperparameters using hypernetworks.
new_line
· Differentiably finding bifurcations in optimization for diverse solutions.
text
· Differentiably finding bifurcations in optimization for diverse solutions.
new_line
new_line
https://arxiv.org/abs/2407.01526
https://arxiv.org/abs/2407.01526
link
⚡ My PhD thesis, “Scalable Nested Optimization for Deep Learning,” is now on arXiv! ⚡

tl;dr: We develop various optimization tools with highlights, including:
· Making the momentum coefficient complex for adversarial games like GANs.
· Optimizing millions of hyperparameters using implicit differentiation.
· Tuning hyperparameters using hypernetworks.
· Differentiably finding bifurcations in optimization for diverse solutions.

https://arxiv.org/abs/2407.01526
🔥
nbroad ajibawa-2023 merve MexIvanov rkusch Joseph717171 osanseviero lorraine2 not-lain fsaudm
👍
Jaward merve MexIvanov Joseph717171 Aurelien-Morgan lorraine2 not-lain
64aea8ff67511bd3d965697b
https://cdn-avatars.huggingface.co/v1/production/uploads/64aea8ff67511bd3d965697b/Jxn52EmDF5RApJh8antxn.jpeg
Feynman Innovations
ajibawa-2023
user
6032802e1f993496bc14d9e3
https://cdn-avatars.huggingface.co/v1/production/uploads/6032802e1f993496bc14d9e3/w6hr-DEQot4VVkoyRIBiy.png
Omar Sanseviero
osanseviero
user