On the  2nd of October a really cool paper was released called "Were RNNs all we need"   
text
On the  2nd of October a really cool paper was released called "Were RNNs all we need"   
https://arxiv.org/abs/2410.01201
https://arxiv.org/abs/2410.01201
link
new_line
new_line
This paper introduces the MinGRU model, a simplified version of the traditional Gated Recurrent Unit (GRU) designed to enhance efficiency by removing hidden state dependencies from its gates. This allows for parallel training, making it significantly faster than conventional GRUs. Additionally, MinGRU eliminates non-linear activations like tanh, streamlining computations.
text
This paper introduces the MinGRU model, a simplified version of the traditional Gated Recurrent Unit (GRU) designed to enhance efficiency by removing hidden state dependencies from its gates. This allows for parallel training, making it significantly faster than conventional GRUs. Additionally, MinGRU eliminates non-linear activations like tanh, streamlining computations.
new_line
new_line
So I read the paper and I tried training this model  and it seems to be doing quite well , you could check out the pre-trained model on the huggingface spaces 
text
So I read the paper and I tried training this model  and it seems to be doing quite well , you could check out the pre-trained model on the huggingface spaces 
new_line
new_line
-  
text
-  
https://huggingface.co/spaces/damerajee/mingru-stories
damerajee/mingru-stories
space
resource
https://huggingface.co/spaces/damerajee/mingru-stories
text
new_line
On the  2nd of October a really cool paper was released called "Were RNNs all we need"   https://arxiv.org/abs/2410.01201

This paper introduces the MinGRU model, a simplified version of the traditional Gated Recurrent Unit (GRU) designed to enhance efficiency by removing hidden state dependencies from its gates. This allows for parallel training, making it significantly faster than conventional GRUs. Additionally, MinGRU eliminates non-linear activations like tanh, streamlining computations.

So I read the paper and I tried training this model  and it seems to be doing quite well , you could check out the pre-trained model on the huggingface spaces 

-  https://huggingface.co/spaces/damerajee/mingru-stories 

👀
John6666
670a77bdb01ca59d9b6a4d2a
/avatars/7c7860afb1bef5657f006cc75609e7d7.svg
Elvis Serge
NSAA
user