SII-xrliu/RoPEPP_EC-DCLM-1_5B-32k
1B
•
Updated
•
10
Xiaoran Liu (SII)
SII-xrliu
AI & ML interests
None yet
Recent Activity
upvoted
a
collection
5 days ago
RoPE++
upvoted
a
paper
14 days ago
AdaLomo: Low-memory Optimization with Adaptive Learning Rate
authored
a paper
17 days ago
Beyond Real: Imaginary Extension of Rotary Position Embeddings for Long-Context LLMs
Organizations
None yet
SII-xrliu/RoPEPP_EH-DCLM-1_5B-32k
1B
•
Updated
•
12
SII-xrliu/RoPE-DCLM-1_5B-32k
1B
•
Updated
•
9
SII-xrliu/RoPEPP_EC-DCLM-1_5B-4k
1B
•
Updated
•
10
SII-xrliu/RoPEPP_EH-DCLM-1_5B-4k
1B
•
Updated
•
6
SII-xrliu/RoPE-DCLM-1_5B-4k
1B
•
Updated
•
10
SII-xrliu/RoPEPP_EC-DCLM-776M-32k
0.8B
•
Updated
•
7
SII-xrliu/RoPEPP_EH-DCLM-776M-32k
0.7B
•
Updated
•
9
SII-xrliu/RoPE-DCLM-776M-32k
0.8B
•
Updated
•
9
SII-xrliu/Pythia-DCLM-776M-4k
0.8B
•
Updated
•
12
SII-xrliu/FoPE-DCLM-776M-4k
0.8B
•
Updated
•
26
SII-xrliu/ALiBi-DCLM-776M-4k
0.8B
•
Updated
•
9
SII-xrliu/RoPEPP_EC-DCLM-776M-4k
0.8B
•
Updated
•
6
SII-xrliu/RoPEPP_EH-DCLM-776M-4k
0.7B
•
Updated
•
11
SII-xrliu/RoPE-DCLM-776M-4k
0.8B
•
Updated
•
8
SII-xrliu/FoPE-DCLM-376M-4k
0.4B
•
Updated
•
20
SII-xrliu/RoPEPP_EC-DCLM-376M-32k
0.4B
•
Updated
•
9
SII-xrliu/RoPEPP_EH-DCLM-376M-32k
0.4B
•
Updated
•
14
SII-xrliu/RoPE-DCLM-376M-32k
0.4B
•
Updated
•
7
SII-xrliu/RoPEPP_EC-DCLM-376M-4k
0.4B
•
Updated
•
14
SII-xrliu/RoPEPP_EH-DCLM-376M-4k
0.4B
•
Updated
•
25
SII-xrliu/Pythia-DCLM-376M-4k
0.4B
•
Updated
•
11
SII-xrliu/ALiBi-DCLM-376M-4k
0.4B
•
Updated
•
7
SII-xrliu/RoPE-DCLM-376M-4k
0.4B
•
Updated
•
20