arxiv
PublishedApril 24, 2026 at 4:00 AM
—neutral
Super Apriel: One Checkpoint, Many Speeds
Publisher summary· verbatim
arXiv:2604.19877v1 Announce Type: new Abstract: We release Super Apriel, a 15B-parameter supernet in which every decoder layer provides four trained mixer choices -- Full Attention (FA), Sliding Window Attention (SWA), Kimi Delta Attention (KDA), and Gated DeltaNet (GDN). A placement selects one mix
Discussion
No replies yet. Be first.
Originally published on arxiv ↗