Research14h ago
TinyCeNN-LM: Quality-Gated Conversion of Pretrained Attention with CeNN-Inspired Cellular-Recurrent Layers
TinyCeNN-LM introduces a quality-gated post-training conversion framework replacing attention in pretrained language models with cellular-recurrent layers…
#attention#language-models#model-conversion#cellular-recurrent#research#Perplexity#LLM