"RWKV-LM" recurrent #neural-networks #AI #LLM: “an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). (...) So it’s combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding. (...) a Linux Foundation AI project, so totally free”
on 02026-01-12"TS_Zip" #compression with #RWKV-LM #neural-networks by #Bellard succeeding his #NNCP
on 02026-01-12