Subquadratic launches with $29M to bring 12M-token context windows to AI

Subquadratic, a company developing a novel generative artificial intelligence model, launched today with $29 million in seed ...
VentureBeat

New transformer architecture can make language models faster and resource-efficient

Large language models like ChatGPT and Llama-2 are notorious for their extensive memory and computational demands, making them costly to run. Trimming even a small fraction of their size can lead to ...
VentureBeat

Open source Mamba 3 arrives to surpass Transformer architecture with nearly 4% improved language modeling, reduced latency

The generative AI era began for most people with the launch of OpenAI's ChatGPT in late 2022, but the underlying technology — the "Transformer" neural network architecture that allows AI models to ...
Geeky Gadgets

Liquid LFM 40B: Redefining Transformer AI Architecture

Liquid AI has unveiled its groundbreaking Liquid Foundation Models (LFMs), signaling a significant leap forward in AI architecture. These innovative models seamlessly integrate the strengths of ...