i-SCOOP

Mamba 3, a state space model and an alternative to transformers

Mamba 3 is a state space model built for fast inference. Learn what it is, how it works, why it challenges transformers, and ...

Open source Mamba 3 arrives to surpass Transformer architecture with nearly 4% improved language modeling, reduced latency

This release is good for developers building long-context applications, real-time reasoning agents, or those seeking to ...
Forbes

Oscillatory State-Space Models: Toward Physical Intelligence

For a while now, we’ve been talking about transformers, frontier neural network logic models, as a transformative technology, no pun intended. But now, these attention mechanisms have other competing ...

Nvidia's new open weights Nemotron 3 super combines three different architectures to beat gpt-oss and Qwen in throughput

But today, Nvidia sought to help solve this problem with the release of Nemotron 3 Super, a 120-billion-parameter hybrid model, with weights posted on Hugging Face. By merging disparate architectural ...
Forbes

Ten Questions With The Researchers Behind H3 On State Space Models

Recently, we talked to Dan Fu and Tri Dao – authors of “Hungry Hungry Hippos” (aka “H3”) – on our Deep Papers podcast. H3 is a proposed language modeling architecture that performs comparably to ...
InfoQ

State Space Models Can Enable AI in Low-Power Edge Computing

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...
Computer Weekly

Pathway builds truly native reasoning model to solve LLM Sudoku stumbling blocks

First set out in a scientific paper last September, Pathway’s post-transformer architecture, BDH (Dragon hatchling), gives LLMs native reasoning powers with intrinsic memory mechanisms that support ...