State Space Model

An alternative to transformer architecture that processes sequences using principles from control theory and signal processing. State space models like Mamba achieve competitive performance with linear rather than quadratic scaling in sequence length, enabling efficient processing of very long contexts. They are gaining traction as transformer alternatives.