In several benchmark, Falcon Mamba 7B convincingly outperformed Llama 3 8B, Llama 3.1 8B, Gemma 7B and Mistral 7B.
https://venturebeat.com/ai/falcon-mamba-7bs-powerful-new-ai-architecture-offers-alternative-to-transformer-models/?utm_source=dlvr.it&utm_medium=blogger
https://venturebeat.com/ai/falcon-mamba-7bs-powerful-new-ai-architecture-offers-alternative-to-transformer-models/?utm_source=dlvr.it&utm_medium=blogger