Awesome-Mamba-Collection

Welcome to Awesome Mamba Resources! This repository is a curated collection of papers, tutorials, videos, and other valuable resources related to Mamba. Whether you're a beginner or an experienced user, this collection aims to provide a comprehensive reference for all things Mamba. Explore the latest research papers, dive into helpful tutorials, and discover insightful videos to enhance your understanding and proficiency in Mamba. Join us in this open collaboration to foster knowledge sharing and empower the Mamba community. Let's embark on an exciting journey with Mamba!

Feel free to modify and customize this introduction according to your preferences. Good luck with your repository! If you have any other questions, feel free to ask. -by ChatGPT

If you want to see the star count of each paper's code, switch to this.

Enjoy it below!

• Papers
  • Architecture
  • Theoretical Analysis
  • Vision
  • Language
  • Multi-Modal
  • Diffusion
  • Medical
  • Tabular Data
  • Graph
  • Point Cloud
  • Time Series
  • Speech
  • Recommendation
  • Reinforcement Learning
  • Survey
• Tutorials
  • Blogs
  • Videos
  • Books
  • Codes
  • Other Awesome Mamba List
• Contributions
• Citation
• Acknowledgement

<span id="head2"></span>

Papers

<span id="head3"></span>

Architecture

• Mamba: Linear-Time Sequence Modeling with Selective State Spaces [paper] [code] (2023.12.01)
• MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts [paper] [code] (2024.01.08)
• BlackMamba: Mixture of Experts for State-Space Models [paper] [code] (2024.02.01)
• Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling [paper] [homepage] (2024.02.15)
• DenseMamba: State Space Models with Dense Hidden Connection for Efficient Large Language Models [paper] [code] (2024.02.26)
• Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models [paper] [code] (2024.02.29)
• Jamba: A Hybrid Transformer-Mamba Language Model [paper] [code] (2024.03.28)
• (ICML 2024, Mamba-2) Transformers are SSMs: Generalized Models and Efficient Algorithms with Structured State Space Duality [paper] [poster] [code] (2024.05.31)

<span id="head4"></span>

Theoretical Analysis

• StableSSM: Alleviating the Curse of Memory in State-space Models through Stable Reparameterization [paper] (2023.11.24)
• The Hidden Attention of Mamba Models [paper] [code] (2024.03.03)
• Understanding Robustness of Visual State Space Models for Image Classification [paper] (2024.03.16)
• From Generalization Analysis to Optimization Designs for State Space Models [paper] (2024.05.04)
• Demystify Mamba in Vision: A Linear Attention Perspective [paper] [code] (2024.05.26)
• A Unified Implicit Attention Formulation for Gated-Linear Recurrent Sequence Models [paper] (2024.05.26)
• The Expressive Capacity of State Space Models: A Formal Language Perspective [paper] (2024.05.27)
• Unlocking the Secrets of Linear Complexity Sequence Model from A Unified Perspective [paper] (2024.05.27)
• (ICML 2024) Transformers are SSMs: Generalized Models and Efficient Algorithms with Structured State Space Duality [paper] [poster] [code] (2024.05.31)
• MambaLRP: Explaining Selective State Space Sequence Models [paper] (2024.06.11)
• Towards a theory of learning dynamics in deep state space models [paper] (2024.07.10)

<span id="head5"></span>

Vision

• (ICML 2024) Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model [paper] [code] (2024.01.17)
• VMamba: Visual State Space Model [paper] [code] (2024.01.18)
• U-shaped Vision Mamba for Single Image Dehazing [paper] (2024.02.06)
• Scalable Diffusion Models with State Space Backbone [paper] [code] (2024.02.08)
• Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data [paper] (2024.02.08)
• Pan-Mamba: Effective pan-sharpening with State Space Model [paper] (2024.02.19)
• (ECCV 2024) MambaIR: A Simple Baseline for Image Restoration with State-Space Model [paper] [code] (2024.02.23)
• Res-VMamba: Fine-Grained Food Category Visual Classification Using Selective State Space Models with Deep Residual Learning [paper] [code] (2024.02.24)
• MiM-ISTD: Mamba-in-Mamba for Efficient Infrared Small Target Detection [paper] [code] (2024.03.04)
• Motion Mamba: Efficient and Long Sequence Motion Generation with Hierarchical and Bidirectional Selective SSM [paper] [code] (2024.03.12)
• Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding [paper] [code] (2024.03.12)
• LocalMamba: Visual State Space Model with Windowed Selective Scan [paper] [code] (2024.03.14)
• EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mamba [paper] (2024.03.15)
• VmambaIR: Visual State Space Model for Image Restoration [paper] [code] (2024.03.18)
• (ECCV 2024) ZigMa: Zigzag Mamba Diffusion Model [paper] [code] [project] (2024.03.20)
• SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series [paper] (2024.03.22)
• VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotemporal Forecasting [paper] [code] (2024.03.25) (CVPR24 Precognition Workshop)
• PlainMamba: Improving Non-Hierarchical Mamba in Visual Recognition [paper] [code] (2024.03.26)
• ReMamber: Referring Image Segmentation with Mamba Twister [paper] (2024.03.26)
• Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstruction [paper] (2024.03.27)
• RSMamba: Remote Sensing Image Classification with State Space Model [paper] [code] (2024.03.28)
• MambaMixer: Efficient Selective State Space Models with Dual Token and Channel Selection [paper] (2024.03.29)
• HSIMamba: Hyperpsectral Imaging Efficient Feature Learning with Bidirectional State Space for Classification [paper] (2024.03.30)
• Samba: Semantic Segmentation of Remotely Sensed Images with State Space Model [paper] [code] (2024.04.02)
• RS-Mamba for Large Remote Sensing Image Dense Prediction [paper] [code] (2024.04.03)
• RS3Mamba: Visual State Space Model for Remote Sensing Images Semantic Segmentation [paper] (2024.04.03)
• InsectMamba: Insect Pest Classification with State Space Model [paper] (2024.04.04)
• (IEEE TGRS 2024) ChangeMamba: Remote Sensing Change Detection with Spatio-Temporal State Space Model [paper] [code] (2024.04.04)
• RhythmMamba: Fast Remote Physiological Measurement with Arbitrary Length Videos [paper] [code] (2024.04.09)
• Simba: Mamba augmented U-ShiftGCN for Skeletal Action Recognition in Videos [paper] (2024.04.11)
• FusionMamba: Efficient Image Fusion with State Space Model [paper] (2024.04.11)
• DGMamba: Domain Generalization via Generalized State Space Model [paper] [code] (2024.04.11)
• SpectralMamba: Efficient Mamba for Hyperspectral Image Classification [paper] (2024.04.12)
• FreqMamba: Viewing Mamba from a Frequency Perspective for Image Deraining [paper] (2024.04.15)
• HSIDMamba: Exploring Bidirectional State-Space Models for Hyperspectral Denoising [paper] (2024.04.15)
• A Novel State Space Model with Local Enhancement and State Sharing for Image Fusion [paper] (2024.04.15)
• FusionMamba: Dynamic Feature Enhancement for Multimodal Image Fusion with Mamba [paper] [code] (2024.04.15)
• MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detection [paper] [project] [code] (2024.04.15)
• Text-controlled Motion Mamba: Text-Instructed Temporal Grounding of Human Motion [paper] (2024.04.17)
• CU-Mamba: Selective State Space Models with Channel Learning for Image Restoration [paper] (2024.04.17)
• MambaPupil: Bidirectional Selective Recurrent model for Event-based Eye tracking [paper] (2024.04.18)
• MambaMOS: LiDAR-based 3D Moving Object Segmentation with Motion-aware State Space Model [paper] [code] (2024.04.19)
• ST-SSMs: Spatial-Temporal Selective State of Space Model for Traffic Forecasting [paper] (2024.04.20)
• MambaUIE&SR: Unraveling the Ocean's Secrets with Only 2.8 FLOPs [paper] [code] (2024.04.22)
• ST-MambaSync: The Confluence of Mamba Structure and Spatio-Temporal Transformers for Precipitous Traffic Prediction [paper] (2024.04.24)
• Spectral-Spatial Mamba for Hyperspectral Image Classification [paper] (2024.04.29)
• CLIP-Mamba: CLIP Pretrained Mamba Models with OOD and Hessian Evaluation [paper] [code] (2024.04.30)
• SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising [paper]