Add support for mamba-codestral

[Shadowblujay]

Description

Add support for https://huggingface.co/mistralai/mamba-codestral-7B-v0.1

I'm guessing this also means adding support for mamba models in general

Additional Context

Probably would have to be a separate model loader, from what I'm understanding either https://github.com/state-spaces/mamba or https://github.com/mistralai/mistral-inference could be used, although the original mamba package would probably be better for future models based on the mamba architecture from other sources.

[dlippold]

mamba-codestral is currently integrated into llama.cpp, see ggerganov/llama.cpp#8519 . That depends on ggerganov/llama.cpp#8526 where there still seems to be work to be done.