fastmoe是否支持微调，page-attention，flasahattention和kvcache，混合精度等

[PowerDispatch]

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

[laekov]

是, 是, 是和是, 是...

[PowerDispatch]

没有找到微调的case, 能帮忙引导一下吗

[laekov]

我们没有在仓库中包含微调的例子. 请您自行实现.

[PowerDispatch]

好的，谢谢