metal RWKV

[RafaelUI]

Hello everyone. I conducted a study of the efficiency of metal with low resources. Created a WKV kernel: metal WKV-7 forward + backward kernel. Acceleration when learning in 7.8x vs python. The idea of unsloth on the RWKV core on apple silicon was also implemented. This is a research open project. It is not a production. But you can use it as you want