Maybe a slerp or some other merge method will preserve the component experts better?
3
#2 opened about 1 year ago
by
BlueNipples
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64bb1109aaccfd28b023bcec/fumfSHv9pnW1rMvgQeibP.png)
Responses somewhat related to the prompt but still gibberish
2
#1 opened about 1 year ago
by
JeroenAdam