Readme
This is a Cog implementation test for Language model streaming. The model is from Openbuddy finetuned mistral-7b in GPTQ quantization in 4bits by TheBloke.
Openbuddy finetuned mistral-7b in GPTQ quantization in 4bits by TheBloke
This is a Cog implementation test for Language model streaming. The model is from Openbuddy finetuned mistral-7b in GPTQ quantization in 4bits by TheBloke.