peter65374 / openbuddy-mistral-7b

Openbuddy finetuned mistral-7b in GPTQ quantization in 4bits by TheBloke

  • Public
  • 66 runs
  • GitHub
  • License

Readme

This is a Cog implementation test for Language model streaming. The model is from Openbuddy finetuned mistral-7b in GPTQ quantization in 4bits by TheBloke.