kcaverly / neuralbeagle14-7b-gguf

NeuralBeagle14-7B is (probably) the best 7B model you can find!

  • Public
  • 12.2K runs
  • GitHub
  • Paper

Run time and cost

This model costs approximately $0.036 to run on Replicate, or 27 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.

This model runs on Nvidia T4 GPU hardware. Predictions typically complete within 3 minutes.

Readme

“NeuralBeagle14-7B is (probably) the best 7B model you can find! 🎉”

The original model can be found here. The quantized version used is Q5_K_M, and can be found here.