sahil2801/replit-code-instruct-glaive
This model costs approximately $0.0031 to run on Replicate, or 322 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.
This model runs on Nvidia A100 (80GB) GPU hardware. Predictions typically complete within 3 seconds.
My attempt at creating a cog wraper for GlaiveAI’s instruct-glaive model by Sahil (sahil2801/replit-code-instruct-glaive)
Performs better than WizardCoder-15B-v1 at generating code: https://github.com/abacaj/code-eval
Note: Does not explain code, only generates it
This COG is dedicated to Sahil