replicate-internal / hermes-2-theta-l3-8b-fp16-triton

  • Public
  • 1 run

If you haven’t yet trained a model on Replicate, we recommend you read one of the following guides.

Pricing

Trainings for this model run on Nvidia A100 (40GB) GPU hardware, which costs $0.00115 per second.

Create a training

Install the Python library:

pip install replicate

Then, run this to create a training with replicate-internal/hermes-2-theta-l3-8b-fp16-triton:c08e085a as the base model:

import replicate

training = replicate.trainings.create(
  version="replicate-internal/hermes-2-theta-l3-8b-fp16-triton:c08e085aa24433e159f167bda8de1a67432e66cdcc3a37fae1189367c3c4eb2a",
  input={
    ...
  },
  destination=f"{username}/<destination-model-name>"
)

print(training)
curl -s -X POST \
-d '{"destination": "{username}/<destination-model-name>", "input": {...}}' \
  -H "Authorization: Bearer $REPLICATE_API_TOKEN" \
  https://api.replicate.com/v1/models/replicate-internal/hermes-2-theta-l3-8b-fp16-triton/versions/c08e085aa24433e159f167bda8de1a67432e66cdcc3a37fae1189367c3c4eb2a/trainings

The API response will look like this:

{
  "id": "zz4ibbonubfz7carwiefibzgga",
  "version": "c08e085aa24433e159f167bda8de1a67432e66cdcc3a37fae1189367c3c4eb2a",
  "status": "starting",
  "input": {
    "data": "..."
  },
  "output": null,
  "error": null,
  "logs": null,
  "started_at": null,
  "created_at": "2023-03-28T21:47:58.566434Z",
  "completed_at": null
}

Note that before you can create a training, you’ll need to create a model and use its name as the value for the destination field.