Finetuned E5 embeddings for instruct based on Mistral.
This model costs approximately $0.059 to run on Replicate, or 16 runs per $1, but this varies depending on your inputs. It is also open source and you can run it on your own computer with Docker.
This model runs on Nvidia A100 (80GB) GPU hardware. Predictions typically complete within 43 seconds. The predict time for this model varies significantly based on the inputs.
Improving Text Embeddings with Large Language Models. Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei, arXiv 2024
This model has 32 layers, produces 4096-length embeddings, and has a context window of 32k tokens.