Readme See model card here The AWQ version of the model, which is served here, can be found here. Thank you to TheBloke for sharing this!