Export models
Once a fine-tuned model has completed training, you'll be able to export the model weights so that you can run the model on your own.
How to export a model
To export a model:
Click on the "Fine-tune" button in the sidebar
Click on the fine-tuned model that you would like to export
In the top-right, click the menu dropdown and select "Export Model" as shown below. We will send you an email (if one is provided) when the export job is complete.
Run an exported model with vLLM
Here is a Colab notebook that shows how to download and run an exported model with vLLM.
Last updated