the last stop

gm8xx8

Pricing & Caching:

🔗: https://openai.com/index/api-prompt-caching/

> The cost-per-token has been reduced by 99% over the past two years.

> Introduced automatic prompt caching, which offers a 50% discount on tokens previously processed by the model.

Model Distillation:

🔗: https://openai.com/index/api-model-distillation/

> Introduced tools for model distillation, allowing smaller models to learn from larger ones by teaching them using the outputs of larger models.

> Launched stored completions, enabling the permanent storage of interactions for fine-tuning and distillation.

> Added evaluation tools to assist developers in refining model performance.

https://openai.com/index/api-model-distillation/