gm8xx8

OpenAI DevDay 2024 Updates

o1 Updates:

> The keynote provided an overview of o1 with examples of its applications.

> The rate limit for o1 was doubled to 10,000 RPM, aligning it with GPT-4’s limit.

Realtime API:

🔗: https://openai.com/index/introducing-the-realtime-api/

> Introduced a new real-time API using WebSockets, enabling voice input and output with AI models. This API supports text, audio, and function calls in JSON format.

> Demonstrations included AI-powered voice interactions, such as travel agent and language learning apps, enhancing conversational experiences.

> The API is currently in public beta, with specific pricing for text and audio input/output.

Model Customization:

🔗: https://openai.com/index/introducing-vision-to-the-fine-tuning-api/

> Announced fine-tuning support for vision models, allowing for image-based fine-tuning.

> Suggested use cases include product recommendations, medical imaging, and traffic sign detection.