Audio jitter buffers are required 101 introductory material for understanding VoIP. libWebRTC’s audio jitter buffer implementation – the one in Chromium – is known as NetEQ. NetEQ is anything but basic. This is good from a user perspective since real-life networks conditions are often challenging. However, this means NetEQ’s esoteric code is complex and difficult […]
OpenAI & WebRTC Q&A with Sean DuBois
OpenAI is utilizing WebRTC for its Realtime API! Even better, webrtcHacks friend and Pion founder Sean DuBois helped to develop it and agreed to a Q&A about the implementation. It is not often a massive WebRTC use case like this emerges so rapidly. In addition, Sean was extremely transparent about his work at OpenAI. In […]
Measuring the response latency of OpenAIs WebRTC-based Realtime API
As Chad mentioned in his post last week, we have been diving into what OpenAI is doing with WebRTC. Over the last months, we actually did a full teardown and compared OpenAI’s Realtime API to what powers chatgpt.com. What intrigued us most was how to measure response latency. One of the key metrics for any […]
The Unofficial Guide to OpenAI’s (Beta) Realtime WebRTC API
EDITOR NOTE: OpenAI release the GA version of the Realtime API with WebRTC. This post covers the Beta version-only. The GA version is fully backward compatible and everything here is still accurate – just don’t mix approaches. I will have an gpt-realtime GA version update / version soon! OpenAI using WebRTC in its Realtime API […]
2024 WebRTC in Open Source Review: A Quantitative Analysis
I have been updating a WebRTC in Open Source dataset derived from GitHub event data for 10 years now. I periodically update this to look for recent trends on WebRTC activity, popular repos, and new API usage. I hosted a live stream of my 2024 review back in December where Tsahi Levent-Levi joined to help […]