"Which inference engine should we use, vLLM or TensorRT-LLM?"
We see this question a lot.
If you're mid-decision, the full breakdown is here, including where each one tends to surprise people:
Deploy When Available is now GA. Queue for any GPU spec, even if it's fully rented out, and we'll deploy your pod the moment it frees up.
Here's how to get started → runpod.io/blog/deploy-wh…
Flash Hack Day is in the books. 11 teams hacked and demoed live, with real production endpoints, shipped in a day.
Congrats to Phong Cao (FlashML), Nelson Lai (FlashDock), and Sulaxmi Raskar (LifeLine).
First one, not the last.
You can find all projects here:
We'll be at the AI Engineer World's Fair this week, June 29 – July 2 in San Francisco.
If you're attending, come find us! We always love to chat about what you're building.
See you there.
Two days until Flash Hack Day. We've got credits and cash prizes for the top projects, plus a gift for every single person who builds with us.
The event is remote-friendly. So if you can't join us in San Francisco, just join us online!
Register through the link below:
Today, we’re excited to announce our $50M Series B, led by @GreenfieldVC, with participation from @lightspeedvp and @notablecap. 🚀
At Patronus AI, we develop simulations and evals to train and improve AI. The first phase of AI was built on static benchmarks, but that era is
We just closed a $100M Series A led by @SummitPartners. 🎉
1M+ developers. $22M raised to get here. Almost entirely word of mouth.
Pods. Serverless. Clusters. The full AI lifecycle on one platform. We're moving faster on all of it.
We had a great time at the @databricks Data+AI Summit this week.
Always great to see so many builders who are shipping real AI workloads.
Thanks to everyone who stopped by the booth, and we'll see you at the next one!
