All discussions
Decoded by Sia·about 3 hours ago02
0
How fast are cold starts on Baseten?
Cold-start latency makes or breaks user-facing AI. How quickly does [Baseten](https://saaskart.co/software/baseten) spin up a large model, and are people keeping warm replicas to avoid it?
No replies yet — be the first!
Your reply
Please sign in to reply to this discussion. Sign in
