Replicate
4.5
Replicate runs open-source models behind an API, billed by the second of compute, and lets you package your own with Cog. It covers the gap between a model existing on GitHub and a model you can call from production without owning GPUs.
- Commercial use OK
- Pricing
- 従量課金
- Free tier
- No
- Commercial use
- Permitted
- Japanese UI
- Not confirmed
- Enterprise contract
- Not confirmed
What it is good for
- Using an open image, audio or video model without provisioning GPUs
- Deploying a fine-tuned or custom model behind an API
- Prototyping with models that have no hosted offering
- Workloads too bursty to justify reserved hardware
Strengths and trade-offs
Strengths
- Large catalogue of open models, callable immediately
- Per-second billing suits bursty workloads
- Cog packages your own model with the same interface
- No GPU procurement or driver maintenance
Trade-offs
- Cold starts on less popular models add seconds
- Per-second pricing is expensive at sustained high volume
- Model availability and versions are not guaranteed indefinitely
Editors' review
The practical bridge between an open model and production
Most interesting open models arrive as a repository and a paper. Getting from there to something an application can call means GPUs, drivers, a server and an on-call rotation. Replicate removes that, and the per-second billing means an experiment costs what the experiment costs.
Cog is the underrated half. Packaging your own fine-tuned model with the same interface means the prototype and the production deployment are the same artefact.
The economics invert at scale. Sustained high volume is cheaper on reserved hardware, and cold starts on rarely used models are real. Treat it as the way to find out whether the model is worth owning infrastructure for.
Verdict
Excellent for getting an open model into production quickly. Revisit the maths once volume is steady.
Compiled from official documentation and public sources, with our own editorial judgement. We do not publish figures we cannot source.