Portkey
Portkey is a mature way to put one gateway in front of many model providers, with failover, caching and logging included. It suits teams running LLM apps in production that want cost and reliability controls without writing them. The acquisition by a security vendor is likely to steer the roadmap toward enterprise governance, so small teams should watch pricing and packaging.
Pros
- Open-source MIT-licensed gateway that can be self-hosted
- Routing, fallbacks, load balancing and semantic caching in one place
- Free developer tier and a $49 production tier with published overage pricing
- Observability, guardrails and prompt management on the same platform
Cons
- The free tier is limited to 10,000 logs and is not meant for production
- Brand and packaging are shifting under Palo Alto Networks' Prisma AIRS
- Advanced governance, SSO and VPC hosting need the Enterprise plan