Vercel AI Gateway Blocks BYOK Requests with Zero Balance
TL;DR. Vercel's AI Gateway inappropriately blocks Bring Your Own Key (BYOK) requests when a user's account balance reaches zero, despite BYOK not incurring Vercel credits. - This issue impacts developers using their own AI model keys through Vercel's platform. - Users must top up their Vercel accounts to restore functionality for BYOK models. - The problem highlights potential billing logic flaws in AI service infrastructure. - The platform is designed to manage AI API consumption and cost for developers.
- Vercel AI Gateway ceases all requests, including BYOK, when credits expire.
- BYOK requests should bypass credit checks as they use external keys.
- The issue forces users to replenish Vercel credits even for services not billed by Vercel.
- This impacts developers managing AI model costs via Vercel's platform.