Is your feature request related to a problem?
There is no monitoring or alerting for per API key request rates, leading to potential abuse on high-cost endpoints. This lack of visibility can result in unexpected costs and runaway clients.
Describe the solution you'd like
Implement monitoring and Discord alerts for per API key request rates with the following thresholds in a one-minute window:
- llm/call/ → more than 15 requests per minute
- evaluations/ → more than 3 requests per minute
- collections/ → more than 3 requests per minute
Notifications should be sent to a designated Discord channel detailing the triggering API key, endpoint, and request count. This proposal is for monitoring and alerting only; no rate limiting is required.
Is your feature request related to a problem?
There is no monitoring or alerting for per API key request rates, leading to potential abuse on high-cost endpoints. This lack of visibility can result in unexpected costs and runaway clients.
Describe the solution you'd like
Implement monitoring and Discord alerts for per API key request rates with the following thresholds in a one-minute window:
Notifications should be sent to a designated Discord channel detailing the triggering API key, endpoint, and request count. This proposal is for monitoring and alerting only; no rate limiting is required.