Comment on page

Logs & Analytics

One of the many advantages of integrating with Portkey is the detailed logs and analytics provided directly on the Portkey dashboard. Once your application is integrated with Portkey, this feature is enabled automatically, providing you with valuable insights into your application's usage patterns and performance.
This feature does not require any additional headers to be passed in your requests. As soon as the Portkey integration is done, all logs and analytics will begin to appear in the Portkey dashboard.
The Logs and Analytics section is split into two parts:

📊 Analytics

The Analytics section of the Portkey dashboard provides a visual and interactive interface for understanding your LLM application Here, you can see various graphs and metrics related to requests to different LLMs, costs, latencies, tokens, user activity, feedback, cache hits, errors, and much more.
The metrics in the Analytics section can help you understand the overall efficiency of your application, discover patterns, identify areas of optimization, and much more.

📋 Logs

The Logs section presents a chronological list of all the requests processed through Portkey. Each log entry provides useful data such as the timestamp, request type, LLM used, tokens generated, and cost. By clicking on an entry, a side panel opens up, revealing the entire raw data with the request and response objects.
This detailed log can be invaluable when troubleshooting issues or understanding specific interactions. It provides full transparency into each request and response, enabling you to see exactly what data was sent and received.

🤝 Share Logs with Teammates

Each log on Portkey has a unique URL. You can just copy the link from the address bar and directly share it with anyone in your org.

🚦Request Status Guide

Wondering how your requests are being handled by Portkey? The Status column on the Logs page gives you a snapshot of the gateway activity for every request.
Portkey’s gateway features—Cache, Retries, Fallback, Loadbalance—are all tracked here with their exact states (disabled, triggered, etc.), making it a breeze to monitor and optimize your usage.
Common Queries Answered:
  • Is Caching Working?: Enabled caching but unsure if it's active? The Status column will confirm it for you.
  • How Many Retries Took Place?: Curious about the retry count for a successful request? See it with a glance.
  • Fallback and Loadbalance: Want to know if loadbalance is active or which fallback option was triggered? See it with a glance
🔴 Inactive State
🟢 Possible Active States
Cache Disabled
Cache Miss,
Cache Refreshed,
Cache Hit,
Cache Semantic Hit
Retry Not Triggered
Retry Success on {x} Tries,
Retry Failed
Fallback Disabled
Fallback Active,
Fallback Triggered on Option {x}
Loadbalancer Disabled
Loadbalancer Active