Cost by model
Dan Fletcher, ML engineer at BigCo, asked what last week's requests had cost. Memtro totalled cost and tokens from PromptLayer and named the most used models and prompts.
Which prompt version is live, and what did our LLM requests cost?
PromptLayer shows you your prompt templates with versions, release labels and text. It reads logged requests as figures, such as cost, tokens, latency and errors, plus workflows, evaluations and tables. When asked and granted, it can publish a prompt or a new version, and create, move or delete a release label. It can also score or tag a request, run a workflow or evaluation, and manage folders, evaluations and tables. PromptLayer can tell Memtro as it happens when a release label moves or an evaluation finishes, and a job can start on it. Prompt inputs and outputs are never returned.
Ask in plain English from chat, your editor, a scheduled job or your own agent. The model picks the right PromptLayer tool, reads what it needs, and answers with the source cited.
These tools change something in PromptLayer. The model is told to use them only when you ask for exactly that, and an administrator grants each one by name to the teams that may use it; a personal connection acts only after its owner allows it.
Turn events on in the connection's Events tab on the Connections page, then add the address it shows as a webhook in PromptLayer, choosing the same kinds; the tab shows PromptLayer's own steps. Each event can start a job, with the event as its input. PromptLayer signs every delivery, and one whose signature does not check out is refused before it is read.
Events and webhooksOnce PromptLayer is connected, these are the kinds of things people ask. Plain questions, no syntax. If the answer lives partly in another system you have connected, Memtro looks there too.
What did our LLM requests cost last week?
Which version of the support prompt is labelled prod?
Which prompt had the most errors yesterday?
What is the p95 latency for gpt-4o this month?
When did the onboarding evaluation last run?
Dan Fletcher, ML engineer at BigCo, asked what last week's requests had cost. Memtro totalled cost and tokens from PromptLayer and named the most used models and prompts.
When a release label was moved in PromptLayer, a job started for Sarah Chen at Northwind. It read the prompt's new version with its messages and release labels and summarised what had changed.
The teams that lean on PromptLayer most, a question each of them asks, and what they connect beside it.
A record in PromptLayer is rarely the whole story. Connect the systems that hold the rest and Memtro checks them together, then remembers what it learned so the next question starts further along.
Using something else for the same job, or both? Each connector has its own tools; connect as many as you like.
In PromptLayer open Settings, then API keys, and create a key. Each workspace has its own keys.
In Memtro open Connections → PromptLayer and paste the API key.
An administrator grants the label, run and delete actions by name to the teams that may use them. Events are turned on from the connection's Events tab, and the address is then added in PromptLayer's webhook settings.
Ask: what did our LLM requests cost last week?
Chat in the dashboard, the OpenAI-compatible API, scheduled jobs, and any MCP client: Claude Code, OpenCode, Cursor, Claude Desktop. The PromptLayer tools are the same everywhere.
Only when you ask, and only what it has been granted: publish a new version of a prompt (replace its messages or text, optionally move release labels to it); create a new prompt template; create a release label on a prompt version; move a release label to another version (changes what code fetching that label gets); delete a release label; score a logged request (0 to 100); add metadata to a logged request; create a folder; run an agent workflow (spends LLM provider credits); run an evaluation (spends LLM provider credits); rename an evaluation; archive an evaluation; add rows to a table sheet; delete a table. Every other tool reads, searches or lists. The Connections page labels the tools that act, an administrator grants each one by name to the teams that may use it, and a personal connection acts only after its owner allows it.
A personal connection serves only your own requests. A shared connection serves the organisation: everyone, or only the teams an admin chooses. Admins can always add shared connections; other members need the permission.
Credentials are encrypted at rest. Tool results are cached briefly so agent loops do not repeat identical calls, and the facts the model extracts are saved to your organisation's memory with provenance (system, record and link) so they can be checked and superseded.
API key. In PromptLayer open Settings, then API keys, and create a key. Each workspace has its own keys.
Yes. Turn events on in the connection's Events tab on the Connections page, then add the address it shows as a webhook in PromptLayer, choosing the same kinds; the tab shows PromptLayer's own steps. A job set to start "When an event arrives" then runs once for each matching event, with the event as its input. The run treats the event as outside data, never as instructions, and anything the run remembers is kept as unverified.
Seven-day free trial, then one monthly price per organisation. Connectors, jobs and memory are never metered.
Sign in, add a provider key, create an API key and point your tools at Memtro. It takes about five minutes.
7-day free trial · card on file, nothing charged until it ends · cancel any time