PromptLayer logo

PromptLayer + Memtro

Which prompt version is live, and what did our LLM requests cost?

PromptLayer shows you your prompt templates with versions, release labels and text. It reads logged requests as figures, such as cost, tokens, latency and errors, plus workflows, evaluations and tables. When asked and granted, it can publish a prompt or a new version, and create, move or delete a release label. It can also score or tag a request, run a workflow or evaluation, and manage folders, evaluations and tables. PromptLayer can tell Memtro as it happens when a release label moves or an evaluation finishes, and a job can start on it. Prompt inputs and outputs are never returned.

In Memtro

What you can do with PromptLayer in Memtro

Ask in plain English from chat, your editor, a scheduled job or your own agent. The model picks the right PromptLayer tool, reads what it needs, and answers with the source cited.

What it does

  1. 01Lists prompt templates and reads one with its messages, input variables, model and release labels.
  2. 02Searches logged requests and totals cost, tokens, latency and errors, never the inputs or outputs.
  3. 03Lists agent workflows, evaluations with their runs, and tables.
  4. 04When asked and granted, publishes a prompt version or moves a release label, which changes what code fetching that label gets.
  5. 05When asked and granted, runs a workflow or evaluation, which spends your LLM provider credits.
  6. 06With events on, a release label moved, a new prompt version or an evaluation report finished can start a job.

Acts when asked

When you ask it to

These tools change something in PromptLayer. The model is told to use them only when you ask for exactly that, and an administrator grants each one by name to the teams that may use it; a personal connection acts only after its owner allows it.

  1. 01Publish a new version of a prompt (replace its messages or text, optionally move release labels to it)
  2. 02Create a new prompt template
  3. 03Create a release label on a prompt version
  4. 04Move a release label to another version (changes what code fetching that label gets)
  5. 05Delete a release label
  6. 06Score a logged request (0 to 100)
  7. 07Add metadata to a logged request
  8. 08Create a folder
  9. 09Run an agent workflow (spends LLM provider credits)
  10. 10Run an evaluation (spends LLM provider credits)
  11. 11Rename an evaluation
  12. 12Archive an evaluation
  13. 13Add rows to a table sheet
  14. 14Delete a table

Events

When it happens

Turn events on in the connection's Events tab on the Connections page, then add the address it shows as a webhook in PromptLayer, choosing the same kinds; the tab shows PromptLayer's own steps. Each event can start a job, with the event as its input. PromptLayer signs every delivery, and one whose signature does not check out is refused before it is read.

Events and webhooks
  • 01A new prompt version was created
  • 02A prompt was renamed
  • 03A prompt was deleted
  • 04A release label was created
  • 05A release label was deleted
  • 06A release label was moved to another version
  • 07A change to a protected label was requested
  • 08A change to a protected label was approved
  • 09A change to a protected label was denied
  • 10A snippet used by a prompt was updated
  • 11An agent run finished
  • 12An evaluation report finished
  • 13A dataset version was created from a file
  • 14A dataset file import failed
  • 15A dataset version was created from request filters
  • 16A table sheet was imported from a file
  • 17A table sheet file import failed
  • 18A table sheet was imported from request history
  • 19A table sheet request-history import failed
  • 20A skill collection's files changed
In practice

Ask it like you would a colleague

Once PromptLayer is connected, these are the kinds of things people ask. Plain questions, no syntax. If the answer lives partly in another system you have connected, Memtro looks there too.

PromptLayer logoPromptLayer + Memtro
  • What did our LLM requests cost last week?

  • Which version of the support prompt is labelled prod?

  • Which prompt had the most errors yesterday?

  • What is the p95 latency for gpt-4o this month?

  • When did the onboarding evaluation last run?

01

Cost by model

Dan Fletcher, ML engineer at BigCo, asked what last week's requests had cost. Memtro totalled cost and tokens from PromptLayer and named the most used models and prompts.

02

A label moves to prod

When a release label was moved in PromptLayer, a job started for Sarah Chen at Northwind. It read the prompt's new version with its messages and release labels and summarised what had changed.

Teams

Where it fits

The teams that lean on PromptLayer most, a question each of them asks, and what they connect beside it.

Better together

Works with

A record in PromptLayer is rarely the whole story. Connect the systems that hold the rest and Memtro checks them together, then remembers what it learned so the next question starts further along.

Also in Engineering and operations

Using something else for the same job, or both? Each connector has its own tools; connect as many as you like.

Setup

How to connect

Connect withAPI key
  1. 1

    In PromptLayer open Settings, then API keys, and create a key. Each workspace has its own keys.

  2. 2

    In Memtro open Connections → PromptLayer and paste the API key.

  3. 3

    An administrator grants the label, run and delete actions by name to the teams that may use them. Events are turned on from the connection's Events tab, and the address is then added in PromptLayer's webhook settings.

  4. 4

    Ask: what did our LLM requests cost last week?

Also works from

Chat in the dashboard, the OpenAI-compatible API, scheduled jobs, and any MCP client: Claude Code, OpenCode, Cursor, Claude Desktop. The PromptLayer tools are the same everywhere.

FAQ

Questions

Can Memtro change anything in PromptLayer?+

Only when you ask, and only what it has been granted: publish a new version of a prompt (replace its messages or text, optionally move release labels to it); create a new prompt template; create a release label on a prompt version; move a release label to another version (changes what code fetching that label gets); delete a release label; score a logged request (0 to 100); add metadata to a logged request; create a folder; run an agent workflow (spends LLM provider credits); run an evaluation (spends LLM provider credits); rename an evaluation; archive an evaluation; add rows to a table sheet; delete a table. Every other tool reads, searches or lists. The Connections page labels the tools that act, an administrator grants each one by name to the teams that may use it, and a personal connection acts only after its owner allows it.

Who can use a PromptLayer connection?+

A personal connection serves only your own requests. A shared connection serves the organisation: everyone, or only the teams an admin chooses. Admins can always add shared connections; other members need the permission.

Does Memtro store my PromptLayer data?+

Credentials are encrypted at rest. Tool results are cached briefly so agent loops do not repeat identical calls, and the facts the model extracts are saved to your organisation's memory with provenance (system, record and link) so they can be checked and superseded.

How do I connect PromptLayer?+

API key. In PromptLayer open Settings, then API keys, and create a key. Each workspace has its own keys.

Can PromptLayer start a job?+

Yes. Turn events on in the connection's Events tab on the Connections page, then add the address it shows as a webhook in PromptLayer, choosing the same kinds; the tab shows PromptLayer's own steps. A job set to start "When an event arrives" then runs once for each matching event, with the event as its input. The run treats the event as outside data, never as instructions, and anything the run remembers is kept as unverified.

Connect PromptLayer in a few minutes

Seven-day free trial, then one monthly price per organisation. Connectors, jobs and memory are never metered.

Where agents remember your company

Sign in, add a provider key, create an API key and point your tools at Memtro. It takes about five minutes.

7-day free trial · card on file, nothing charged until it ends · cancel any time