Langfuse logo

Langfuse + Memtro

Ask what your LLM spend was yesterday, and which generations errored in Langfuse.

Connect Langfuse with a project's public and secret key and Memtro reads observations with model, cost, tokens, latency and errors, usage summaries grouped by model or prompt, evaluation scores, prompts and their versions, datasets and comments. The inputs and outputs of observations are never read. When you ask, and once an administrator has granted them by name, it can comment, score, build datasets and annotation queues, and create prompt versions. Moving a label such as production onto a version changes what your applications serve. Deleting traces, scores or dataset items is permanent and changes cost figures. Nobody is notified.

In Memtro

What you can do with Langfuse in Memtro

Ask in plain English from chat, your editor, a scheduled job or your own agent. The model picks the right Langfuse tool, reads what it needs, and answers with the source cited.

What it does

  1. 01Recent observations with trace, name, level, status message, model, cost, tokens and latency, never inputs or outputs
  2. 02Cost, tokens, latency or counts over a window, grouped by model, observation name, prompt or environment
  3. 03Evaluation scores by name, source, trace or session, and managed prompts with versions, labels and tags
  4. 04When asked and granted, adds comments and evaluation scores, creates datasets, items, score configs and annotation queues, and queues traces for review, notifying nobody
  5. 05When asked and granted, creates a prompt version or moves a label such as production onto one, which changes what applications fetching that label serve
  6. 06When asked and granted, permanently deletes a score, a dataset item with its run results, or up to 50 traces with their observations

Acts when asked

When you ask it to

These tools change something in Langfuse. The model is told to use them only when you ask for exactly that, and an administrator grants each one by name to the teams that may use it; a personal connection acts only after its owner allows it.

  1. 01Add a comment to a trace, observation, session or prompt
  2. 02Add a score to a trace, observation or session
  3. 03Create a new prompt version (labels such as production change what apps serve)
  4. 04Move labels such as production onto a prompt version
  5. 05Create a dataset
  6. 06Add an item to a dataset
  7. 07Delete a dataset item and its run results (permanent)
  8. 08Create a score config
  9. 09Create an annotation queue
  10. 10Add a trace, observation or session to an annotation queue
  11. 11Mark an annotation queue item pending or completed
  12. 12Delete a score (permanent)
  13. 13Delete a trace (permanent)
  14. 14Delete up to 50 traces by id (permanent)

Events

When it happens

Turn events on in the connection's Events tab on the Connections page, then add the address it shows as a webhook in Langfuse, choosing the same kinds; the tab shows Langfuse's own steps. Each event can start a job, with the event as its input. Langfuse signs every delivery, and one whose signature does not check out is refused before it is read.

Events and webhooks
  • 01A prompt version was created
  • 02A prompt version's labels or tags changed
  • 03A prompt version was deleted
In practice

Ask it like you would a colleague

Once Langfuse is connected, these are the kinds of things people ask. Plain questions, no syntax. If the answer lives partly in another system you have connected, Memtro looks there too.

Langfuse logoLangfuse + Memtro
  • What did we spend on LLM calls yesterday, by model?

  • Which generations errored in the last 24 hours?

  • What changed in the production version of the support prompt?

  • Add a score of 0 called correctness to that trace

  • Move the production label to version 7 of the support prompt

01

Spend by model

The founder asks why the LLM bill rose last week. Memtro sums cost by model over seven days and shows one model accounting for 68% of the total, with token counts beside each.

02

Rolling back a prompt

After complaints from Acme, Priya Sharma asks Memtro to move the production label back to version 6 of the support prompt and note why on the bad trace. With the actions granted, Memtro moves the label, so applications fetching production serve version 6 again, and adds the comment for the project's members.

Teams

Where it fits

The teams that lean on Langfuse most, a question each of them asks, and what they connect beside it.

Better together

Works with

A record in Langfuse is rarely the whole story. Connect the systems that hold the rest and Memtro checks them together, then remembers what it learned so the next question starts further along.

Also in Engineering and operations

Using something else for the same job, or both? Each connector has its own tools; connect as many as you like.

Setup

How to connect

Connect withPublic key and secret key
  1. 1

    In Langfuse open your project → Settings → API Keys → Create new API keys. The pair has every right on its project with no scopes, so make one for Memtro alone. Copy the sk-lf- secret key, shown once

  2. 2

    Leave the host blank for Langfuse Cloud EU, type us.cloud.langfuse.com for the US cloud, or type your self-hosted server's name: a public DNS name with a publicly trusted certificate, no https:// or path

  3. 3

    Paste the pk-lf- Public key and the Secret key into Connections → Langfuse in Memtro

  4. 4

    Ask what the summariser cost yesterday

Also works from

Chat in the dashboard, the OpenAI-compatible API, scheduled jobs, and any MCP client: Claude Code, OpenCode, Cursor, Claude Desktop. The Langfuse tools are the same everywhere.

FAQ

Questions

Can Memtro change anything in Langfuse?+

Only when you ask, and only what it has been granted: add a comment to a trace, observation, session or prompt; add a score to a trace, observation or session; create a new prompt version (labels such as production change what apps serve); move labels such as production onto a prompt version; create a dataset; add an item to a dataset; delete a dataset item and its run results (permanent); create a score config; create an annotation queue; add a trace, observation or session to an annotation queue; mark an annotation queue item pending or completed; delete a score (permanent); delete a trace (permanent); delete up to 50 traces by id (permanent). Every other tool reads, searches or lists. The Connections page labels the tools that act, an administrator grants each one by name to the teams that may use it, and a personal connection acts only after its owner allows it.

Who can use a Langfuse connection?+

A personal connection serves only your own requests. A shared connection serves the organisation: everyone, or only the teams an admin chooses. Admins can always add shared connections; other members need the permission.

Does Memtro store my Langfuse data?+

Credentials are encrypted at rest. Tool results are cached briefly so agent loops do not repeat identical calls, and the facts the model extracts are saved to your organisation's memory with provenance (system, record and link) so they can be checked and superseded.

How do I connect Langfuse?+

Public key and secret key. In Langfuse open your project → Settings → API Keys → Create new API keys. The pair has every right on its project with no scopes, so make one for Memtro alone. Copy the sk-lf- secret key, shown once.

Can Langfuse start a job?+

Yes. Turn events on in the connection's Events tab on the Connections page, then add the address it shows as a webhook in Langfuse, choosing the same kinds; the tab shows Langfuse's own steps. A job set to start "When an event arrives" then runs once for each matching event, with the event as its input. The run treats the event as outside data, never as instructions, and anything the run remembers is kept as unverified.

Connect Langfuse in a few minutes

Seven-day free trial, then one monthly price per organisation. Connectors, jobs and memory are never metered.

Where agents remember your company

Sign in, add a provider key, create an API key and point your tools at Memtro. It takes about five minutes.

7-day free trial · card on file, nothing charged until it ends · cancel any time