Weekly spend check
Sarah Chen, engineering manager at BigCo, asked what the LLM spend was this week. Memtro read the usage by model with errors and successes. She saw which model drove the cost and raised it in planning.
Lunary + Memtro
What was our LLM spend this week, and which runs got thumbs down?
Lunary connects Memtro to your LLM observability project. It reads runs, meaning LLM calls, traces and threads, by type, model, tag and time, with status, duration, tokens, cost and feedback. It also reads token and cost usage by day and model, prompt templates with their versions, and evaluation datasets. When asked and granted, it can tag, rate and score runs, create, version, publish or delete templates, and create, fill or delete datasets. A key belongs to one project, so each project is connected separately. Prompt, reply and error text are never returned.
In Memtro
What you can do with Lunary in Memtro
Ask in plain English from chat, your editor, a scheduled job or your own agent. The model picks the right Lunary tool, reads what it needs, and answers with the source cited.
What it does
- 01Runs by type, words, model, tag and time, with status, duration, tokens, cost, template and thumbs feedback.
- 02One run's metadata and trace, without the prompt, reply or error text.
- 03Token and cost usage over the last days, by model or by day, with errors and successes.
- 04Prompt templates with their versions, draft or live, and evaluation datasets with item counts.
- 05When asked and granted, tags, rates or scores a run, visible to everyone in the project, and creates, fills or deletes datasets.
- 06When asked and granted, creates a prompt template or version, or publishes a draft, which apps fetching the latest version receive, and permanently deletes a template.
Acts when asked
When you ask it to
These tools change something in Lunary. The model is told to use them only when you ask for exactly that, and an administrator grants each one by name to the teams that may use it; a personal connection acts only after its owner allows it.
- 01Add tags to a run
- 02Give a run thumbs up or down feedback
- 03Score a run
- 04Create a prompt template
- 05Add a version to a prompt template (a draft unless you publish it)
- 06Publish a draft template version, making it live
- 07Delete a prompt template (permanent)
- 08Create a dataset
- 09Add an item to a dataset
- 10Delete a dataset (permanent)
In practice
Ask it like you would a colleague
Once Lunary is connected, these are the kinds of things people ask. Plain questions, no syntax. If the answer lives partly in another system you have connected, Memtro looks there too.
Lunary + MemtroWhat was our LLM spend this week, by model?
Which runs got thumbs down yesterday?
Which versions of the support reply template are live?
How many items are in the regression dataset?
Tag that run as needs-review.
Template goes live
Tom Reilly, AI engineer at Northwind, asked Memtro to publish the reviewed draft of the support reply template. With the action granted, Memtro published it. Every app fetching the latest version received it from then on.
Teams
Where it fits
The teams that lean on Lunary most, a question each of them asks, and what they connect beside it.
- EngineeringKeep decisions from evaporatingEngineer, Tech lead, On call, New joiner“Who owns the billing migration, and what did we decide about retries?”Used alongside GitHub, Linear, Jira, Confluence, Slack and 5 more.
- ProductHear what customers actually ask forProduct manager, Researcher, Designer, Head of product“Which customers asked for SSO this quarter, and what is their combined ARR?”Used alongside Help Scout, HubSpot, Linear, Jira, Slack and 6 more.
- Agent buildersMemory and tools for the agents you buildSolo builder, Platform team, Automation engineer, Whoever signs it off“Search memtro for what we know about Acme before drafting the proposal”Used alongside GitHub, Linear and Slack.
Better together
Works with
A record in Lunary is rarely the whole story. Connect the systems that hold the rest and Memtro checks them together, then remembers what it learned so the next question starts further along.
- Work managementLunary with JiraJQL search, issue details and projects from Jira Cloud.
- Work managementLunary with Clio ManageAsk the matter: its client, its fee earner, the time on it and what is still unbilled.
- Work managementLunary with LinearIssues, projects and teams, synced hourly into memory.
- SupportLunary with Help ScoutAI that reads your support conversations and cross-references the customer everywhere else.
- SupportLunary with ZendeskEvery ticket, reply and internal note, ready to be asked about.
- SupportLunary with IntercomCustomer conversations and the people behind them, in your company memory.
- Documents and wikisLunary with NotionSearch pages and query databases, and write to them when you ask.
- Documents and wikisLunary with Google DriveSearch Drive and read Docs, Sheets and Slides as text, and write a Doc when you ask.
- Documents and wikisLunary with ConfluenceSearch and read wiki pages, and write them when you ask.
Also in Engineering and operations
Using something else for the same job, or both? Each connector has its own tools; connect as many as you like.
- GitHub
- AWS CloudWatch
- Sentry
- ServiceNow
- Okta
- Twilio
- AWS CloudTrail
- GitLab
- Bitbucket
- Vercel
- PagerDuty
- Datadog
- Grafana
- incident.io
- Azure DevOps
- CircleCI
- Cloudflare
- LaunchDarkly
- New Relic
- Rollbar
- Snyk
- Better Stack
- Buildkite
- DigitalOcean
- Heroku
- Netlify
- SonarQube Cloud
- Statuspage
UptimeRobot- Axiom
- BugSnag
- Checkly
- Hetzner Cloud
Honeycomb- Pingdom
- Render
- Statsig
- Sumo Logic
- Supabase
- HCP Terraform
- Vultr
- Airbrake
- Codecov
Cronitor- Dynatrace
FireHydrant- Fly.io
- Honeybadger
- Akamai Linode
- Octopus Deploy
- Pulumi
- Rootly
- Semgrep
- Splunk
StatusCake- Tailscale
- Argo CD
- authentik
- Coolify
- Gitea
GlitchTip
GLPI- Jenkins
Langfuse
LibreNMS- n8n
NetBox- Portainer
- Prefect
Snipe-IT
Woodpecker CI
Zabbix
LangSmith
Helicone- OpenAI (usage and cost)
- Anthropic (usage and cost)
- Algolia
- Flagsmith
- Unleash
GrowthBook
Drata
Intruder
GitGuardian
Secureframe
ilert- KnowBe4
JumpCloud
ConfigCat- Railway
- Fastly
- Postman
- Make
- Braintrust
- OpenRouter
- ElevenLabs
Split- Scaleway
Aikido Security- AssemblyAI
Astronomer- Bamboo
- Baseten
- Bitrise
- Bitwarden
- BrowserStack
- bunny.net
- Cachet
- Checkmk
- Civo
- Cloudsmith
- Codacy
- Codemagic
Comet Opik- Coralogix
CrowdStrike Falcon- Dagster+
- DeepSource
Detectify- Docker Hub
Domotz- Grafana OnCall
- Harness
- Hugging Face
- Instatus
- Koyeb
- Lambda Cloud
LambdaTest
LangWatch
LlamaCloud
Logz.io- Mezmo
NinjaOne- Nomad
Northflank- Oh Dear
- OVHcloud
Portkey- Probely (Snyk API & Web)
PromptLayer- Proxmox VE
PRTG Network Monitor- Qase
Raygun
Retell AI- Retool
Runpod- SecurityScorecard
- Semaphore CI
Shodan- SigNoz
- Socket
Spike.sh
Squadcast- SwaggerHub
- TeamCity
Tenable- Together AI
- Travis CI
UpGuard
Uptime.com
Vanta- Vapi
- Windmill
Zenduty- OpsLevel
Cortex- Auth0
- Clerk
WorkOS
Kandji
Automox
Huntress- HackerOne
SimpleMDM- AppSignal
Healthchecks.io
Rapid7 InsightVM- 1Password Events
- JFrog Artifactory
- Sauce Labs
Zenhub- Deepgram
- Replicate
Setup
How to connect
Connect withPrivate API key
- 1
In Lunary, open Settings → API keys and copy the project's private key. The public key only sends data and cannot read.
- 2
In Memtro, open Connections → Lunary and paste the Private API key. For a self-hosted Lunary, add the API host.
- 3
An administrator grants the actions by name, such as Publish a draft template version, to the teams that may use them.
- 4
Ask "What was our LLM spend this week?"
Also works from
Chat in the dashboard, the OpenAI-compatible API, scheduled jobs, and any MCP client: Claude Code, OpenCode, Cursor, Claude Desktop. The Lunary tools are the same everywhere.
FAQ
Questions
Can Memtro change anything in Lunary?+
Only when you ask, and only what it has been granted: add tags to a run; give a run thumbs up or down feedback; score a run; create a prompt template; add a version to a prompt template (a draft unless you publish it); publish a draft template version, making it live; delete a prompt template (permanent); create a dataset; add an item to a dataset; delete a dataset (permanent). Every other tool reads, searches or lists. The Connections page labels the tools that act, an administrator grants each one by name to the teams that may use it, and a personal connection acts only after its owner allows it.
Who can use a Lunary connection?+
A personal connection serves only your own requests. A shared connection serves the organisation: everyone, or only the teams an admin chooses. Admins can always add shared connections; other members need the permission.
Does Memtro store my Lunary data?+
Credentials are encrypted at rest. Tool results are cached briefly so agent loops do not repeat identical calls, and the facts the model extracts are saved to your organisation's memory with provenance (system, record and link) so they can be checked and superseded.
How do I connect Lunary?+
Private API key. In Lunary, open Settings → API keys and copy the project's private key. The public key only sends data and cannot read.
Connect Lunary in a few minutes
Seven-day free trial, then one monthly price per organisation. Connectors, jobs and memory are never metered.