Thinksy EngineeringEngineer usage detail
FY2027 · Feb 2026 – Jan 2027Data through Oct 2026
← Engineering Effectiveness report
Agent Platform · Robin Silva

Reese

Lead engineer · AI usage, harness practices and where spend could have gone further.

Demonstration report. This engineer and their usage are synthetic.

This page is for the engineer and their manager to find cheaper defaults and harness fixes. It is never used to rank people.

Period
01

Summary

FY2027 to date

AI spend
$3,515
189 sessions · $19 each
Savings opportunity
$398
11% of spend, at list price
Practices on target
7 of 7
All measured practices on target
Cache hit rate
87%
Team 84% · org 82%
02

Where spend could go further

FY2027 to date · estimated at list price

Savings opportunity by lever

$398 of $3,515 spend

Improve prompt caching$252Right-size models$111Keep context lean$27Route commands through rtk$9

What to change

Largest saving first

  1. Improve prompt caching$252

    Cache hit rate 87% against an 85% target.

    Keep stable context at the front of prompts and avoid switching models mid-session, so 85% of input reads from cache.

  2. Right-size models$111

    18% of routine spend ran on Opus: code research $72 of $434, documentation $70 of $359, ops $117 of $618, presentation $14 of $86.

    Run docs, decks, ops and read-only research on Sonnet instead of Opus.

  3. Keep context lean$27

    2% of input tokens were past 100K of context.

    Compact or /clear between tasks instead of carrying more than 100K tokens of context.

  4. Route commands through rtk$9

    80% of 2,156 Bash calls ran through rtk; 2.8M tokens of command output went into context.

    rtk compacts test, build, git and search output before it reaches the model (about 70% smaller).

03

Harness practices

Compared with Agent Platform and the organization

PracticeReeseTeamOrgTargetRecommendation
rtk coverage80%On target74%56%≥ 80% of Bash callsOn target
Knowledge MCP use
15 findings saved back
64%On target48%30%≥ 40% of sessionsOn target
Cache hit rate87%On target84%82%≥ 85% of inputOn target
Context past 100K2%On target6%10%≤ 10% of inputOn target
Opus on routine work18%On target29%44%≤ 25% of routine spendOn target
Sessions using subagents57%On target59%50%≥ 30% of sessionsOn target
Tool error rate2.5%On target2.5%3.0%≤ 4% of tool callsOn target

Practices by month

Is the engineer moving toward the targets?

MonthrtkKnowledgeCacheContextModel fitSubagentsSavings opportunity
Feb 2026––70%Needs attention4%On target24%On target47%On target$52
Mar 2026––75%Needs attention2%On target24%On target40%On target$76
Apr 2026––81%Needs attention2%On target24%On target36%On target$69
May 202629%Off target–80%Needs attention3%On target21%On target44%On target$132
Jun 202663%Needs attention20%Needs attention82%Needs attention1%On target20%On target64%On target$29
Jul 202698%On target51%On target90%On target3%On target15%On target56%On target$13
Aug 202696%On target71%On target93%On target4%On target14%On target62%On target$8
Sep 202697%On target79%On target93%On target2%On target11%On target55%On target$14
Oct 202690%On target71%On target93%On target0%On target9%On target78%On target$5
04

Usage

FY2027 to date

AI spend by model

By model tier, by month

  • Opus
  • Sonnet
  • Haiku
  • Other
$0$500$1K$167Feb$317Mar$423Apr$835May$283Jun$334Jul$257Aug$494Sep$404Oct

AI spend by session type

Routine types (documentation, presentation, ops, code research) rarely need Opus

Harness$1,372Freeform$518Code research$434Documentation$359Ideation$128Ops$618Presentation$86

Tokens by model

Cache reads are billed at a fraction of uncached input; a high share is what good caching looks like

ModelRequestsUncached inputCache readsCache writesOutputSpend
Opus 5.51,8241M97.6M6.3M2.2M$100
Opus 51,4981.2M88.8M5.7M2.4M$147
Opus 4.81,2975.9M63.4M4.4M1.8M$135
Opus 4.63,62933.7M172.8M13.2M5.7M$480
Opus 4.51101.5M4.3M371K153K$16
Sonnet 5.510,4325.8M542.8M35M12.8M$282
Sonnet 513,78113.5M728.5M47.4M20.9M$751
Sonnet 4.618,434141.5M796.9M59.9M26.2M$1,281
Sonnet 4.571011M32.8M2.8M1.1M$70
Haiku 5.510,6086M561.2M36.2M16.3M$19
Haiku 4.510,59151.7M534.8M37.4M15.2M$228
GPT Realtime (meetings)98557K4.5M325K144K$8
Total73,012273.5M3628.5M249.1M105.1M$3,515

Methodology

  • Spend and tokens come from LiteLLM gateway logs and imported agent session history, priced at API list rates.
  • Savings are estimates: routine Opus work repriced at the Sonnet available at the time; uncached input moved to cache reads up to an 85% hit rate; rtk removing 70% of unfiltered command output, which stays in context for about half the session's remaining turns; and 50% of input past 100K context avoided by compacting. Levers overlap, so the total is an upper bound.
  • rtk and the knowledge MCP are scored from their rollout (rtk May 2026, knowledge MCP Jun 2026).
  • Generated Oct 20, 2026, 7:46 AM.
Engineer Usage Detail (demo) · Thomas Tucker