Thinksy EngineeringEngineering Effectiveness Report
FY2027 · Feb 2026 – Jan 2027Data through Oct 2026
← Thomas Tucker
Director of Engineering view

Engineering Effectiveness

AI spend and forecast, delivery, adoption and friction across the engineering organization.

Demonstration report. Thinksy's engineering organization, people, spend and results are synthetic.

Period
Organization
01

Executive summary

FY2027 to date

FY2027 AI spend forecast
$85,657
5% under budget · $90,000 budget · 61% spent to date
AI spend, FY2027 to date
$55,031
Run-rate $8,531/month
At-bats shipped
116
39 won (34%)
AI spend per at-bat
$474
Lower means cheaper experiments
Active AI users, Oct
24 of 24
100% adoption

Key findings

  • Spend is forecast to finish FY2027 at $85,657, 5% under the $90,000 budget.
  • Opus's share of AI spend fell from 68% in the first three months to 52% in the last three.
  • 116 at-bats shipped FY2027 to date (34% won), at $474 of AI spend per at-bat.
  • Harness practice gaps cost an estimated $15,109 (27% of spend) FY2027 to date, led by missed prompt-cache hits ($8,461).
  • Biggest friction point: test suite failure loops (Content Pipeline), 41 occurrences.
02

Spend and forecast

FY2027, cumulative · forecast to fiscal year-end

Cumulative AI spend, FY2027

Actuals through Oct 2026; forecast through Jan 2027 with an 80% range

  • Actual
  • Forecast
  • 80% range
  • FY budget
$0$50K$100KFebMarAprMayJunJulAugSepOctNovDecJanBudget $90K$86K

FY2027 forecast by team

Fiscal year to date, forecast for the remaining 3 months, and variance to budget

TeamFY to dateForecast, rest of yearFY totalFY budgetVariance
Jamie Park · Content & Media
Content Pipeline$6,065$3,629$9,694$10,200−$506
Video Rendering$8,923$5,241$14,163$15,600−$1,437
Social Publishing$5,128$3,104$8,233$7,200+$1,033
Subtotal$20,116$11,974$32,090$33,000−$910
Sam Okafor · Growth & Web
Growth & SEO$5,607$3,394$9,002$9,600−$598
Web Platform$6,739$5,056$11,795$11,400+$395
Data & Analytics$5,968$2,706$8,674$10,800−$2,126
Subtotal$18,314$11,156$29,470$31,800−$2,330
Robin Silva · Platform
Agent Platform$9,130$3,409$12,539$12,000+$539
Infrastructure$7,471$4,088$11,559$13,200−$1,641
Subtotal$16,601$7,497$24,098$25,200−$1,102
Total$55,031$30,627$85,657$90,000−$4,343
03

Spend breakdown

FY2027 to date, by month

AI spend by manager group

API list-price equivalent, from the LiteLLM gateway.

  • Content & Media (Jamie Park)
  • Growth & Web (Sam Okafor)
  • Platform (Robin Silva)
$0$5K$10K$2.1KFeb$3.2KMar$3.8KApr$6.1KMay$7.5KJun$6.7KJul$7.8KAug$8.6KSep$9.2KOct

AI spend by model

By model tier; teams move to each new version within weeks of release (table lists versions)

  • Opus
  • Sonnet
  • Haiku
  • Other
$0$5K$10K$2.1KFeb$3.2KMar$3.8KApr$6.1KMay$7.5KJun$6.7KJul$7.8KAug$8.6KSep$9.2KOct
04

Delivery and adoption

FY2027 to date

Prompt-cache hit rate
78%
Higher is cheaper
Tool error rate
3.0%
Failed tool calls
Sessions using subagents
50%
Work delegated to specialist agents
Headless (automated) runs
28%
Scripted and pipeline agent runs

At-bats by outcome

Shipped experiments with a measurable hypothesis

  • Hypothesis won
  • Didn't win (learned)
  • Still running
01020309Feb8Mar10Apr10May10Jun16Jul19Aug21Sep22Oct

How teams use agents

Share of sessions by type

  • Harness
  • Freeform
  • Code research
  • Documentation
  • Ideation
  • Ops
  • Presentation
Content PipelineVideo RenderingSocial PublishingGrowth & SEOWeb PlatformData & AnalyticsAgent PlatformInfrastructure
05

Friction

Where agents and engineers get stuck, FY2027 to date

Top friction points

From failed tool calls and retries

Test suite failure loops41Script approval rejected in review36Flaky end-to-end tests35Permission prompts on deploy35Missing env vars in preview34Context limit on large media modules33Lint failures after agent edits33Type errors after dependency bumps29
06

Harness practices and savings

FY2027 to date · estimated at list price

Savings opportunity by lever

$15,109 of $55,031 spend (27%) if every session followed the practices below

Improve prompt caching$8,461Right-size models$4,075Keep context lean$2,044Route commands through rtk$529

Engineers on target

Per practice, of engineers with data this period

  • rtk coverage · ≥ 80% of Bash calls1 of 24
  • Knowledge MCP use · ≥ 40% of sessions3 of 24
  • Cache hit rate · ≥ 85% of input4 of 24
  • Context past 100K · ≤ 10% of input21 of 24
  • Opus on routine work · ≤ 25% of routine spend2 of 24
  • Sessions using subagents · ≥ 30% of sessions24 of 24
  • Tool error rate · ≤ 4% of tool calls22 of 24

Practices by engineer

Grouped by team. Each cell shows the engineer's value against the target; open an engineer for their usage and recommendations.

EngineerrtkKnowledgeCacheContextModel fitSubagentsAI spendSavings opportunity
Content Pipeline
Avery · lead65%Needs attention31%Needs attention84%Needs attention9%On target41%Needs attention57%On target$2,277$549 · 24%
Blake60%Needs attention29%Needs attention77%Needs attention8%On target88%Off target53%On target$2,030$654 · 32%
Casey61%Needs attention30%Needs attention81%Needs attention9%On target42%Needs attention55%On target$1,758$395 · 22%
Video Rendering
Devon · lead1%Off target28%Needs attention81%Needs attention31%Off target43%Needs attention48%On target$3,203$1,038 · 32%
Emery1%Off target28%Needs attention83%Needs attention9%On target43%Needs attention46%On target$3,627$841 · 23%
Finley3%Off target30%Needs attention82%Needs attention9%On target40%Needs attention53%On target$2,093$383 · 18%
Social Publishing
Harper · lead65%Needs attention3%Off target83%Needs attention9%On target45%Needs attention47%On target$2,104$587 · 28%
Indigo61%Needs attention3%Off target82%Needs attention10%On target46%Needs attention47%On target$1,798$456 · 25%
Jules63%Needs attention8%Off target82%Needs attention9%On target41%Needs attention44%On target$1,226$269 · 22%
Growth & SEO
Jordan · lead61%Needs attention30%Needs attention79%Needs attention25%Needs attention81%Off target44%On target$2,407$1,005 · 42%
Kai62%Needs attention31%Needs attention72%Needs attention23%Needs attention41%Needs attention49%On target$1,791$844 · 47%
Lane66%Needs attention29%Needs attention86%On target7%On target38%Needs attention49%On target$1,410$324 · 23%
Web Platform
Logan · lead63%Needs attention30%Needs attention82%Needs attention8%On target41%Needs attention51%On target$2,651$569 · 21%
Marlo64%Needs attention32%Needs attention82%Needs attention8%On target44%Needs attention49%On target$2,284$543 · 24%
Noel3%Off target28%Needs attention67%Off target8%On target40%Needs attention52%On target$1,803$787 · 44%
Data & Analytics
Oakley · lead54%Needs attention30%Needs attention81%Needs attention8%On target48%Needs attention43%On target$2,199$741 · 34%
Parker61%Needs attention30%Needs attention80%Needs attention9%On target42%Needs attention45%On target$2,157$656 · 30%
Quinn65%Needs attention31%Needs attention66%Off target9%On target82%Off target49%On target$1,612$965 · 60%
Agent Platform
Reese · lead80%On target64%On target87%On target2%On target18%On target57%On target$3,515$398 · 11%
Riley77%Needs attention50%On target77%Needs attention10%On target31%Needs attention59%On target$3,254$966 · 30%
Rowan66%Needs attention31%Needs attention85%On target8%On target40%Needs attention61%On target$2,360$515 · 22%
Infrastructure
Sage · lead77%Needs attention51%On target88%On target4%On target21%On target53%On target$3,057$357 · 12%
Tatum63%Needs attention28%Needs attention79%Needs attention8%On target43%Needs attention52%On target$2,485$770 · 31%
Wren64%Needs attention28%Needs attention82%Needs attention9%On target41%Needs attention47%On target$1,929$497 · 26%
07

Team and engineer detail

Grouped by reporting line, not ranked

Engineers see their own row first; managers use it to find friction to remove. It is never used to rank people.

EngineerRoleSession mixSessionsTool calls / sessionSubagentsHeadlessTool errorsCache hitsAI spend
Content Pipeline · Jamie Park
AveryLead engineer
19133.957%31%2.4%79%$2,277
BlakeEngineer
18428.353%28%2.8%77%$2,030
CaseyEngineer
14631.455%31%2.1%80%$1,758
Video Rendering · Jamie Park
DevonLead engineer
20028.848%27%2.7%77%$3,203
EmeryEngineer
20427.246%25%2.9%79%$3,627
FinleyEngineer
12628.953%30%3.5%80%$2,093
Social Publishing · Jamie Park
HarperLead engineer
21129.147%26%3.2%78%$2,104
IndigoEngineer
18729.747%26%4.1%80%$1,798
JulesEngineer
13029.444%26%4.0%80%$1,226
Growth & SEO · Sam Okafor
JordanLead engineer
24129.644%26%3.0%78%$2,407
KaiEngineer
16731.049%28%2.8%68%$1,791
LaneEngineer
13929.749%27%3.3%80%$1,410
Web Platform · Sam Okafor
LoganLead engineer
20632.351%29%2.6%79%$2,651
MarloEngineer
16933.049%26%3.0%79%$2,284
NoelEngineer
13630.052%32%2.5%64%$1,803
Data & Analytics · Sam Okafor
OakleyLead engineer
17830.743%22%3.9%77%$2,199
ParkerEngineer
18528.945%26%3.3%77%$2,157
QuinnEngineer
14130.749%28%2.9%65%$1,612
Agent Platform · Robin Silva
ReeseLead engineer
18938.157%31%2.5%87%$3,515
RileyEngineer
18432.059%33%2.8%77%$3,254
RowanEngineer
15937.761%33%2.2%82%$2,360
Infrastructure · Robin Silva
SageLead engineer
20533.653%28%2.9%86%$3,057
TatumEngineer
15933.752%28%3.2%76%$2,485
WrenEngineer
13032.347%27%3.4%79%$1,929

Methodology

  • Spend comes from LiteLLM gateway logs and imported agent session history, priced at API list rates.
  • Forecast: a linear trend fitted to each team's last six months of spend, summed across teams and projected to Jan 2027. The shaded range is an 80% prediction interval, widened cumulatively.
  • Fiscal year FY2027 runs Feb 2026 through Jan 2027. Budgets are set per team at the start of the year.
  • Savings are estimates at list price: routine Opus work repriced at the Sonnet available at the time; uncached input moved to cache reads up to an 85% hit rate; rtk removing 70% of unfiltered command output, which stays in context for about half of the session's remaining turns; and half of the input beyond 100K context avoided by compacting. Levers overlap, so the total is an upper bound. rtk and the knowledge MCP are scored from their rollout (rtk May 2026, knowledge MCP Jun 2026).
  • Sessions are classified by usage type from the tools they used and the files they changed. At-bats are shipped initiatives with a measurable hypothesis.
  • Generated Oct 20, 2026, 7:46 AM.
Engineering Effectiveness Report (demo) · Thomas Tucker