Skip to content
Back to blog
AI Development 6 min read

The cost of invisible AI: why token tracking matters


Your engineering team uses AI tools. This is not a prediction; it is a statistical certainty. Developers adopt AI assistants faster than any previous category of tooling. The question is not whether your team uses AI. The question is whether you know what it costs.

Most organizations cannot answer that question. Individual developers expense subscriptions. Usage-based APIs bill to personal accounts or shared credit cards. The monthly invoice shows a number with no attribution to projects, teams, or outcomes.

This invisibility creates three problems that compound over time.

Problem 1: Uncontrolled spend growth

AI costs scale with usage. A developer who executes 50 prompts per day costs more than one who executes 5. Neither number is inherently wrong. The developer executing 50 might be shipping faster. But without visibility, you cannot distinguish productive usage from wasteful usage.

Teams report 40-60% month-over-month growth in AI spending during initial adoption phases. Some of that growth reflects genuine productivity gains. Some reflects inefficient prompting, unnecessary iterations, or recreational experimentation. Without attribution, you cannot tell the difference.

Problem 2: Misaligned incentives

When AI costs are invisible, developers optimize for convenience rather than efficiency. Why write a precise prompt when you can iterate through five vague ones? Why reduce context when adding more tokens does not affect your budget?

This is not developer laziness. It is rational behavior in a system without feedback loops. Developers receive no signal about cost, so they cannot optimize for it.

Problem 3: No ROI measurement

Engineering leaders increasingly face questions about AI ROI. "We spend X on AI tools. What do we get for that?" Without attribution, the answer is a shrug.

You cannot measure the productivity impact of AI if you cannot connect AI spend to outcomes. You cannot justify increased investment. You cannot identify which projects benefit most. You cannot allocate resources intelligently.

Token-level cost attribution

JuhJuh tracks AI costs at the token level, attributed to specific tickets, projects, and teams. Every execution logs:

  • Input tokens: The size of the prompt sent to the model
  • Output tokens: The size of the response generated
  • Model: Which AI model processed the request
  • Duration: How long the execution took
  • USD cost: Computed cost based on model pricing

This data aggregates across multiple dimensions:

Organization total: $4,847.23 (Feb 2026)
  Project: hanhaa-portal     $2,156.41
    Team: Backend            $1,423.89
    Team: Frontend           $732.52
  Project: internal-tools    $891.77
  Project: data-pipeline     $1,799.05

Every dollar is traceable to a ticket. Every ticket is traceable to a project and team. Engineering leaders see exactly where AI spend concentrates.

What visibility enables

Informed budget allocation

When you know that the data pipeline project consumes 37% of AI spend, you can ask useful questions. Is that project proportionally important? Is the team using AI efficiently? Should we invest more there, or optimize usage?

Prompt efficiency feedback

Token counts reveal prompt quality. A ticket that consumes 50,000 input tokens suggests either a large codebase context (appropriate) or prompt bloat (wasteful). Teams can identify patterns and improve.

Project-level ROI calculation

With spend attributed to projects, you can correlate cost with outcomes. A project that shipped 47 tickets for $1,200 in AI spend shows different economics than one that shipped 12 tickets for $800. Both numbers matter for planning.

Team benchmarking

Teams doing similar work should have similar cost profiles. Large variances suggest either efficiency opportunities or different working patterns worth understanding.

The dashboard view

JuhJuh surfaces cost data in the project analytics dashboard. The default view shows:

  • Spend over time: Daily/weekly/monthly trends
  • Spend by source: Breakdown by AI model (Claude, GPT, etc.)
  • Spend by ticket type: Feature vs. bug vs. refactor
  • Top tickets by cost: Which work consumed the most resources

This is not about penny-pinching. It is about visibility. Engineering leaders need data to make decisions. "We should invest more in AI" is a different conversation than "We should invest more in AI, and here is where the current spend delivers value."

Implementation patterns

Pattern 1: Monthly AI budget reviews

Include AI costs in monthly engineering reviews alongside headcount and infrastructure. Treat AI spend as a resource to optimize, not an uncontrolled externality.

Pattern 2: Project-level cost alerts

Set thresholds per project. If a project exceeds expected AI spend, investigate. The variance might be justified (complex work) or indicate inefficiency.

Pattern 3: Prompt efficiency training

Use cost data to identify training opportunities. If one team consistently achieves lower cost-per-ticket, study their prompting patterns and spread that knowledge.

Pattern 4: ROI reporting to leadership

Build quarterly reports connecting AI spend to outcomes: tickets completed, cycle time improvements, quality metrics. Make the value visible to stakeholders who approve budgets.

The broader point

AI-assisted development is already a significant line item for engineering organizations. That spend will grow. The question is whether it grows with visibility and intention, or whether it grows in the dark.

Invisible costs are unmanaged costs. Unmanaged costs grow faster than managed ones. The first step to controlling AI spend is knowing what you spend: per project, per team, per ticket.

JuhJuh makes this data available by default. Every execution carries its cost. Every dashboard shows the numbers. Engineering leaders get the visibility they need to make informed decisions.

Your team uses AI. Now you can see what it costs.

See this in action.

The features described in this post are live in JuhJuh. Get started and explore the pipeline yourself.

Get started

Share this post
Post Share

From idea to pull request.

From reading to building. Get started on your first orchestrated pipeline.

JuhJuh uses cookies

By clicking “Accept all”, you agree to the storing of cookies on your device for functional, analytics, and marketing purposes. Only essential cookies are turned on by default. Cookie Policy

Essential

Required for the site to function

Analytics

Help us improve the product

Marketing

Personalized content and ads