Secret scanners cry wolf — what credible reporting looks like

A scanner that flags your anon key will be ignored when it matters. Calibration philosophy compared against regex-dump behavior.

2026-08-234 min read

What Naive pattern tools does well

they cast wide nets cheaply — useful for discovery triage at small scale.

Broad provider coverage quickly.
Low setup cost.

What Calibrated engines adds

dispositions separate public-by-design from secrets; entropy normalizes per alphabet; sample keys reject by name; low-confidence drops silently.

Every false positive trains teams to dismiss the next alert. Credibility compounds both directions — calibration choices decide whether scanning survives contact with real repos.

Fast triage on tiny codebases.

Trustworthy severity at volume.
Silence where silence is correct.
R
u
n
b
o
t
h
o
n
a
c
o
r
r
e
c
t
l
y
-
b
u
i
l
t
a
p
p
f
i
r
s
t
:
c
o
u
n
t
i
n
s
u
l
t
s
.
T
h
e
n
j
u
d
g
e
s
i
g
n
a
l
v
a
l
u
e
o
n
a
l
e
a
k
i
n
g
o
n
e
.

Using them together

Tuning fatigue already? Switch the engine, not the team.,Audit-grade evidence needed? Calibrated reports stand up.

Decision rule

Keep what already works for its stated strength.
Add KeyDrift when the deployed artifact itself needs watching.

Neither answer replaces the other; they watch different files at different moments. The mistake is believing one report covers both.

The bigger picture

Zoom out and the pattern is bigger than one repo. AI-assisted output has outgrown review capacity everywhere at once, which means thousands of teams are making the same reasonable-looking tradeoffs in the same week. Nobody using modern tooling is uniquely exposed. The failure mode documented above is the modal outcome of velocity without verification, not evidence of carelessness.

How KeyDrift reports this exact finding

Report anatomy matters during incidents, so it is worth reading once calmly: masked string (never the live value — it ceases to exist outside the detection engine), salted fingerprint (trackable within your workspace, useless to strangers), chunk path (your starting point for a "git log -S" hunt), disposition (secret versus public-by-design), confidence (matches below 0.5 never reach the page at all).

Manual check, step by step

The full manual drill, for readers who want zero dependence on any tool: open the deployed site in a private window; launch DevTools → Sources; use Search-all-files (Ctrl/Cmd+Shift+F) for eyJ; then repeat for the other marker families — eyJ, sk_live_, sk-proj-, AKIA, postgres, BEGIN PRIVATE KEY. Decode anything JWT-shaped before reacting, and classify public-by-design formats as expected guests rather than intruders.

Close the loop with monitoring

If you take one operational step from this page, make it this: put the URL under continuous monitoring (free tier covers one project daily). The first scan tells you whether you have a problem today; the schedule tells you whether the problem comes back next month after someone re-adds the convenient line.

What the plans change

Free $0 — 1 project · daily scans · email alerts · findings always visible.
Indie $29/mo — 3 projects · hourly · Slack added · 80 chunks per scan.
Team $89/mo — 15 projects · every 15 minutes · Discord + webhooks · 150 chunks.
Growth — from $249/mo, quoted display-only until checkout ships.

The constant across every tier: plans limit how much is watched, never what a scan found. Visibility is structural, not promotional — asserted by tests over the entitlements model itself.

Common questions

Is Naive pattern tools bad practice then?

No — the page credits exactly where it wins. Blind spots are structural, not sloppy.

Bottom line?

Add KeyDrift when the deployed artifact itself needs watching.

Run a free scan at keydrift.dev/scan — paste a URL or the bundle source itself, no account. Findings arrive masked, with the exact chunk they live in.