All dimensions

Detection dimension · weight 3%

Stylometric Analysis

What this dimension detects

Stylometric fingerprints capture sentence length, Markdown usage, punctuation density, and bullet patterns — a coarse but cheap signal that survives even when logprobs are stripped.

Algorithm

Compute 8 features per response, average over ≥ 3 samples, and cosine-compare to per-model centroids stored in lib/fingerprints/. The best match is reported alongside the claimed model's score.

Thresholds

ConditionVerdict contribution
Best match = claimed modelMatch
Best match within 0.05 cosine of claimedBorderline
OtherwiseMismatch

Limitations

Highly sensitive to prompt phrasing. Use ≥ 3 stable prompts and the same temperature across calls.

References

  • TrueLLMs lib/identity-audit/index.ts analyzeStylometry

Back to the full methodology