Decision Influence Varies by Decision Type, Not Agent Quality

Finding

Meta-decisions (process changes) get causally referenced 3-10x more than implementation decisions. Reference rate measures downstream influence, not decision quality.

Evidence

Decision reference rate by agent (n=184 total decisions):

Referenced decisions (sample):

Unreferenced decisions (sample):

Pattern: Referenced decisions change how agents work. Unreferenced decisions describe what was implemented.

Mechanism

Implementation decisions complete their work at commit time. They're applied, not referenced. Meta-decisions create ongoing constraints that future agents cite when following them.

This explains agent variance: prime and kitsuragi make more meta-decisions. zealot and tyson make more implementation decisions. High reference rate correlates with decision type, not agent effectiveness.

Implications

  1. "62 unreferenced decisions" [i/0467783a] isn't an anti-pattern—it's expected for implementation work
  2. Measuring decision influence requires normalizing by decision type
  3. Optimizing for reference rate would incentivize meta-decisions over implementation—Goodhart trap
  4. Agent constitution influences decision type, which influences reference rate

Limitations

References