economicsinterview

Add a note

Scott Cunningham

What they did

In an interview written up by Aniket Panjwani, Cunningham describes a public collaboration with Caitlin Myers (Middlebury) on a new paper that is ideated, conceptualised and written with Claude Code. Claude Code collected and merged the data. Myers, more cautious than Cunningham about trusting the output, had a former student, Hannah Sayer, act as RA and check independently what Claude had done. She found errors in the raw data, such as wrong county names or words in Excel files; as the interviewer understood it, they did not change the substantive results much.

In their words

These are the interviewer's sentences, not Cunningham's.

"try to verify independently everything Claude was doing in collecting data, merging it, and so on."

"you can only work with AI to the extent of your level of understanding."

Lessons they draw

  • Two collaborators differed in how far to trust the agent; an independent human check was the response (Panjwani, describing Cunningham and Myers).
  • Knowledge of econometrics matters more, not less, because you can only work with the agent to your level of understanding (Panjwani, summarising Cunningham).
  • Repeated manual checks can be turned into skills and sub-agents (Panjwani's suggestion to Cunningham, not Cunningham's claim).

Limits of this account

Secondary: the page is the interviewer's reflections; the full video and transcript were not read. No model or Claude Code version stated. Cunningham's own Substack posts on referee reports and data work are paywalled (preview only), so they are not used. This is the only account in the batch where verification of the agent's data work by a second human is reported, but no error counts are given.

Search the collection

↑ ↓ move · Enter open · Shift+Enter original source · Esc close · Search index for agents

Keyboard shortcuts

Single keys work when you are not typing and no dialog is open. Turn them off if stray key presses move the page. ⌘K / Ctrl+K and Esc keep working.

/
Search the collection
⌘K / Ctrl+K
Open or close search
?
Show these shortcuts
h
Home
l
Lessons
a
Accounts
r
Replications
p
Papers
g
Guides and tools
d
Timeline
b
Bookmark the record you are reading (press again to remove it)
s
Your saved list and notes
← →
Previous and next record on an account, lesson, replication or paper page, and in a quick look
m
Switch between system, light and dark theme
t
Back to the top of the page
Open full page