medicinetalk

Add a note

Adam Johnson

What they did

Johnson presented to the OHDSI community how he uses Claude Code to develop transportable analytic code for prognostic modelling on OMOP data, constrained by a CLAUDE.md that enforces OHDSI conventions. The environment is a Docker template with the HADES stack and numbered workflow steps; concept IDs follow a three-tier lookup and are tagged "[vocab query]" or "[pretraining]". He also uses Claude Code as a "lab manager" to sync repositories, align studies with a shared template, validate setups, triage GitHub issues and edit Synthea modules.

In their words

"unconstrained LLMs actively undermine OHDSI standards."

"AI-generated IDs tagged [pretraining] with mandatory warning — never silently trusted"

"Instruction following is convention, not code"

Lessons they draw

  • Make the guardrailed path the default: a template repo and environment encode best practice from day one (Johnson).
  • Treat IDs the model produces from pretraining as untrusted; confirm against the live vocabulary and tag them (Johnson).
  • Stated limitations: instruction following is convention not code, and there is no automated concept-ID cross-validation against the live vocabulary (Johnson).
  • He asks whether instruction following is a sufficient enforcement mechanism for reproducible research (Johnson).

Limits of this account

Conference slides (some text from extracted PDF), no outcomes data; the speaker frames the approach as "a working answer" and unsure if it is "the right one".

Search the collection

↑ ↓ move · Enter open · Shift+Enter original source · Esc close · Search index for agents

Keyboard shortcuts

Single keys work when you are not typing and no dialog is open. Turn them off if stray key presses move the page. ⌘K / Ctrl+K and Esc keep working.

/
Search the collection
⌘K / Ctrl+K
Open or close search
?
Show these shortcuts
h
Home
l
Lessons
a
Accounts
r
Replications
p
Papers
g
Guides and tools
d
Timeline
b
Bookmark the record you are reading (press again to remove it)
s
Your saved list and notes
← →
Previous and next record on an account, lesson, replication or paper page, and in a quick look
m
Switch between system, light and dark theme
t
Back to the top of the page
Open full page