Nature 655, 487–496 (page range taken from the running footers)
Accelerating scientific discovery with Co-Scientist
Co-Scientist (Gottweis et al., Nature, 2026)
What the paper does
A Google group (with collaborators at Stanford, Houston Methodist, Imperial and Sequome) describes Co-Scientist, a multi-agent system built on Gemini 2.0 that takes a research goal written in natural language and returns ranked research hypotheses and proposals. Agents have separate jobs: Generation, Reflection (acts as peer reviewer, with web search), Ranking (runs an Elo tournament of pairwise "scientific debates"), Proximity (clusters similar ideas), Evolution (writes new hypotheses from the best ones; it does not edit existing ones) and Meta-review (summarises recurring review criticisms and appends them to the other agents' prompts). A Supervisor agent schedules them on a task queue. Scientists can supply ideas, reviews and feedback through a chat interface.
It was asked to do three things, all in biomedicine: propose repurposing candidates, and combinations, for acute myeloid leukaemia (AML); propose epigenetic targets for liver fibrosis; and explain how capsid-forming phage-inducible chromosomal islands (cf-PICIs) spread across bacterial species.
Results worth quoting
Computational evaluation (Fig. 2, Extended Data Figs 1–2).
- 203 research goals: Elo ratings of the system's hypotheses rise across ten time buckets (Fig. 2a). The Elo is produced by the system's own Ranking agent. Extended Data Fig. 1 states that it "is auto-evaluated and not based on independent ground truth".
- 15 expert-written goals (seven biomedical experts): Co-Scientist's Elo ends above Gemini 2.0 variants, o1, o3-mini-high, DeepSeek R1 and the experts' own "best guess" answers (Fig. 2b), again on the system's own Elo.
- 11 of those goals, blinded human experts: preference ranks Co-Scientist 2.36 against 2.45, 2.45 and 2.73 for the three other systems (my reading of Fig. 2c; which value belongs to which system is not in the extracted text). Novelty 3.64 and impact 3.09 out of 5. With four systems, 2.5 is the chance mean, so the margin is narrow. The authors write "These evaluations reflect subjective expert assessments, not objective ground truth" and call the evaluation small-scale.
- Four LLM judges also preferred Co-Scientist (Extended Data Fig. 2).
Wet-lab checks (Figs 3–4, Extended Data Figs 3–6). All in cell lines, biological triplicates (n = 3), unblinded.
- AML, existing evidence. Thirty top-ranked candidates went to oncologists, who chose five for testing: binimetinib, pacritinib, cerivastatin, pravastatin, dimethyl fumarate. Three inhibited viability. Pravastatin and dimethyl fumarate showed little or no effect on MOLM-13 (Extended Data Fig. 4).
- AML, single agents proposed without prior preclinical evidence. Experts chose three of the ranked list: nanvuranlat, KIRA6, leflunomide. Only KIRA6 was active in several lines (IC50 10 nM in KG-1a, 180 nM in the non-AML control TK6, 1,750 nM in MOLM-13). Nanvuranlat and leflunomide had limited effect on MOLM-13. The text calls this "without oversight", yet experts selected which three to test.
- AML combinations. Seven combinations tested in MOLM-13 and KG-1a. MOLM-13 responses "predominantly synergistic"; KG-1a a mixture of synergy and antagonism (Fig. 4, Extended Data Table 2).
- Liver fibrosis. Experts picked three top-ranked hypotheses; the system named three epigenetic modifiers and drugs; two showed significant anti-fibrotic activity in human hepatic organoids without toxicity, one of them vorinostat (already approved for another cancer). Details are in a separate paper (ref. 1) and the Supplement.
- cf-PICIs. The group that had made the unpublished finding set the question. The system's top-ranked hypothesis, that cf-PICIs interact with diverse phage tails to expand host range, matched the experimental result, "in just 2 days" against years of laboratory work. The match was judged by the same group; no outside blind assessment is described.
Not in the main text. I found no baseline for the wet-lab hit rate (for example random drugs or expert-picked drugs), and no count of hypotheses produced against those tested beyond the figures above.
What the humans did. Wrote the goals (under 1 h of a clinician's time for the AML prompt); reviewed the ranked output and chose what to test (about 3 h for AML); suggested constraints (2,300 approved drugs across 34 cancers); ran all experiments. The authors say experts' time at both ends was comparable across the three studies.
The authors' own caveats
- Validation "remains preliminary"; the cell-line experiments are "a viability check", not a replacement for preclinical and clinical assessment, and an in vitro result does not "guarantee in vivo efficacy or clinical success".
- Reliance on open-access literature may omit paywalled work and gives "a systemic lack of access to negative experimental results". Mixed-quality sources create "a risk of propagating erroneous or irreproducible findings". They propose agents that trace claims to figures or data in a source.
- Inherited limits of the underlying models: "imperfect factuality and the potential for hallucinations". Rates of hallucinated or wrong hypotheses are not given in the main text.
- Possible homogenising of research directions and reduced critical thinking; misuse without peer review could worsen the reproducibility crisis.
- The Methods flag the worked ALS example as possibly containing errors, to be "interpreted with utmost caution".
- Reproducibility: the code is not public ("deep integration ... with proprietary internal infrastructure"); prompts and pseudocode are in the Supplement; access is through an experimental programme. Most authors are Alphabet employees and the study was funded by Alphabet. The reporting summary says all in vitro and computational replications "were successful" and no data were excluded; that is about assay and run repeats, not about how many hypotheses worked.
- A small inconsistency worth knowing: the reporting summary says 11 goals were used for LLM-judge preference; the main text says 15 goals for LLM judges and 11 for human experts. Fig. 3e prints an IC50 of 0.01 µM with a 95% interval of 0.012–0.081 µM, which does not contain the point estimate (probably a typographical error; not resolved).
Ideas that travel beyond biomedicine
- Output must be checkable (supports). Every hypothesis comes with a testable proposal and the key claims were tested at the bench. The system's own review uses literature search: without it, the Reflection agent scored known-non-novel ideas at 6.14 out of 10 for novelty; with it, 2.38 (Methods, ablation analysis).
- External checks the agent cannot alter (complicated). The bench and the blinded experts are external. The headline "quality improves with compute" curves are not: the Ranking agent that produces the Elo is part of the system, and the Meta-review agent feeds its critique back into the generators. The wet-lab step also sat after a human selection step, so the agent could not alter which drugs were tested, but experts could.
- "Done"/"verified" as claims (supports). The system attaches self-generated novelty reviews to each hypothesis (for example for KIRA6, "moderate novelty"); the authors judge it "reasonably well calibrated" from one example. Deep verification splits a hypothesis into sub-assumptions and checks each; that is a self-check, and its error rate on real hypotheses is not reported.
- Silent omission (supports, strongly). The authors name the main omission themselves: negative results and paywalled papers are not visible to the system. Candidates that failed (pravastatin, dimethyl fumarate, nanvuranlat, leflunomide) are reported, which is good practice; the untested remainder of the ranked lists and the hypotheses discarded by the tournament are not described.
- Councils and multiple agents (supports, with small effects). The ablation numbers are modest: Evolution lifted GPQA precision from 70.9% to 75.4%; Meta-review lifted the AUC for predicting a correct answer from 0.521 to 0.597 on the authors' constructed set (0.629 to 0.634 on GPQA diamond). An AUC of 0.521 is close to chance. All agents are one model family (Gemini 2.0). The debate prompt in the Ranking agent reduced positional bias. Other vendors' models appear only as baselines and judges.
- Disclosure (partly). Authors disclose employment and funding, and the human time spent. They do not give the failure rate of the hypothesis stream, and the system is not available for others to rerun.
Limits for our purposes
Large-lab, proprietary system, biomedicine, and a single model family. The three real-world cases each involved senior domain scientists who chose goals and candidates, so the paper shows a hypothesis generator under expert supervision, not an autonomous researcher. The most striking claim (the two-day recapitulation) was judged by the group that already knew the answer. Little here transfers to qualitative or humanities research; the transferable parts are the tournament-and-review pattern, the human selection step and the authors' list of what the system cannot see.