Find out whether a paper can be reproduced

HumanStudy Hub for Mac rebuilds the study from its paper and lists what the paper does not state. Every item points back to the page of the original PDF it came from. A Windows preview is also available.

Version 0.6.11, released October 31, 2026. Release notes macOS 12 or later.

HumanStudy Hub with the study agent, the reconstructed study document and the original paper open side by side
Left to right: the study agent, the study document with page references, and the original paper with the cited sentence boxed.

Who it is for

Students and early PhDs reading an experimental paper
Read the twelve-section study document and compare each item with the PDF.
Researchers planning a replication or adaptation
Start from verbatim materials, the procedure and the missing-information list, and ask the agent for a preregistration draft.
Reviewers, editors and meta-scientists
Judge reporting completeness from the amber “not stated in the paper” items, each with page citations.
Teachers of research methods
Show the design and results as interactive charts, and run simulated participants on simple survey or vignette studies, clearly labelled as simulation.

The study, rebuilt from the paper

Open a PDF and the study agent writes a twelve-section study document: research questions and hypotheses, participants, design and conditions, the procedure with its materials transcribed verbatim, measures, the analysis plan and the reported results.

Each item carries the page it came from and how it was obtained: quoted verbatim, reported in the text, or derived from what the paper reports. Multi-study papers get one tab per study.

Study document for Ross, Greene and House (1977) with sections for paper overview, research questions and studies

What the paper leaves out is marked, not filled in

The question the app keeps asking is whether there is enough information to reproduce the study. Anything the paper does not state is shown in amber as not stated, with the decision it leaves open.

The agent does not invent a plausible assignment rule or a missing item wording. You record the decision yourself, or discuss it with the agent and keep the reasoning next to the item.

Two conditions marked Not stated in the paper, with the assignment rule open for a decision

Every item next to the page it came from

Compare source opens the original PDF beside the study document. Select an item and the quoted passage is boxed on its page.

It works the other way too: select a passage in the paper and the app lists every study item that cites it, so you can check a hypothesis, a measure and an analysis against the same sentence.

A passage selected on page 5 of the paper, listing the four study items that cite it

Charts of the design and the reported results

From the study document the app draws the sample flow, the procedure and the conditions, and charts the statistics the paper reports. Every value links back to its page. Spreads and counts the paper does not report are drawn as not reported rather than estimated.

Study overview for Study 1: sample sizes, a two-step procedure and four conditions, one step marked for checking
Study overview: sample, procedure and conditions.
Reported results: headline statistics and a bar chart of consensus estimates by the rater's own choice
Reported results, charted from Table 1 of the paper.

Simulated participants, labelled as simulation

Once the procedure is in place you can run it with LLM-simulated participants, each going through the materials in the order the paper describes. Use it to find instructions that read ambiguously or conditions that do not differ the way the paper intends.

Simulated responses are labelled as simulation everywhere they appear and are kept apart from the paper's human results. They are not data about people.

Simulation works best for simple survey and vignette studies. Complex interactive experiments are mapped and checked against the paper, not fully simulated.

Getting access

The app is in beta by invitation. You need a HumanStudy-Hub account and an invitation code.

  1. 1Create a HumanStudy-Hub account and confirm your email address.
  2. 2Ask the team for an invitation code. Contact details are on the Partnerships page.
  3. 3Install the app, sign in with your account, enter the code and accept the research-data agreement.

Requirements

System
macOS 12 Monterey or later, on Apple Silicon or Intel. Windows 10/11 (64-bit) as a preview.
First launch
Downloads the study assistant, about 170 MB, once.
Models
Hosted. No API keys or model accounts needed.
Sign-in
HumanStudy-Hub account, invitation code and research-data agreement.

Questions

Who can use the app?
The app is in beta. Anyone can create a HumanStudy-Hub account, and signing in to the app also needs an invitation code from the team.
Do I need an API key or a model subscription?
No. The study agent runs on hosted models through your HumanStudy-Hub account. There is nothing to configure.
What happens to the papers and studies I work on?
When you first sign in, the app asks you to accept a research-data agreement. It explains what is kept from your sessions and how the team may use it for research. Read it before you accept; you can stop there if you do not agree.
Are simulated participants a substitute for human data?
No. Simulated responses come from language models and are always labelled as simulation. They are useful for checking that the materials and procedure make sense to a respondent, not for estimating what people would do.
Why is there a download on first launch?
The app fetches its study assistant, about 170 MB, the first time it opens. Later launches use the copy on your Mac.
Is there a Windows version?
A Windows preview is available. It has not been tested on many machines yet and the installer is not code-signed, so Windows SmartScreen will warn on first run: choose “More info”, then “Run anyway”. Please tell us what breaks.
I started a study in the web builder. Where did it go?
Projects made in the browser are still in your web workspace.

Version 0.6.11, released October 31, 2026. Release notes macOS 12 or later.