W1 · From clinical case to testable question
Guiding question
How many independent observations do we actually have, and which question can they answer?
After a fictitious wrist injury there is one radiograph, two readings and several measurements. Before anyone fits a model, the team has to agree on what is being claimed, about whom, at what time and compared with what.
Learning objectives
By the end of this workshop you can
- formulate a descriptive, a prognostic and a causal question about the same material and name the decision each one would support;
- state purpose, target population, reference standard, time zero and independent unit for a clinical question;
- count people, images and readings in a table by hand and in R, and locate an identifier error and a unit error;
- write a data dictionary with key, unit, time zero and reason for collection;
- distinguish training data from application data for a rule and for a learnt threshold;
- draw a data flow for care, research and teaching, and justify removing every field the teaching table does not need.
Preparation
- Required reading (about 20 minutes): B01 · Clinical decisions and the translational chain – core reading and B03 · How data arise: missingness and denominators – core reading.
- Before the session: install R (any version from 4.4) and, if you like, RStudio or Positron. Open
r/w1-case-table.Ronce. If anything fails, bring the printed lab page; a partner computer is enough. - Bring: paper and a pen. Unit 01 starts without a screen.
The case
A 52-year-old cyclist falls on an outstretched hand. In the emergency department the wrist is swollen and tender. A radiograph is taken and read twice: once by the emergency team, once by radiology. Two days later a follow-up image is taken. A research group wants to use such cases to develop a fracture alert; a lecturer wants to use them in a course.
Everything in the case and in the tables is synthetic. Any similarity to a real person is coincidental.
Teaching units
| Unit | Task | Minutes | Observable evidence |
|---|---|---|---|
| 01 | Entry self-assessment (5 min, below). Trace the patient’s pathway and the research question. Fix target, time point and addressee of a prediction. Formulate a descriptive, a prognostic and a causal question about the same material. | 45 | A case card with three question types, each with population, time zero and the decision it supports. |
| 02 | Count people, images and readings first by hand, then in R (Lab W1, Parts A–B). Locate the identifier error and the unit error. | 45 | A data dictionary with key, unit, time zero and reason for collection; the three corrected counts. |
| 03 | Compare a fixed rule with a learnt threshold on a small table (Part C). Mark training and application. | 45 | A sketch of both approaches and an R script that recreates the starting table in a fresh session. |
| 04 | Draw one data flow for care, research and teaching. Mark roles, expected benefit and dispensable fields. Build the reduced teaching table (Part D). | 45 | A reduced teaching table and a reasoned decision to drop identifying free-text fields. |
Entry self-assessment (unit 01, 5 minutes)
Rate each statement from 1 (not at all) to 5 (fully), anonymously. You will see the same statements again in W8. The ratings are feedback for you and for the course team; they never count towards a grade.
- I can tell which number is the denominator of a percentage in a clinical study.
- I can explain why images from the same patient in training and test data are a problem.
- I can check whether a cited source actually supports a sentence.
- I know who has to be informed, and by when, if patient data reach the wrong recipient.
Then work on short case A for five minutes, on paper and without help:
A research group reports “94% accuracy on 1,200 test images” for a model that classifies tissue in images from 20 fictitious rats. Images of every rat were used both for training and for testing. A week later a technician notices that a spreadsheet with the animal-house cage cards, including the names of the responsible staff, was sent to an external software helpdesk.
- What is the independent number of units in the test? (b) What does the 94% measure? (c) Name the first two steps after the spreadsheet is discovered.
Keep your answer. The course team collects it anonymously and compares it with a parallel case in W8.
Three question types (unit 01)
| Type | Example for the wrist case | Decision it supports | Comparison needed |
|---|---|---|---|
| Descriptive | What share of adults presenting with wrist pain after a fall have a fracture on imaging? | Staffing of radiology in the emergency department | None; a well-defined population and denominator |
| Prognostic | Which patients will still have reduced grip strength after six weeks? | Who gets an early physiotherapy appointment | Predictors known at time zero, outcome later |
| Causal | Does an immediate second read of every radiograph reduce missed fractures? | Whether to introduce the second read | Patients with and without the second read, comparable at time zero |
Materials
- Lab W1 · Counting people, images and readings with
r/w1-case-table.R. - Tables: raw export, corrected table, data dictionary, teaching table.
- Paper version: the lab page prints all results; groups without a working R installation complete Parts A–D on paper and swap to a partner computer for the script.
Four perspectives in this workshop
- Ethics. Who would act differently because of the alert, and who carries the harm of a wrong answer? The case card names one affected person.
- Regulation. Only indirectly: the intended purpose of a future alert decides which rules apply. This becomes the central question in W7.
- Data protection. The data flow in unit 04 separates care, research and teaching. Free text and exact age are removed because the teaching question does not need them (data minimisation, Article 5(1)(c) of the General Data Protection Regulation (GDPR)).
- Security. A teaching table that leaves the clinic is a copy that has to be protected or, better, that contains nothing worth protecting.
Transition to W2
The case card and the data dictionary are the first two parts of your project. In W2 you add an evidence card: a claim about your case, checked against its original source.
Further reading
- B01 · Clinical decisions and the translational chain and B03 · How data arise – the full chapters behind the required reading.
- B02 · Describe, predict, explain – the three question types in depth; returns in W5.
- B04 · Reconstructing a research project in R – the R basics used in this workshop.
- Methods in R: The research workflow – 1. Question – from question to measurement and design.
- CTTIR Courses: Scientific process and research workflow – the first lab of the statistics curriculum this course builds on.
- CTTIR Tutorials: Population vs. Sample – what the denominator stands for.
- Strategy in R: R Refresher – a compact R introduction for newcomers.