ScientiaHubDiscuss your project

Research design · Demonstration study

A review question that can survive the evidence

From a broad topic to explicit eligibility, traceable selection and a synthesis plan that keeps different questions apart.

The brief

What needs to change?

Develop a systematic intervention-review protocol for structured written feedback in postgraduate academic writing. The worked protocol below is a demonstration; the search has not been run.

The challenge

Revision quality, satisfaction and confidence are different outcomes. A convincing plan must define what it intends to compare before searching, and must not conceal missing information or count multiple reports as separate studies.

Working excerpt · Illustrative material

Protocol excerpt and synthetic selection record

Synthetic selection recordFictional counts · A reporting illustration, not a completed search
  1. 420Records identified
  2. 330Records screened
  3. 60Reports sought
  4. 56Reports assessed
  5. 16Reports retained
  6. 14Studies represented

The record of duplicates, exclusions and companion reports is shown below.

Protocol excerpt · Draft eligibility decisions
DimensionIncludeRecord or resolve
PopulationPostgraduate students revising academic writing.Separate undergraduate-only samples; resolve mixed samples from available subgroup data.
InterventionWritten feedback that links a criterion to an actionable revision.Record delivery, timing, length and accompanying discussion.
ComparatorUsual feedback without the required structured format.Extract what usual practice actually involved.
DesignRandomised and non-randomised comparative intervention studies.Keep design categories separate in extraction and appraisal.
OutcomesRevision quality, writing performance or self-reported experience.Do not merge these constructs as one outcome.

01 / Define the comparison

Among postgraduate students revising academic writing, how does structured written feedback compare with usual written feedback in its effects on first-revision quality? Structured feedback requires both a reference to an explicit criterion and an actionable revision instruction. The comparator is ordinary written feedback without that required structure. Record feedback length, timing and accompanying discussion as potential differences between conditions. Randomised and controlled non-randomised designs belong in separate synthesis groups.

02 / Make the search inspectable

Unexecuted retrieval skeleton: (postgraduat* OR doctoral OR master*) AND (feedback OR comment* OR annotat* OR rubric*) AND (writ* OR draft* OR revis*). Translate syntax for the selected database and platform, test sensitivity against known relevant reports, and record dates, limits and export counts. Determine written format and comparator eligibility during screening; requiring their wording in the query could miss relevant records.

03 / Reconcile the selection flow

Synthetic bookkeeping only—no real records or studies: 420 identified records − 90 duplicates = 330 screened; 330 − 270 title/abstract exclusions = 60 reports sought; 60 − 4 not retrieved = 56 assessed; 56 − 40 full-report exclusions = 16 retained reports representing 14 fictional studies. Two reports are companion reports. The 40 full-report exclusions comprise 17 wrong population, 11 wrong intervention, 8 ineligible design and 4 ineligible comparison.

04 / Expose missing evidence

Fictional extraction rows, not citations: DEMO-A | randomised comparison | first-revision rubric score | assessor masking unclear | dispersion available. DEMO-B | controlled non-randomised comparison | revision quality measured, result unreported | author query required. In a real review, each row would link to an actual source report; no authors, journals or DOIs are invented here.

05 / Keep the synthesis meaningful

Group the evidence by design, feedback components, outcome construct and measurement occasion. Do not pool a confidence rating with a writing-quality score under the label improvement. If the planned comparison is not defensible, use an organised evidence table and explain the differences instead of manufacturing a single effect.

Read alongside the reasoning and limitations below. These excerpts are not a complete commissioned deliverable.

Editorial & methodological judgement

Why these decisions?

The value is in the choices that connect the brief to the result.

Eligibility before results

Set and justify the population, intervention, comparator and study-design criteria before knowing the findings. The Cochrane reference supports selected planning principles; this educational demonstration is not a Cochrane review.

Reporting is not validation

PRISMA supplies reporting resources, including flow-diagram templates. A neat flow diagram does not establish search quality, valid selection or trustworthy conclusions.

Keep uncertainty visible

An unclear method or unavailable result becomes a query or limitation. It is not filled in with an assumption that makes the evidence appear stronger.

Review checklist

What to check.

  • Question, eligibility and synthesis groups agree.
  • All synthetic selection totals reconcile; reports and studies remain distinct.
  • Outcome availability is not confused with a positive result.
  • Search syntax stays labelled untested; no effect or certainty rating is invented.

A possible commissioned handover

What to specify.

  • Protocol excerpt and eligibility note
  • Search-log template
  • Synthetic selection flow and extraction rows
  • Synthesis decision note

The actual deliverable list, format and review stages are agreed in your quote.

Method & further reading

These sources explain the approach. They do not report, endorse or validate the fictional example above.

Bring your own brief

Make the next step specific.

Explore this service See what your quote includes Discuss your project

Another kind of work

From supervisor comments to a defensible interpretation

Read the next demonstration Back to all demonstrations