Designing and pilot-testing a communication study
Two things at once: a design for a full study you will never run, and a real pilot small enough to actually do. The report is graded on what the pilot taught you about the design, not on the findings.
Editorial process
Last reviewed · August 15, 2026
A full design, then a small pilot of it
The structure is the thing to get right, because the report has two levels and they serve different purposes. The first is a design for a full-scale study that stays hypothetical: research question, sampling frame, unit of analysis, method, coding scheme or protocol, and the analysis you would run. The second is a genuinely small pilot of that design using real data — a handful of articles coded, one short focus group, a small corpus queried — whose purpose is not to produce findings but to test whether the design works. That is the distinction most reports blur, and it decides the grade: a pilot that reports what it found about the topic has missed the point, while one that reports that two coders disagreed on a category, or that the sampling frame produced almost no relevant items, has done exactly what a pilot is for.
Choose the method from the module's list and choose it for fit rather than familiarity. Content analysis suits counting manifest features across many texts and pilots well because intercoder reliability is testable on a small sample. Framing analysis suits identifying how an issue is packaged, and its pilot problem is usually that frames overlap. Critical discourse analysis suits power and ideology in a small number of texts, and pilots by showing whether your analytical categories survive contact with real language. Corpus analysis and big data suit scale and pilot by revealing whether the data is obtainable at all, which is frequently the finding. Focus groups pilot by exposing which questions produce discussion and which produce silence. Then reserve real space at the end for reflection on what the pilot showed and how you would revise the full design, since that is the section that demonstrates research thinking rather than research reporting. Academic referencing and a bibliography are required, within 2,800 words.
Likely learning objectives
Inferred from the brief — check these against your own rubric.
- 01Separate a full-scale hypothetical design from the small pilot that tests it.
- 02Select a method by its fit to the research question rather than by familiarity.
- 03Report what a pilot reveals about the instrument rather than about the topic.
- 04Revise a design in light of pilot findings.
Read the full question
Review every instruction before using the planning guidance that follows.
Course-wide instructions that accompany this question
You must proofread your paper. But do not strictly rely on your computer’s spell-checker and grammar-checker; failure to do so indicates a lack of effort on your part and you can expect your grade to suffer accordingly. Papers with numerous misspelled words and grammatical mistakes will be penalized. Read over your paper – in silence and then aloud – before handing it in and make corrections as necessary. Often it is advantageous to have a friend proofread your paper for obvious errors. Handwritten corrections are preferable to uncorrected mistakes. Use a standard 10 to 12 point (10 to 12 characters per inch) typeface. Smaller or compressed type and papers with small margins or single-spacing are hard to read. It is better to let your essay run over the recommended number of pages than to try to compress it into fewer pages. Likewise, large type, large margins, large indentations, triple-spacing, increased leading (space between lines), increased kerning (space between letters), and any other such attempts at “padding” to increase the length of a paper are unacceptable, wasteful of trees, and will not fool your professor. The paper must be neatly formatted, double-spaced with a one-inch margin on the top, bottom, and sides of each page. When submitting hard copy, be sure to use white paper and print out using dark ink. If it is hard to read your essay, it will also be hard to follow your argument.
Turn the brief into deliverables
- 01A 2,800-word research report.
- 02A full-scale hypothetical design with question, sampling, unit of analysis and method.
- 03A method drawn from the module's list, with justification.
- 04A small-scale pilot with real data collection and analysis.
- 05Reflection on what the pilot showed and how the design would change, with academic referencing and a bibliography.
Topic, method, design, pilot, then what it revealed
Topic and research question
State the public communication issue and the question the study would answer.
Method selection and justification
Choose from the module's list and say why it fits this question.
The full-scale design
Set out sampling frame, unit of analysis, coding scheme or protocol and analysis plan.
The pilot
Describe the small data collection actually carried out and how it was analysed.
What the pilot revealed and how you would revise
Report instrument problems and the design changes they imply.
Choosing among the module's named methods
Recommended databases
- Your module readings on each method
- Communication and media studies journals
- Your institution's Postgraduate Student Handbook for referencing
- Corpus and archive tools where relevant to your method
Search sequence
- 1.Read one published study using your chosen method before designing anything, and note how it reports its coding scheme.
- 2.Check data availability early — the commonest pilot finding is that the data cannot be obtained as planned.
- 3.For content analysis, look up how intercoder reliability is reported, since the pilot should test it.
- 4.Consult the handbook on referencing and academic honesty, which the brief names explicitly.
Reference shortlist
These are authoritative starting points, not a ready-made bibliography. A qualified reviewer must confirm that each source fits the assignment and supports the claim beside which it is cited.
Nothing here is cleared for citation until you have read it.
- 01
Human Subjects Research Design
StatPearls, NCBI Bookshelf · 2023
Design fundamentals — sampling, unit of analysis and what a given design can support — which apply across the module's methods.
- 02
Expanding knowledge and roles for authority and practice boundaries of Emergency Department nurses: a grounded theory study
International Journal of Qualitative Studies on Health and Well-being · 2019
A published qualitative study whose methods section models how a protocol and analysis should be reported.
- 03
Research Design: Descriptive Studies
Office of Research Integrity, U.S. Department of Health and Human Services · 2024
Descriptive design and its limits, relevant since most of the module's methods are descriptive rather than causal.
- 04
Research Ethics
StatPearls, NCBI Bookshelf · 2023
Research ethics, which applies as soon as the pilot involves focus group participants or personal data.
Review before submission
Common mistakes
- Reporting the pilot's substantive findings instead of what it revealed about the design.
- Using a method not on the module's list, which the brief rules out.
- Designing a study so large that no pilot of it is feasible.
- Omitting the coding scheme or protocol, which is what the pilot is actually testing.
- Leaving no room for the revision section, which is where research thinking is demonstrated.
Submission checklist
- Are the full design and the pilot clearly separated?
- Is your method from the module's list?
- Did the pilot use real data, however little?
- Does the report say what the pilot revealed about the instrument?
- Is there a revision section, within 2,800 words, with a bibliography?
Use this guide to plan and review your own work. Follow your institution's rules and read our academic-integrity policy.
Written by
Aaron Bishop
MA, Education
assignment interpretation and research-methods coaching across disciplines
Aaron leads the EssayCrackers editorial desk. He works on how assignment briefs are read — what a rubric is actually asking for, and where students most often answer a different question than the one set.
Reviewed by
Dr. Nathan Cole
PhD, Rhetoric & Composition
Argumentation and thesis development
Nathan teaches first-year composition and directs a university writing center. He reviews EssayCrackers guides for argumentative soundness and citation accuracy.