Validity in Quantitative Research Designs Guide
Four validities that pull against each other. A post that defines all four and ranks none has not answered the question the prompt is really asking.
Editorial process
Last reviewed · August 16, 2026
Four validities, and they trade against each other
The prompt names four aspects of validity and asks about the importance of each, which is an invitation to rank rather than to define. Get the definitions right first, because they are routinely muddled. Statistical conclusion validity asks whether the analysis supports the claim that a relationship exists — adequate power, correct test, assumptions met. Internal validity asks whether the intervention rather than something else caused the outcome, and its threats have names worth using: history, maturation, testing, instrumentation, selection, attrition, regression to the mean. Construct validity asks whether the measures and the intervention actually represent the concepts they claim to, which is where a study measuring 'patient engagement' with a satisfaction survey quietly fails. External validity asks whether the finding transfers beyond this sample, this setting and this moment. Each is a different question about the same study, and confusing two is the fastest way to lose a mark.
Now do the part that earns marks: show that they compete. Tightening internal validity usually means restricting the sample and controlling the setting, and every restriction narrows the population the result applies to. A randomised trial in one academic medical centre with strict exclusion criteria may have excellent internal validity and tell you very little about your own patients, most of whom would have been excluded. A pragmatic trial across many ordinary sites reverses that trade. Say which validity matters most for a given purpose, and defend it: for deciding whether an intervention works at all, internal validity comes first; for deciding whether to adopt it on your unit, external validity does. Bring one real study you have read to the argument, name the threat you think it handled worst, and say what the authors could have done instead. That single concrete judgement is what separates this post from a glossary.
Likely learning objectives
Inferred from the brief — check these against your own rubric.
- 01Define the four aspects of validity without conflating them.
- 02Name specific threats to internal validity rather than describing it generally.
- 03Explain the trade-off between internal and external validity.
- 04Judge one real study's handling of a named threat.
Read the full question
Review every instruction before using the planning guidance that follows.
Course-wide instructions that accompany this question
Important information for writing discussion questions and participation Hi Class, Please read through the following information on writing a Discussion question response and participation posts. Contact me if you have any questions. Important information on Writing a Discussion Question Your response needs to be a minimum of 150 words (not including your list of references) There needs to be at least TWO references with ONE being a peer reviewed professional journal article. Include in-text citations in your response Do not include quotes—instead summarize and paraphrase the information Follow APA-7th edition Points will be deducted if the above is not followed Participation –replies to your classmates or instructor A minimum of 6 responses per week, on at least 3 days of the week. Each response needs at least ONE reference with citations—best if it is a peer reviewed journal article Each response needs to be at least 75 words in length (does not include your list of references) Responses need to be substantive by bringing information to the discussion or further enhance the discussion. Responses of “I agree” or “great post” does not count for the word count. Follow APA 7th edition Points will be deducted if the above is not followed Remember to use and follow APA-7th edition for all weekly assignments, discussion questions, and participation points. Here are some helpful links Student paper example Citing Sources The Writing Center is a great resource Welcome to class Hello class and welcome to the class and I will be your instructor for this course. This is a -week course and requires a lot of time commitment, organization, and a high level of dedication. Please use the class syllabus to guide you through all the assignments required for the course. I have also attached the classroom policies to this announcement to know your expectations for this course. Please review this document carefully and ask me any questions if you do. You could email me at any time or send me a message via the “message” icon in halo if you need to contact me. I check my email regularly, so you should get a response within 24 hours. If you have not heard from me within 24 hours and need to contact me urgently, please send a follow up text to. I strongly encourage that you do not wait until the very last minute to complete your assignments. Your assignments in weeks 4 and 5 require early planning as you would need to present a teaching plan and interview a community health provider. I advise you look at the requirements for these assignments at the beginning of the course and plan accordingly. I have posted the YouTube link that explains all the class assignments in detail. It is required that you watch this 32-minute video as the assignments from week 3 through 5 require that you follow the instructions to the letter to succeed. Failure to complete these assignments according to instructions might lead to a zero. After watching the video, please schedule a one-on-one with me to discuss your topic for your project by the second week of class. Use this link to schedule a 15-minute session. Please, call me at the time of your appointment on my number. Please note that I will NOT call you. Please, be advised I do NOT accept any assignments by email. If you are having technical issues with uploading an assignment, contact the technical department and inform me of the issue. If you have any issues that would prevent you from getting your assignments to me by the deadline, please inform me to request a possible extension. Note that working fulltime or overtime is no excuse for late assignments. There is a 5%-point deduction for every day your assignment is late. This only applies to approved extensions. Late assignments will not be accepted. If you think you would be needing accommodations due to any reasons, please contact the appropriate department to request accommodations. Plagiarism is highly prohibited. Please ensure you are citing your sources correctly using APA 7th edition. All assignments including discussion posts should be formatted in APA with the appropriate spacing, font, margin, and indents. Any papers not well formatted would be returned back to you, hence, I advise you review APA formatting style. I have attached a sample paper in APA format and will also post sample discussion responses in subsequent announcements. Your initial discussion post should be a minimum of 200 words and response posts should be a minimum of 150 words. Be advised that I grade based on quality and not necessarily the number of words you post. A minimum of TWO references should be used for your initial post. For your response post, you do not need references as personal experiences would count as response posts. If you however cite anything from the literature for your response post, it is required that you cite your reference. You should include a minimum of THREE references for papers in this course. Please note that references should be no more than 5 years old except recommended as a resource for the class. Furthermore, for each discussion board question, you need ONE initial substantive response and TWO substantive responses to either your classmates or your instructor for a total of THREE responses. There are TWO discussion questions each week, hence, you need a total minimum of SIX discussion posts for each week. I usually post a discussion question each week. You could also respond to these as it would count towards your required SIX discussion posts for the week. I understand this is a lot of information to cover in 5 weeks, however, the Bible says in Philippians 4:13 that we can do all things through Christ that strengthens us. Even in times like this, we are encouraged by God’s word that we have that ability in us to succeed with His strength. I pray that each and every one of you receives strength for this course and life generally as we navigate through this pandemic that is shaking our world today. Relax and enjoy the course!
Turn the brief into deliverables
- 01Definitions of all four validity types.
- 02Named threats for at least internal and construct validity.
- 03An explanation of how the validities trade against each other.
- 04A judgement about which matters most, with a stated purpose.
- 05One real study appraised against a named threat.
Define each, then judge a real design against all four
Statistical conclusion validity
Explain what it asks and what undermines it.
Internal validity and its threats
Define causal inference and list the standard threats.
Construct validity
Explain the gap between a concept and its measure.
External validity
Explain transferability across population, setting and time.
The trade-off, and what it means for practice
Argue for which validity matters most and for which purpose.
One study, appraised
Apply the framework to a real design you have read.
Sources that name the threats, not just the categories
Recommended databases
- The assigned research text
- University of Southern California research guides
- NCBI Bookshelf
- PubMed Central
Search sequence
- 1.Get the four categories from one source so the definitions are consistent.
- 2.Look up the standard threat list rather than recalling it.
- 3.Find a pragmatic trial and an explanatory trial to illustrate the trade-off.
- 4.Choose a study you can access in full text; you cannot appraise a design from an abstract.
Reference shortlist
These are authoritative starting points, not a ready-made bibliography. A qualified reviewer must confirm that each source fits the assignment and supports the claim beside which it is cited.
Nothing here is cleared for citation until you have read it.
- 01
Quantitative Methods
University of Southern California Libraries · 2025
The quantitative design guide — variables, control and the threats appraisal targets.
- 02
Exploratory Data Analysis: Frequencies, Descriptive Statistics, Histograms, and Boxplots
StatPearls, NCBI Bookshelf · 2023
Exploratory analysis and assumption checking, which is where statistical conclusion validity lives.
- 03
Qualitative Study
StatPearls, NCBI Bookshelf · 2023
The qualitative counterpart, useful for showing why these four criteria are design-specific.
- 04
Nursing Professional Development Evidence-Based Practice
StatPearls, NCBI Bookshelf · 2023
How appraised evidence is meant to reach practice — the reason external validity matters clinically.
- 05
Using Implementation Science to Implement Evidence-Based Practice: A Discursive Paper
Journal of Advanced Nursing · 2025
Implementation science on the gap between trial conditions and real settings.
Review before submission
Common mistakes
- Defining all four and never comparing their importance.
- Confusing construct validity with instrument reliability.
- Treating external validity as sample size rather than as transferability.
- Discussing threats generically without naming any of them.
Submission checklist
- Are all four validities defined distinctly?
- Have you named at least three specific threats?
- Is the internal-versus-external trade-off stated explicitly?
- Does a real study appear, with a specific judgement about it?
Use this guide to plan and review your own work. Follow your institution's rules and read our academic-integrity policy.
Written by
Aaron Bishop
MA, Education
assignment interpretation and research-methods coaching across disciplines
Aaron leads the EssayCrackers editorial desk. He works on how assignment briefs are read — what a rubric is actually asking for, and where students most often answer a different question than the one set.
Reviewed by
Dr. Nathan Cole
PhD, Rhetoric & Composition
Argumentation and thesis development
Nathan teaches first-year composition and directs a university writing center. He reviews EssayCrackers guides for argumentative soundness and citation accuracy.