Chapter 3: Research Method
Checklist:
☐ Begin with the first sentence of the problem and purpose statement that leads to a brief explanation of the organization of the literature review. Copy verbatim from Chapter 1.
☐ Provide a brief overview of the contents of this chapter, including a statement that identifies the research methodology and design initially described in Chapter 1.
Research Methodology and Design
Checklist:
☐ Describe the research methodology and design. Elaborate upon their appropriateness in relation to the study problem, purpose, and research questions.
☐ Justify your choices by citing seminal authors on your chosen methodology and design.
☐ Identify alternative methodologies and designs and indicate why they were determined to be less appropriate than the ones selected. Do not simply list and describe research methodologies and designs in general.
Population and Sample
Checklist:
☐ Describe the population, including the estimated size and relevant characteristics.
☐ Explain why the population is appropriate, given the study problem, purpose, and research questions.
☐ Discuss the generalized research setting, including the appropriateness of the setting in the context of the research.
☐ Describe the sample that will be (proposal) or was (manuscript) obtained.
☐ Explain why the sample is appropriate, given the study problem, purpose, and research questions.
☐ Explain the inclusion criteria for study participants.
☐ Explain the sampling type used and how it is appropriate for the dissertation proposal methodology and design. For qualitative studies, evidence must be presented that saturation will be (proposal) or was (manuscript) reached. For quantitative studies, a power analysis must be reported to include the parameters (e.g., effect size, alpha, beta, type test, and number of groups) included, and evidence from the power analysis must be presented that the minimum required sample size will be (proposal) or was (manuscript) reached.
☐ Describe how the participants will be (proposal) or were (manuscript) recruited (e.g., email lists from professional organizations, flyers) and/or the data will be (proposal) or were (manuscript) obtained (e.g., archived data, public records) with sufficient detail so the study could be replicated.
Materials or Instrumentation
Checklist:
☐ Describe the materials and instruments (e.g., tests, questionnaires, interviews, observation protocols, archival data, etc.) that will be (proposal) or were (manuscript) used, including information on their origin and evidence of their reliability and validity (for quantitative instruments) or trustworthiness (qualitative materials and instruments).
☐ All materials and instruments must be included in the appendices. Reference the appendices within this section.
☐ If instruments or materials are used that were developed by another researcher, include evidence in the appendix that permission was granted to use or adapt the instrument(s) and/or material(s) and refer to that fact and the appendix in this section.
☐ Describe in detail any expert panel review, field testing, or pilot testing of instruments to include their results and any subsequent modifications. (IRB approval is needed for pilot testing a newly developed or significantly modified instrument. Once pilot testing is complete, IRB approval is needed for the main study. For questions about pilot testing, consult your chair and IRB).
Operational Definitions of Variables
Text…
Checklist:
☐ For quantitative and mixed methods studies, identify how each variable will be (proposal) or was (manuscript) used in the study. Use terminology appropriate for the selected statistical test (e.g., independent/dependent, predictor/criterion, mediator, moderator).
☐ Base the operational definitions on published research and valid and reliable instruments.
☐ Identify the specific instrument that will be (proposal) or was (manuscript) used to measure each variable.
☐ Describe the level of measurement of each variable (e.g., nominal, ordinal, interval, ratio), potential scores for each variable (e.g., the range [0–100] or levels [low, medium, high]), and data sources. If appropriate, identify what specific questions and scores (e.g., subscale scores, total scores) will be (proposal) or were (manuscript) included in the analysis and how they will be (proposal) or were (manuscript) derived (e.g., calculating the sum, difference, average).
Study Procedures
Checklist:
☐ Remember the objective of this section is to help future researchers recreate your study. Think of this section as the recipe where all the ingredients are included and then a narrative of the directions for assembling the ingredients.
☐ Describe the exact steps for recruiting study participants and for obtaining consent.
☐ Describe the exact steps that will be (proposal) or were (manuscript) followed to collect the data, addressing what data as well as how, when, from where, and from whom those data will be (proposal) or were (manuscript) collected in enough detail the study can be replicated.
☐ For qualitative studies, discuss how you will establish trustworthiness and where you will implement them in the data collection process.
Data Analysis
Checklist:
☐ Describe the strategies that will be (proposal) or were (manuscript) used to code and/or analyze the data, and any software that will be (proposal) or was (manuscript) used.
☐ Ensure the data that will be (proposal) or were (manuscript) analyzed can be used to answer the research questions and/or test the hypotheses to address the identified problem.
☐ Use proper terminology associated with each design/analysis (e.g., independent and dependent variables for an experimental design, predictor and criterion variables for regression).
☐ For quantitative studies, describe the analysis that will be (proposal) or was (manuscript) used to test each hypothesis. Provide multiple sources as supporting evidence that the statistical tests chosen are appropriate, given the level of measurement, number of variables, and grouping of the variables. Explain the assumptions of your chosen statistical tests and how your data will meet these assumptions.
☐ For qualitative studies, describe how the data will be (proposal) or were (manuscript) processed and analyzed.
☐ Explain the role of the researcher in ensuring ethical assurances and trustworthiness (credibility, dependability, transferability, & confirmability) in the context of the data analysis process.
☐ For mixed methods studies, include all of the above.
Assumptions
Checklist:
☐ Define what an assumption is from the literature.
☐ Discuss your study’s assumptions and the corresponding rationale underlying them.
Limitations
Checklist:
☐ Define what a limitation is from the literature.
☐ Describe the study limitations (any threats to internal and external validity as well as reliability for quantitative studies or trustworthiness for qualitative studies).
☐ Discuss the measures taken to mitigate these limitations.
Delimitations
Checklist:
☐ Define what a delimitation is from the literature.
☐ Describe the study delimitations along with the corresponding rationale underlying them.
☐ Explain how these research decisions relate to the existing literature and framework, problem statement, purpose statement, and research questions.
Ethical Assurances
Checklist:
☐ Confirm in a statement the study will (proposal) or did (manuscript) receive approval from the University’s Institutional Review Board (IRB) before recruitment and data collection.
☐ Discuss the three major principles of The Belmont Report (Beneficence, Justice, and Respect for Persons) and demonstrate how your procedures address each principle.
☐ If there is any risk to participants, discuss the relevant ethical issues and how they will be (proposal) or were (manuscript) addressed.
☐ Describe how confidentiality or anonymity will be (proposal) or was (manuscript) achieved.
☐ Identify how the data will be (proposal) or were (manuscript) securely stored following IRB requirements.
☐ Describe the role of the researcher in the study. Discuss relevant issues, including biases as well as personal and professional experiences with the topic, problem, or context. Present the strategies that will be (proposal) or were (manuscript) used to prevent these biases and experiences from influencing the analysis or findings.
☐ In the dissertation manuscript only, include the IRB approval letter in an appendix.
Summary
Checklist:
☐ Summarize the key points presented in the chapter.
☐ Include a transition to the next chapter (no more than a sentence or two).
☐ Do not introduce any new information in your summary
