If you are unsure how detailed your analysis plan should be, or if your committee says your analysis is either “too rigid” or “too vague,” you are encountering one of the most common tensions in doctoral research. Committees want to see rigor and flexibility. Too much of one without the other signals risk. The challenge is that many doctoral students interpret rigor as rigidity and flexibility as improvisation. Committees interpret them very differently. This post explains how committees evaluate data analysis plans, why analysis often becomes a sticking point, and how to demonstrate analytic competence without overpromising.
What “Rigor” Means at the Doctoral Level
Rigor does not mean that every analytic step is predetermined in exhaustive detail. Rigor means that your analysis is:
- Systematic rather than ad hoc
- Grounded in an established analytic approach
- Transparent enough to be evaluated
- Appropriate for your data and research questions
Creswell and Creswell (2018) emphasize that rigor is demonstrated through coherence between data, analytic procedures, and claims—not through sheer volume of procedural description. If your committee cannot tell how you will move from raw data to findings, they will question the credibility of your study.
Why Overly Detailed Analysis Plans Raise Red Flags
Many students respond to uncertainty by writing extremely detailed analysis plans. Ironically, this often creates problems. Committees know that:
- You do not yet know what your data will look like
- Analytic decisions evolve as patterns emerge
- Some flexibility is necessary for credible interpretation
When an analysis plan reads like a script that cannot change, committees worry that:
- You will force data into predetermined categories
- You misunderstand how analysis actually works
- You are confusing procedural compliance with analytic thinking
Ravitch and Riggan (2017) argue that strong analysis plans show intentional openness, clarity about approach paired with responsiveness to data.
Why Vague Analysis Plans Also Fail
At the other extreme, some analysis sections are so general that they reveal little analytic thinking. Statements such as “the data will be analyzed for themes” or “appropriate statistical tests will be conducted” do not demonstrate rigor. Committees need to see the following:
- What analytic tradition you are working within
- What kinds of patterns you are looking for
- How analytic decisions will be made
- How trustworthiness or validity will be addressed
Booth, Colomb, and Williams (2016) note that strong arguments require transparent reasoning. If your analytic logic is invisible, your findings will not be trusted.
Analysis Must Match the Research Questions
One of the most common sources of committee concern is mismatch between research questions and analysis. Your committee will look closely at whether:
- Each research question has a corresponding analytic strategy
- Your data can reasonably address those questions
- Your analysis allows you to make the claims implied by the questions
If your analysis cannot answer your questions, no amount of rigor will fix the problem. This is an alignment issue, not a technical one.
Qualitative, Quantitative, and Mixed Methods Require Different Standards
Committees evaluate rigor differently depending on methodological approach.
For qualitative studies, they look for:
- Clear analytic approach (e.g., thematic analysis, grounded theory)
- Systematic coding and interpretation
- Reflexivity and transparency
- Strategies for credibility and trustworthiness
For quantitative studies, they look for:
- Appropriate statistical techniques
- Justified assumptions
- Attention to validity and reliability
- Clear links between variables and questions
For mixed methods studies, they look for:
- Integration rather than parallel tracks
- Clear rationale for mixing methods
- Thoughtful sequencing or convergence
- Coherent interpretation across data types
Creswell and Creswell (2018) emphasize that mixing methods increases complexity. Committees expect analytic clarity, not methodological ambition alone.
What Flexibility Actually Looks Like
Flexibility does not mean “I’ll figure it out later.” It means you can:
- Articulate a clear analytic approach
- Identify decision points where adaptation may occur
- Explain how those decisions will be made
- Maintain coherence if changes are required
Ravitch and Riggan (2017) argue that analytic flexibility is a sign of expertise, not weakness. Committees are reassured when students acknowledge uncertainty while demonstrating control.
Why Committees Worry About Overclaiming During Analysis
Analysis is where overclaiming often begins. Committees are attentive to whether:
- Claims exceed what the data can support
- Patterns are treated as causal when they are not
- Isolated findings are generalized too broadly
- Unexpected results are overstated
The American Psychological Association (2020) stresses that claims must be proportional to evidence. A careful analysis plan protects you from overinterpreting your findings.
How Analysis Decisions Shape the Discussion Chapter
Your analysis does not end when you identify results. Committees expect you to:
- Interpret findings in light of theory and literature
- Distinguish between description and explanation
- Acknowledge alternative interpretations
- Maintain analytic humility
Weak analysis leads to discussion chapters that feel speculative or repetitive. Strong analysis creates discussions that are grounded and credible.
Questions to Ask Yourself as You Revise
As you refine your analysis section, ask:
- Can someone else understand how I will analyze my data?
- Do my analytic strategies match my research questions?
- Have I balanced structure with openness?
- Do I explain how rigor will be maintained?
- Are my potential claims realistic?
If you can answer these clearly, your committee is more likely to trust your analysis plan. When committees struggle with analysis plans, the root cause is often earlier:
- Research questions that are too broad
- Theory that is not actually guiding interpretation
- Methods chosen without analytic implications in mind
Analysis exposes these weaknesses because it forces you to confront what your data can actually do. Revisiting earlier chapters is not backtracking. It is research design work.
What Comes Next
The next post in this series focuses on results, discussion, and overclaiming—specifically, how committees evaluate whether conclusions are warranted and how to avoid undermining your study at the final stage. If you are unsure how strong your conclusions can be, analysis is where those limits are set.
References
American Psychological Association. (2020). Publication manual of the American Psychological Association (7th ed.).
Booth, W. C., Colomb, G. G., & Williams, J. M. (2016). The craft of research (4th ed.). University of Chicago Press.
Creswell, J. W., & Creswell, J. D. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). SAGE.
Ravitch, S. M., & Riggan, M. (2017). Reason & rigor: How conceptual frameworks guide research (2nd ed.). SAGE.
