On the Pragmatics of Qualitative Assessment
Abstract
Using the example of a project on the assessment of implicit leadership theories, this article aims to describe qualitative content analysis as a systematic, rule-based process of analyzing verbal and textual data (e.g., interviews, group discussions, documents). Steps and typical problems in the qualitative assessment process are addressed and guidelines for decision and action presented. The steps include transcription of interview tapes into raw data, condensing and structuring the data, building and applying a category system, displaying data and results for concluding analyses and interpretation. Necessary checks for securing the quality of the assessment are shown for each step. Ideas for the combination of qualitative and quantitative analyses are presented, and applications of qualitative content analysis in the field of psychological assessment discussed.
References
Agresti, A. (1990). Categorical data analysis . New York: WileyAlexa, M. Züll, C. (1999). Commonalities, differences, and limitations of text analysis software: The results of a review. ZUMA Working Paper, 6, 1– 29Bachiochi, P.D. Weiner, S.P. (2002). Qualitative data collection and analysis. In S.G. Rogelberg (Ed.), Handbook of research methods in industrial and organizational psychology (pp. 161- 183). Oxford: BlackwellBannister, D. Fransella, F. (1981). Inquiring man: The psychology of personal constructs . London: Croom HelmCacioppo, J. von Hippel, W. Ernst, J. (1997). Mapping cognitive structures and processes through verbal content: The thought-listing technique. Journal of Consulting and Clinical Psychology, 65, 928– 940Conger, J.A. (1998). Qualitative research as the cornerstone methodology for understanding leadership. Leadership Quarterly, 9, 107– 121Creswell, J.W. (1998). Qualitative inquiry and research design: Choosing among five traditions . Thousand Oaks, CA: SageDavidson, G. Vogel, R. Coffman, S. (1997). Think-aloud approaches to cognitive assessment and the articulated thought paradigm. Journal of Consulting and Clinical Psychology, 65, 950– 958De Bruyn, E.E.J. (2003). Assessment process. In R. Fernández-Ballesteros (Ed.), Encyclopedia of psychological assessment (pp. 93-97). London: SageDenzin, N.K. Lincoln, Y.S. (2000). Introduction: The discipline and practice of qualitative research. In N.K. Denzin & Y.S. Lincoln (Eds.), Handbook of qualitative research (pp. 1-29). Thousand Oaks, CA: SageErdener, C.B. Dunn, C.P. (1990). Content analysis. In A.S. Huff (Ed.), Mapping strategic thought (pp. 291-300). Chichester: WileyFeixas, G. Geldschläger, H. Neimeyer, R.A. (2002). Content analysis of personal constructs. Journal of Constructivist Psychology, 15, 1– 19Fernández-Ballesteros, R. De Bruyn, E.E.J. Godoy, A. Hornke, L.F. Vizcarro, C. Westhoff, K. Westmeyer, H. Zaccagnini, J.L. (2001). Guidelines for the assessment process (GAP): A proposal for discussion. European Journal of Psychological Assessment, 17, 187– 200Flick, U. (1991). Stationen des qualitativen Forschungsprozesses. [Steps of the qualitative research process]. In U. Flick, E. von Kardorff, H. Keupp, L. von Rosenstiel, & S. Wolff (Eds.), Handbuch Qualitative Sozialforschung - Grundlagen, Konzepte, Methoden und Anwendungen (pp. 147-179). München, Germany: Psychologie Verlags UnionFrommer, J. Langenbach, M. Streeck, U. (2004). Qualitative psychotherapy research in German-speaking countries. Psychotherapy Research, 14, 57– 75Holsti, O.R. (1969). Content analysis for the social sciences and the humanities . Reading, MA: Addison-WesleyJelf, G.S. (1999). A narrative review of post-1989 employment interview research. Journal of Business and Psychology, 14, 25– 58Kluge, A. (2003). Assessment of organizational culture. In R. Fernandez-Ballesteros (Ed.), Encyclopedia of psychological assessment (pp. 649-657). London: SageKrippendorff, K. (1980). Content analysis: An introduction to its methodology . Beverly Hills, CA: SageLocke, K. (2002). The grounded theory approach to qualitative research. In F. Drasgow & N. Schmitt (Eds.), Measuring and analyzing behavior in organizations - Advances in measurement and data analysis (pp. 17-43). San Francisco: Jossey-BassMaxwell, J.A. (1998). Designing a qualitative study. In L. Bickman & D.J. Rog (Eds.), Handbook of applied social research methods (pp. 69-100). Thousand Oaks, CA: SageMayring, P. (1987). New approaches to qualitative research in German psychology: An attempt at integration . Paper presented at the Third Symposium of the International Association for Qualitative Research in Psychology, Perugia, ItalyMayring, P. (1994). Qualitative Inhaltsanalyse: Grundlagen und Techniken . [Qualitative content analysis: Fundamentals and techniques]. Weinheim, Germany: Deutscher Studien VerlagMayring, P. (2000). Qualitative content analysis. Forum: Qualitative Social Research, 2, 1-28. Retrieved March, 31, 2001, from www.qualitative-research.net/fqs-texte/2-00/2-00mayring-e.htmMiles, M.B. Huberman, A.M. (1994). Qualitative data analysis: An expanded sourcebook . London: SageMostyn, B. (1985). The content analysis of qualitative research data: A dynamic approach. In M. Brenner, J. Brown, & D. Cauter (Eds.), The research interview (pp. 115-145). London: Academic PressNeimeyer, G.J. Gemignani, M. (2003). Qualitative methods. In R. Fernández-Ballesteros (Ed.), Encyclopedia of psychological assessment (pp. 785-800). Sage: LondonSchein, E.H. (1990). Organizational culture. American Psychologist, 45, 109– 119Schilling, J. (2001). Wovon sprechen Führungskräfte, wenn sie über Führung sprechen: Eine Analyse subjektiver Führungstheorien . [What do leaders talk about when they are talking about leadership: An analysis of implicit leadership theories]. Hamburg: Dr. KovacSilverman, D. (2000). Doing qualitative research - A practical handbook . London: SageTesch, R. (1990). Qualitative research: Analysis types and software tools . New York: Farmer Press
