An evaluation can use quantitative or qualitative data, and often includes both. Open-ended questions in structured questionnaires Semi-structured and in- depth interviews Focus groups Document analysis Workshops - table-based/group exercises Go-along interviews - shadowing Photo-elicitation - photovoice Mental models- mind maps Participant diaries, logbooks, recordings Observation Qualitative methods play an important role in safety intervention evaluation. This Chapter Cdc-pdf[PDF – 777 KB]. Qualitative methods include three kinds of data collection: (1) in-depth, open-ended interviews; (2) direct observation; and (3) written … Quantitative data is expressed as numbers; qualitative data is expressed as words. Qualitative evaluation methods stray towards greater ‘subjectivity’ i.e. Observations may help explain behaviors as well as social context and meanings because the evaluator sees what is actually happening. During the webinar, a question was posed about groupthink during Focus Groups. However, quantitative evidence is usually needed to show that a program increased or decreased the frequency of some health behavior. Linking to a non-federal website does not constitute an endorsement by CDC or any of its employees of the sponsors or the information and products presented on the website. Experiments typically yield quantitative data, as they are concerned with measuring things. Commonly used qualitative methods include: participant observation. The evaluation of community engagement may need both qualitative and quantitative methods because of the diversity of issues addressed (e.g., population, type of project, and goals). Interviews: personally asking people questions in one-on-one conversations. Another type of interview focuses on a person’s perceptions and motivations. Surveys may be self- or interviewer-administered and conducted face-to-face or by telephone, by mail, or online. Qualitative Evaluation Methods . Beverly Hills, CA: Sage. The strengths of quantitative data for evaluation purposes include their generalizability (if the sample represents the population), the ease of analysis, and their consistency and precision (if collected reliably). Quantitative methods track changes in ‘quantifiables’, while qualita-tive methods reveal perspectives, perceptions or behaviours. In addition, quantitative data do not provide an understanding of the program’s context and may not be robust enough to explain complex issues or interactions (Holland et al., 2005; Garbarino et al., 2009). However, other research methods, such as controlled observations and questionnairescan produce both quantitative information. These methods are rarely used alone; combined, they generally provide the best overview of the project. The choice of methods should fit the need for the evaluation, its timeline, and available resources (Holland et al., 2005; Steckler et al., 1992). Click here to access the webinar: Using Qualitative Methods in your Evaluation – Webinar, This document is a copy of the slides presented during the webinar: Using Qualitative Methods in your Evaluation – Webinar Presentation Slides. This article provides insights into evaluating and creating evaluation methods. QUALITATIVE METHODS. Qualitative inquiry’s seven major contributions to understanding the world are presented. This is because the combination generally provides the best overall assessment of the program. Collecting qualitative evaluation data requires the use of different tools than if you were focused only on gathering quantitative data. This webinar provides an overview of how to use qualitative methods during an evaluation. Twelve primary strategic themes of qualitative inquiry illuminate the unique niche of qualitative inquiry in research and evaluation studies. Qualitative Evaluation Checklist 2 INTRODUCTION Qualitative evaluations use qualitative and naturalistic methods, sometimes alone, but often in combination with quantitative data. Agency for Toxic Substance and Disease Registration, Principles of Community Engagement - Second Edition, Agency for Toxic Substances and Disease Registry, Successful Efforts in Community Engagement, Improving American Indian Cancer Surveillance, The Dental Practice-Based Research Network, Determinants of Brushing Young Children’s Teeth, Chapter 4. Subjective (Qualitative) Journals Testimonials Observations Photographs Clippings. Quantitative and qualitative methods generate different types of data. Surveys may be self- or interviewer-administered and conducted face-to-face or by telephone, by mail, or online. Most training evaluation processes include a combination of both of these methods. Engaging and Maintaining Community Involvement, 3. Qualitative Methods for Evaluation Research. Quantitative and qualitative methods can be combined in many ways to build on the strengths of both, and minimise their relative weaknesses. One-on-One interviews can be conducted physically, via the telephone and through video conferencing apps like Zoom and Google Meet. Seven distinct, criteria-based frameworks for presenting and judging qualitative findings are provided. Collecting qualitative evaluation data requires the use of different tools than if you were focused only on gathering quantitative data. Full Document Cdc-pdf[PDF – 2.6 MB] It is designed to help you explore the options you have when creating your program and project designs. Analyzing Your Qualitative Evaluation Results – Webinar 169-186). Observations can include watching a participant or program, videotaping an intervention, or even recording people who have been asked to “think aloud” while they work (Ericsson et al., 1993). Evaluation research helps in market research. Types of Quantitative Research There are four (4) main types of quantitative designs: descriptive, correlational, quasi-experimental, and experimental. Qualitative evaluation and research methods (pp. The results of qualitative methods are more descriptive and the inferences can … Qualitative evaluation approaches differ from each other on at least two important fronts: their philosophical beliefs about how CDC is not responsible for Section 508 compliance (accessibility) on other federal or private website. Quantitative data collection methods include: Program records; Contact tracking; Data-matching with other organizations; Pre-and post-tests; Surveys; Qualitative data is used to describe meaning and is generally non-numerical. In terms of quantitative vs qualitative data, neither quantitative or qualitative … combining the theoretical with the practical, this book examines both how and why to conduct evaluations, reviews evaluation research history, and presents a qualitative research model. Designing Qualitative Studies 169 PURPOSEFUL SAMPLING Perhaps nothing better captures the difference between quantitative and qualitative methods than the different logics that undergird sampling approaches. The strength of this method is that group discussion can provide ideas and stimulate memories with topics cascading as discussion occurs (Krueger et al., 2000; Morgan, 1997). Quantitative data collected before and after an intervention can show its outcomes and impact. Qualitative versus quantitative methods Most evaluation methods produce either quanti-tative or qualitative data. Qualitative vs. Quantitative Evaluation -5 Qualitative Quantitative Includes interviews, focus groups, observations, ethnographies, letter or diary writing Surveys, questionnaires, randomized controlled studies, semi-experimental designs, use of secondary data. One challenge of collecting qualitative evaluation data is figuring out what to do with it! Process evaluation Goals: ... • Does not require a comparison group • Includes qualitative and quantitative data collection • Does not require advanced statistical methods. Here are two articles that discuss this concept, as well as how to address it during your Focus Groups: A Strategy to Avoid Groupthink and Stimulate Discussion in Focus Groups (MacDougall & Baum, 1997), Evaluating the Efficacy of Focus Group Discussion in Qualitative Social Research (Boateng, 2012). Focus Groups Patton (1990) identifies three basic types of qualitative interviewing for research or evaluation: the informal conversational interview, the interview guide approach, and … Working with Nontraditional Communities, Chapter 6. Some interviews have a specific focus, such as a critical incident that an individual recalls and describes in detail. It can help you develop a deep understanding of a topic, issue, or problem from an individual perspective. Some qualitative methods I have used are: 1. Focus groups are run by a facilitator who leads a discussion among a group of people who have been chosen because they have specific characteristics (e.g., were clients of the program being evaluated). Each of the research approaches involve using one or more data collection methods.These are some of the most common qualitative methods: Observations: recording what you have seen, heard, or encountered in detailed field notes. 67081. author(s) m q patton. Using Qualitative Methods in your Evaluation – Webinar. what qualitative methods are, the kinds of questions that can best be addressed by this approach, and the role qualitative methods can play in program evaluation. unstructured and semi-structured interviews. Focus group participants discuss their ideas and insights in response to open-ended questions from the facilitator. The limitations of using quantitative data for evaluation can include poor response rates from surveys, difficulty obtaining documents, and difficulties in valid measurement. The last section of this chapter outlines less common but, nonetheless, potentially useful qualitative methods for project evaluation. Document Studies Existing records often provide insights into a setting and/or group of people that cannot be observed or noted in another way. After it is clear which type of evaluation you will conduct, you have to determine which research method you should use. 1980 annotation. ncj number. samples.jbpub.com/9780763780586/80586_CH03_Keele.pdf Qualitative evaluation provides you with the ability to gain an in-depth understanding of a program or process. You will be subject to the destination website's privacy policy when you follow the link. qualitative evaluation methods. Qualitative data: Qualitative data answer such questions as “What is the value added?”, “Who was responsible?”, and “When did something happen?’’ Qualitative data are collected through direct or participant observation, interviews, focus groups, and case studies and from written documents. For example: Student narratives about why they participate in your program each month. away from the tick box type of evaluation used in ‘objective’ methods. Analysis of quantitative data involves statistical analysis, from basic descriptive statistics to complex analyses. Interviews may be structured and conducted under controlled conditions, or they may be conducted with a loose set of questions asked in an open-ended manner. Analyses of qualitative data include examining, comparing and contrasting, and interpreting patterns. In many cases qualitative surveys are used to come up with a hypothesis, which are then tested using quantitative research. Just as quantitative methods are well suited for some types of questions, qualitative methods are particularly well suited to other, specific types …