Atrimonta
  • What's New
  • About Us
    • Project Experience Examples
  • Client-Centred Evaluation
    • CCE Awareness
    • CCE Access
    • CCE Needs
    • CCE Services
    • CCE Outcomes
  • Logic Models
    • Logic Model Best Practices
    • Logical Program Approaches
    • Logical Organizational Approaches
  • Templates
    • Scoping Questions
    • Program Profile
    • Logic Model
    • Evaluation Matrix
    • Data Collection Plan
    • Schedule and Budget
    • Data Collection and Analysis Form
    • Report Outline
    • Debriefing Questions
  • Evaluating Reach
    • Who's Participating
    • Reasons for Participating
    • Facilitators & Improvements
    • Challenges & Solutions
    • What Works & Sub-Populations
  • Evaluation Surveys
  • Evaluation Toolbox
  • Contact

Evaluation Surveys

A blog about creating, conducting and reporting on Evaluation Surveys

Learn More

Communicating Reflections cont... Reporting Survey Responses (Specific)

2/6/2022

2 Comments

 
Picture
Heads up – this post is also about content rather than data viz

1. Rating scales 
Report the responses by category (e.g., Excellent, Very Good, Fair and Poor) – especially if this is a standalone question and each of the categories has an interesting number of responses in it.

Report the responses of only the “top two” (positive responses) or “bottom two” (negative responses) for each question – especially if this is one of a series of questions as this can help to highlight what the differences are between the questions.

Report the means (averages) for each question if this is a series of questions – as this can also highlight differences and similarities between them.
 
2. Multiple responses
Choose to report the responses either 1) as a percent of all responses or 2) as a percent of all individuals (cases). For example, if a participant responds they like both apples and oranges. Then the apple response can count as one of two (responses) or as one of one (individuals).

3. Other specifies
Report “other specify” comments in existing categories if they match. For example, if a participant responds in other specify comments that they like “granny smiths” but did not check the existing category of “apples”, then include their response in the apples responses when reporting. Report only other specify responses that cannot be included in existing categories as “other”.

4. Open ends 
Report the themes in open-ended responses. First, identify the theme categories, then look back at the responses to see which themes are present in each response.
 
If you have many open-ended responses to a question, you may want to assign a code to the themes in each response. Then tally the numbers by code to see what percent of your responses mention that theme.
 
If you have lots of themes, use NETs. Identify an overall code (NET) for a theme e.g., fruit and then sub-codes for sub-themes mentioned in the responses e.g., apples, oranges, pears, banana. This way you’ll be able to report on how many survey respondents talked about fruit, as well as how many specifically mentioned each type of fruit.
 
5. Final note on reporting survey responses 
  • adding %s across surveys be sure not to include the same individuals in the total count. 

2 Comments
John Carston link
3/18/2022 06:30:00 pm

I love that you talked about the importance of looking for a solution that will be the best option for your products. My father told me that he is looking for a research consultant that can do a program evaluation of their company products to verify quality, and he asked if I had any recommendations for the best course of action. Thank you for your interesting article, I'll let him know that they may acquire more specific information from a well-known program evaluation service.

Reply
datablizz link
1/10/2023 12:13:28 am

Great article! I appreciate the in-depth analysis and examples provided. I have a related resource on our website that might be of interest to readers. You can check it out here: www.datablizz.com

Reply



Leave a Reply.

    Archives

    February 2022
    January 2022
    December 2021
    November 2021
    October 2021
    July 2021

    Categories

    All

    RSS Feed

Proudly powered by Weebly