Qualitative Sentiment Analysis Report

The Qualitative Sentiment Analysis Report feature in Eval25 provides additional scores for tone and sentiments to your evaluation's open-ended questions. Eval25 then allows you to compare scores against different Instructors, Departments, Schools, and even the entire College or University, as well as filter and find responses based on these scores, terms, questions, and more. 


How to Configure the Qualitative Sentiment Analysis Report

Before you can use the Qualitative Sentiment Analysis Report, you must configure what questions the report runs on.

Note

You may choose up to three questions for the Qualitative Sentiment Analysis Report at this time.

1. Open the Sentiment Questions

  • On the Eval25 Dashboard, select the Configuration dropdown from the top menu bar.  
  • Select the Sentiment Questions option.

2. Pick Questions to run the Sentiment Analysis Report for

  • Click the checkbox for the open-ended Questions you would like the Sentiment Analysis Report on.

Sentiment questions pageImage: Sentiment Questions page.

  • Note that only open-ended questions will appear here. Best practice is to make sure the question is a question asked to everyone in the university and evokes emotional responses. Not all questions are asked of the whole university.  These questions will appear first. 
  • If your institution doesn't have university-wide questions, the next best for comparison is the school-wide questions. The organization hierarchy is university > school > department > course.
  • Once the checkbox is clicked, Eval25 automatically adds the question to your Sentiment Analysis, and a green banner appears for confirmation.

Sentiment analysis banner indicating that a question was successfully addedImage: Checking the Yes/No checkbox will add a question to the report.

3. Open the Sentiment Analysis Report

  • Click Home on the top menu to return to the dashboard or click Reports > Sentiment Analysis to view the results.

4. Select a Term and Question

  • Select the Term and Question for the report. (Note that the Qualitative Sentiment Analysis Report only works on one term at a time.)

Sentiment analysis report exampleImage: Sentiment Analysis report example.

5. (Optional) Apply Additional Filters to the Report

  • A filter option is available if you would like to filter the results and also compare them. For more information on Comparisons, see the section below, "How to Compare Sentiment Analysis Reports".
  • Select School, Department, or Instructor from the Add Filter dropdown. Then select the corresponding department, instructor, or school.
  • Click Reset to clear the filter.

Reset buttonImage: Criteria Reset button.

The bar chart and comment list will update automatically in the section underneath these configuration options.


For more information on understanding the report, see the section, "How to Read the Sentiment Analysis Results."

For more information on Filters and Comparisons, see the section "How to Filter and Compare Sentiment Analysis Reports."  

How to Compare Sentiment Analysis Reports

1. Make Your Comparison Selections

  • From Reports > Sentiment Analysis, choose a Term and Question.
  • Select School, Department, or Instructor from the Add Filters dropdown. Then select the specific school, department, or instructor.
  • Click the plus (+) button next to Comparisons to add additional filter sets. These will be compared to the set from the step above.

Comparisons plus buttonImage: Use the Comparisons plus(+) button to add additional criteria to compare.  

  • Select School, Department, or Instructor from the first dropdown and the specific school, department, or instructor from the second dropdown.

Example comparisons criteriaImage: Example comparison criteria.

2. Review the Results

  • Once an option is selected, the bar chart and comment list update automatically. Review the results. For more information on the results, see the section "How to Read the Sentiment Analysis Results" above.

Sentiment analysis report exampleImage: The bar graphs will automatically generate with each criteria selection.

3. Repeat

  • Repeat steps 1-4 to add additional Comparisons.
  • Click Reset to clear the Filter and Comparisons. The bar chart and comment list will update automatically.

Reset buttonImage: Reset button.

  • Continue Steps 1-6 to make as many Comparisons as you like.

How to Read the Sentiment Analysis Results

Sentiment Analysis Bar Chart

The Sentiment Analysis Bar Chart shows the results of the analysis in a variety of ways using six different bars and percentages.

Sentiment analysis bar chartImage: Sentiment Analysis Bar Chart.

The key at the top reveals the different results displayed.

  • Sentiment Score 

    • The analysis of the response broken down into Negative, Neutral, and Positive. The response is analyzed and broken down into a score of 0-5, where 0 is Negative and 5 is Positive, with Neutral in the middle. The first bar chart shows the distribution of the responses Sentiment Score results.
  • Tone

    • The emotion the analysis found for this comment. The results analyze the responses into Joy, Anger, Sadness, and Fear and a response may have more than one tone in the results.
    • The next four bars (2-5) are the bars that represent the percentages of responses with those tones, in that order: Joy, Anger, Sadness, and Fear.
      In the example, Anger and Fear have scores of 0.0% and thus no bars. The scores are still displayed where the bars would appear, the arrows point to where Anger, Bar 3, and Fear, bar 5, would be.
  • Rating

    • The mean rating score from all the responses, displayed in the last bar (bar 6) for comparison.

Hovering over the different bars will isolate that bar and reveal the results details.

Hover windowImage: Hovering over a bar will reveal additional information.

Clicking on these bars updates the comment list below to show results that correspond to the selected bar.

Sentiment Analysis Comment List

The Sentiment Analysis Comment List contains the evaluation response to the question analyzed, a 5-star rating corresponding to the Sentiment Score, and the Tone analysis connected to this response. 

Comment List exampleImage: Comment List example.

  • Comments comes straight from the evaluation, exactly as the person responded:
  • The 5-star rating corresponds to the Sentiment Score of 0 to 5, where 0 is Negative, 5 is Positive, with Neutral in the middle.
  • The Sentiment Score is the analysis of the response broken down into Negative, Neutral, and Positive.
  • Tone is the Emotion the analysis found for this comment. The results analyze the responses into Joy, Anger, Sadness, and Fear and a response may have more than one tone in the results.

Exporting Excel Files

You may export the results in any combination of filters and comparisons using the "export" buttons.

Export Chart Data & Export Comments buttons.Image: Export Chart Data & Export Comments buttons.

  • Export Chart Data: provides a breakdown of each bar displayed in an easy-to-read spreadsheet format.
  • Export Comments: provides the comments that correspond to the current chart with additional statistics.

Filtering and comparing the results will provide unique Excel exports corresponding to the data displayed.