Qualitative Sentiment Analysis Report

The Qualitative Sentiment Analysis Report feature in Eval25 provides additional scores for tone and sentiments to your evaluation's open-ended questions. Eval25 then allows you to compare scores against different Instructors, Departments, Schools, and even the entire College or University, as well as filter and find responses based on these scores, terms, questions, and more. 

How to Configure the Qualitative Sentiment Analysis Report

Before you can use the Qualitative Sentiment Analysis Report, you must configure what questions the report runs on.

1. On the Eval25 Dashboard, select the Configuration dropdown from the top menu bar.  
2. Select the Sentiment Questions option.
   
3. Click the checkbox for the open-ended Questions you would like the Sentiment Analysis Report on.
   
   • Note that only open-ended questions will appear here. Best practice is to make sure the question is a question asked to everyone in the university and evokes emotional responses. Not all questions are asked of the whole university.  These questions will appear first. 
   • If your institution doesn't have university-wide questions, the next best for comparison is the school-wide questions. The organization hierarchy is university > school > department > course.
     
     
4. Once the checkbox is clicked, Eval25 automatically adds the question to your Sentiment Analysis, and a green banner appears for confirmation.
   
   
5. Click Home on the top menu to return to the dashboard or click Reports > Sentiment Analysis to begin step 1 in the section directly below,"How to Run the Sentiment Analysis Report".
   

How to Run the Sentiment Analysis Report

1. If you have configured Sentiment Questions, click Reports on the top menu bar.
   
2. Click Sentiment Analysis to go to the Sentiment Analysis Report page to view results.
   
   
3. Select the Term.
   • Note that Qualitative Sentiment Analysis Report only works on one term at a time.
4. Select the Question for the report.
   
   
5. The bar chart and comment list will update automatically in the section underneath these configuration options.

• For more information on understanding the report, see the section directly below, "How to Read the Sentiment Analysis Results."
• For more information on Filters and Comparisons, see the section below, "How to Filter and Compare Sentiment Analysis Reports."  

How to Read the Sentiment Analysis Results

Sentiment Analysis Bar Chart

The Sentiment Analysis Bar Chart shows the results of the analysis in a variety of ways using six different bars and percentages.

The key at the top reveals the different results displayed.

• The Sentiment Score is the analysis of the response broken down into Negative, Neutral, and Positive. The response is analyzed and broken down into a score of 0-5, where 0 is Negative and 5 is Positive, with Neutral in the middle. The first bar chart shows the distribution of the responses Sentiment Score results.
  
• Tone is the emotion the analysis found for this comment. The results analyze the responses into Joy, Anger, Sadness, and Fear and a response may have more than one tone in the results.
  The next four bars (2-5) are the bars that represent the percentages of responses with those tones, in that order: Joy, Anger, Sadness, and Fear.
  
  In the example, Anger and Fear have scores of 0.0% and thus no bars. The scores are still displayed where the bars would appear, the arrows point to where Anger, Bar 3, and Fear, bar 5, would be.
• Rating is the mean rating score from all the responses, displayed in the last bar (bar 6) for comparison.
  

Hovering over the different bars will isolate that bar and reveal result details.

Clicking on these bars updates the comment list below to show results that correspond to the selected bar.

Sentiment Analysis Comment List

The Sentiment Analysis Comment List contains the evaluation response to the question analyzed, a 5-star rating corresponding to the Sentiment Score, and the Tone analysis connected to this response. 

• The comment comes straight from the evaluation, exactly as the person responded:
  
  
• The 5-star rating corresponds to the Sentiment Score of 0 to 5, where 0 is Negative, 5 is Positive, with Neutral in the middle.
  
  
• The Sentiment Score is the analysis of the response broken down into Negative, Neutral, and Positive.
  
  
• Tone is the emotion the analysis found for this comment. The results analyze the responses into Joy, Anger, Sadness, and Fear and a response may have more than one tone in the results.
  

How to Filter and Compare Sentiment Analysis Reports 

Eval25 allows you to filter the responses and compare different results. This is an optional helpful feature of the Sentiment Analysis. 

How to Filter Sentiment Analysis Reports

A filter option is available if you would like to filter the results and also compare them. For more information on Comparisons, see the section below, "How to Compare Sentiment Analysis Reports".

1. Select School, Department, or Instructor from the Add Filter dropdown.
2. Select the corresponding department, instructor, or school. The bar chart and comment list will update automatically.
   
   
3. Click Reset to clear the filter. The bar chart and comment list will update automatically.
   

How to Compare Sentiment Analysis Reports

If you set up a filter, you can compare the results against the whole college or university, different schools within the institution, departments, or instructors, and any combinations within. 

1. Click the plus (+) button next to Comparisons.
   
   
2. Select University, School, or Department from the dropdown.
   
   
3. Select the department or school. Once an option is selected, the bar chart and comment list update automatically.
   
   
4. Review the results. For more information on the results, see the section "How to Read the Sentiment Analysis Results" above.
   
   
5. Repeat steps 1-4 to add additional Comparisons.
   
6. Click Reset to clear the Filter and Comparisons. The bar chart and comment list will update automatically.
   
   
7. Continue Steps 1-6 to make as many Comparisons as you like.

Exporting Excel Files

You may export the results in any combination of filters and comparisons using the "export" buttons.

• Export Chart Data: provides a breakdown of each bar displayed in an easy-to-read spreadsheet format.
• Export Comments: provides the comments that correspond to the current chart with additional statistics.

Filtering and comparing the results will provide unique Excel exports corresponding to the data displayed.