Qualitative Sentiment Analysis Report

The Qualitative Sentiment Analysis Report feature in Eval25 provides additional scores for tone and sentiments to your evaluation's open-ended questions. Eval25 then allows you to compare scores against different Instructors, Departments, Schools, and even the entire College or University, as well as filter and find responses based on these scores, terms, questions, and more. 

How to Configure the Qualitative Sentiment Analysis Report

Before you can use the Qualitative Sentiment Analysis Report, you must configure what questions the report runs on.

Note

You may choose up to three questions for the Qualitative Sentiment Analysis Report at this time.

  1. On the Eval25 Dashboard, select the Configuration dropdown from the top menu bar.  
  2. Select the Sentiment Questions option.Sentiment questions link in the configuration dropdown
  3. Click the checkbox for the open-ended Questions you would like the Sentiment Analysis Report on.
    Sentiment analysis yes/no checkbox on the sentiment questions page
    • Note that only open-ended questions will appear here. Best practice is to make sure the question is a question asked to everyone in the university and evokes emotional responses. Not all questions are asked of the whole university.  These questions will appear first. 
    • If your institution doesn't have university-wide questions, the next best for comparison is the school-wide questions. The organization hierarchy is university > school > department > course.

  4. Once the checkbox is clicked, Eval25 automatically adds the question to your Sentiment Analysis, and a green banner appears for confirmation.
    banner indicating that the question has been added to the sentiment question list
  5. Click Home on the top menu to return to the dashboard or click Reports > Sentiment Analysis to begin step 1 in the section directly below,"How to Run the Sentiment Analysis Report".
    sentimental analysis link in the reports dropdown

How to Run the Sentiment Analysis Report

  1. If you have configured Sentiment Questions, click Reports on the top menu bar.
  2. Click Sentiment Analysis to go to the Sentiment Analysis Report page to view results.
    sentiment analysis link in the reports dropdown
  3. Select the Term.
    • Note that Qualitative Sentiment Analysis Report only works on one term at a time.term dropdown field
  4. Select the Question for the report.
    question dropdown field
  5. The bar chart and comment list will update automatically in the section underneath these configuration options.
  • For more information on understanding the report, see the section directly below, "How to Read the Sentiment Analysis Results."
  • For more information on Filters and Comparisons, see the section below, "How to Filter and Compare Sentiment Analysis Reports."  

How to Read the Sentiment Analysis Results

Sentiment Analysis Bar Chart

The Sentiment Analysis Bar Chart shows the results of the analysis in a variety of ways using six different bars and percentages.


example of the sentiment analysis bar chart


The key at the top reveals the different results displayed.
key indicating the colors for positive, neutral, negative, joy, anger, sadness, fear, and rating

  • The Sentiment Score is the analysis of the response broken down into Negative, Neutral, and Positive. The response is analyzed and broken down into a score of 0-5, where 0 is Negative and 5 is Positive, with Neutral in the middle. The first bar chart shows the distribution of the responses Sentiment Score results.
    sentiment scores bar
  • Tone is the emotion the analysis found for this comment. The results analyze the responses into Joy, Anger, Sadness, and Fear and a response may have more than one tone in the results.
    The next four bars (2-5) are the bars that represent the percentages of responses with those tones, in that order: Joy, Anger, Sadness, and Fear.
    joy, anger, sadness, fear bars
    In the example, Anger and Fear have scores of 0.0% and thus no bars. The scores are still displayed where the bars would appear, the arrows point to where Anger, Bar 3, and Fear, bar 5, would be.
  • Rating is the mean rating score from all the responses, displayed in the last bar (bar 6) for comparison.
    rating bar

Hovering over the different bars will isolate that bar and reveal result details.
isolated neutral bar
isolated joy bar

Clicking on these bars updates the comment list below to show results that correspond to the selected bar.

Sentiment Analysis Comment List

The Sentiment Analysis Comment List contains the evaluation response to the question analyzed, a 5-star rating corresponding to the Sentiment Score, and the Tone analysis connected to this response. 

  • The comment comes straight from the evaluation, exactly as the person responded:
    evaluation comment
  • The 5-star rating corresponds to the Sentiment Score of 0 to 5, where 0 is Negative, 5 is Positive, with Neutral in the middle.
    evaluation rating
  • The Sentiment Score is the analysis of the response broken down into Negative, Neutral, and Positive.
    evaluation sentiment score
  • Tone is the emotion the analysis found for this comment. The results analyze the responses into Joy, Anger, Sadness, and Fear and a response may have more than one tone in the results.
    response tone

How to Filter and Compare Sentiment Analysis Reports 

Eval25 allows you to filter the responses and compare different results. This is an optional helpful feature of the Sentiment Analysis. 

How to Filter Sentiment Analysis Reports

A filter option is available if you would like to filter the results and also compare them. For more information on Comparisons, see the section below, "How to Compare Sentiment Analysis Reports".
add filter dropdown options

  1. Select School, Department, or Instructor from the Add Filter dropdown.
  2. Select the corresponding department, instructor, or school. The bar chart and comment list will update automatically.
    department dropdown options
  3. Click Reset to clear the filter. The bar chart and comment list will update automatically.
    reset button

How to Compare Sentiment Analysis Reports

If you set up a filter, you can compare the results against the whole college or university, different schools within the institution, departments, or instructors, and any combinations within. 

  1. Click the plus (+) button next to Comparisons.
    add comparisons plus button
  2. Select University, School, or Department from the dropdown.
    comparisons dropdown options
  3. Select the department or school. Once an option is selected, the bar chart and comment list update automatically.
    department dropdown options
  4. Review the results. For more information on the results, see the section "How to Read the Sentiment Analysis Results" above.
    bar chart results
  5. Repeat steps 1-4 to add additional Comparisons.
  6. Click Reset to clear the Filter and Comparisons. The bar chart and comment list will update automatically.
    reset button
  7. Continue Steps 1-6 to make as many Comparisons as you like.

Exporting Excel Files

You may export the results in any combination of filters and comparisons using the "export" buttons.

export chart data and export comments buttons

  • Export Chart Data: provides a breakdown of each bar displayed in an easy-to-read spreadsheet format.
  • Export Comments: provides the comments that correspond to the current chart with additional statistics.

Filtering and comparing the results will provide unique Excel exports corresponding to the data displayed.