Review and modify topic and sentiment models for survey comments, upload training data to create new models, and apply models to current or future surveys.
Use this section of the Advanced Configuration Tool to review and modify the models that Gallup uses to determine the sentiment and topics of a survey question's comments. A model is like a statistical blueprint that helps Gallup "understand" each comment. A topic model helps Gallup determine each comment's topics, and a sentiment model helps it determine each comment's sentiment.
Note: A survey question may have multiple models, but Gallup will use only one of each type (topic and sentiment) to generate report data for the question's comments.
Text Analytics - Topic Modeling section
This section consists of the following areas:
Project
Select the survey whose report you want to configure.
Verbatim Question
Select the open-ended question from the survey whose model you want to review or modify.
Available Models
This area lists the models available for the selected survey question and consists of the following columns:
Model Name
The name of the model.
Type
Whether the model is for determining topics or sentiment.
Version
The version of the model Gallup is currently using to generate report data. When you edit an existing model, Gallup creates a new version of it and increments the version number.
Reportable
Whether Gallup is using the model to generate report data for the comments from the selected survey question.
Classified
Whether Gallup was able to use the model to successfully analyze the comments.
Default
Whether Gallup will use the model to generate report data for future surveys that use the selected survey question.
Note: If a model has multiple versions, click its expand arrow (>) to the left of its name to view all versions.
Click a model's More Options menu (⁝) to select from the following options:
Edit
Create a new version of the model by uploading a new set of data.
View Classification Measures *
View a chart illustrating the accuracy of the model.
Apply Model to the Selected Project
Have Gallup use the model to determine the sentiment or topic data for the comments from the selected survey question. When you select this option, Gallup will update the survey's report immediately.
Apply Model to All Future Projects
Have Gallup use the model to determine the sentiment or topic data for future surveys that use the selected survey question.
Export Training Dataset *
Download a CSV file containing the set of data Gallup used to create the model. To access your download, click View Exports on the right side of the page.
Export Results *
Download a CSV file containing the detailed results of Gallup's topic modeling for the comments from the selected survey question. To access your download, click View Exports on the right side of the page.
* This option is available only for classified models.
More Options menu, Text Analytics - Topic Modeling
To create a new model for the selected survey question, you can upload a set of data that Gallup will use to train and generate a new model. The CSV file you upload must include the following columns:
verb_text
The comment.
topic_level1
For a topic model, the primary topic for the comment. For a sentiment model, one of the following sentiment values for the comment: SENTIMENT_POSITIVE, SENTIMENT_NEGATIVE, SENTIMENT_NEUTRAL or SENTIMENT_MIXED.
Note: If you are creating a sentiment model and your data set omits a sentiment value (e.g., none of the responses in the data set have a SENTIMENT_MIXED value), that sentiment will not appear on the survey report for comments to the selected survey question.
Click Create Model on the right side of the page to display the Create Model window.
Create Model windowClick Choose File to select your CSV file.
Note: You can download the available template file to use for creating your CSV file.
- Type a name for the model in the Model Name field and select the type of model you want to create.
Click Submit.
Note: It may take up to an hour for Gallup to create and classify the new model.