Abstract
Open-ended questions are a very important part of research surveys. However, they can pose a challenge when it comes to processing since manual processing requires a labour-intensive human effort. Automation of the task requires application of NLP methods since free text does not ensure standardized structure. To tackle this problem, we present a solution for topic discovery and analysis of open-ended survey items. We use graph-based representation of the text that adds structure and enables easier manipulation and keyphrase retrieval. Additionally, we use pre-trained fastText aligned word vectors to cluster similar phrases even if they are written in different languages. The goal is to produce topic word and phrase representatives that are easy to interpret by a domain expert. We compare the method with traditional LDA and two state-of-the-art algorithms: BTM and WNTM. The resulting keyphrases representing topics are more intuitive to the domain experts than the ones obtained by reference topic models in similar experimental settings.
Original language | English |
---|---|
Title of host publication | Proceedings - 20th IEEE International Conference on Data Mining Workshops, ICDMW 2020 |
Editors | Giuseppe Di Fatta, Victor Sheng, Alfredo Cuzzocrea, Carlo Zaniolo, Xindong Wu |
Publisher | IEEE Computer Society |
Pages | 621-628 |
Number of pages | 8 |
ISBN (Electronic) | 9781728190129 |
DOIs | |
Publication status | Published - Nov 2020 |
Event | 20th IEEE International Conference on Data Mining Workshops, ICDMW 2020 - Virtual, Sorrento, Italy Duration: Nov 17 2020 → Nov 20 2020 |
Publication series
Name | IEEE International Conference on Data Mining Workshops, ICDMW |
---|---|
Volume | 2020-November |
ISSN (Print) | 2375-9232 |
ISSN (Electronic) | 2375-9259 |
Conference
Conference | 20th IEEE International Conference on Data Mining Workshops, ICDMW 2020 |
---|---|
Country/Territory | Italy |
City | Virtual, Sorrento |
Period | 11/17/20 → 11/20/20 |
Bibliographical note
Publisher Copyright:© 2020 IEEE.
ASJC Scopus Subject Areas
- Computer Science Applications
- Software