A distributed joint sentiment and topic modeling using spark for big opinion mining

Zahedi, E, Saraee, MH and Baniasadi, Z 2017, A distributed joint sentiment and topic modeling using spark for big opinion mining , in: 25th Iranian Conference on Electrical Engineering (ICEE2017), 2-4 May 2017, Tehran.

[img] PDF - Published Version
Restricted to Repository staff only

Download (2MB) | Request a copy

Abstract

Opinion data are produced rapidly by a large and uncontrolled number of opinion holders in different domains (public, business, politic and etc). The volume, variety and velocity of such data requires an opinion mining model to be also adopted with the ever growing and huge volume of opinions and obtaining the probabilistic generative model advantages. In this paper we propose a parallel implementation of joint sentiment and topic (JST) model for simultaneously discovering topics and sentiments from reviews on Spark. Spark is an open source and fast cluster computing framework for large-scale data processing. Here we discuss the implementation of JST on Spark and also discuss the benefit of using Spark while exploring the challenges encountered. We used different Amazon opinion datasets with different volume such as (reviews of electronic devices, book, restaurants, DVD and kitchen). The results present significant speedup and high efficiency on larger scale dataset in our experiments. Index Terms—big opinion dataset, joint sentiment and topic model, Spark, cluster computing

Item Type: Conference or Workshop Item (Paper)
Schools: Schools > School of Computing, Science and Engineering > Salford Innovation Research Centre (SIRC)
Journal or Publication Title: Proceedings of the 25th Iranian Conference on Electrical Engineering (ICEE2017)
Publisher: IEEE
Depositing User: Dr Mo Saraee
Date Deposited: 10 Jul 2017 13:01
Last Modified: 10 Aug 2017 01:52
URI: http://usir.salford.ac.uk/id/eprint/42898

Actions (login required)

Edit record (repository staff only) Edit record (repository staff only)

Downloads

Downloads per month over past year