A distributed joint sentiment and topic modeling using spark for big opinion mining

Zahedi, E, Saraee, MH ORCID: https://orcid.org/0000-0002-3283-1912 and Baniasadi, Z 2017, 'A distributed joint sentiment and topic modeling using spark for big opinion mining' , in: Iranian Conference on Electrical Engineering (ICEE), 2017 , IEEE, pp. 1475-1480.

PDF - Published Version Restricted to Repository staff only Download (2MB) | Request a copy

Abstract

Opinion data are produced rapidly by a large and uncontrolled number of opinion holders in different domains (public, business, politic and etc). The volume, variety and velocity of such data requires an opinion mining model to be also adopted with the ever growing and huge volume of opinions and obtaining the probabilistic generative model advantages. In this paper we propose a parallel implementation of joint sentiment and topic (JST) model for simultaneously discovering topics and sentiments from reviews on Spark. Spark is an open source and fast cluster computing framework for large-scale data processing. Here we discuss the implementation of JST on Spark and also discuss the benefit of using Spark while exploring the challenges encountered. We used different Amazon opinion datasets with different volume such as (reviews of electronic devices, book, restaurants, DVD and kitchen). The results present significant speedup and high efficiency on larger scale dataset in our experiments. Index Terms—big opinion dataset, joint sentiment and topic model, Spark, cluster computing

Item Type:	Book Section
Schools:	Schools > School of Computing, Science and Engineering > Salford Innovation Research Centre
Journal or Publication Title:	Proceedings of the 25th Iranian Conference on Electrical Engineering (ICEE2017)
Publisher:	IEEE
ISBN:	9781509059638
Related URLs:	Organisation
Depositing User:	Prof. Mo Saraee
Date Deposited:	10 Jul 2017 13:01
Last Modified:	16 Feb 2022 18:23
URI:	https://usir.salford.ac.uk/id/eprint/42898

Actions (login required)

Edit record (repository staff only)