DEVELOPING A REAL-TIME DATA ANALYTICS FRAMEWORK FOR TWITTER STREAMING DATA

ECU Author/Contributor (non-ECU co-authors, if there are any, appear on document)

Babak Yadranjiaghdam (Creator)

Institution

East Carolina University (ECU )

Web Site: http://www.ecu.edu/lib/

Abstract: Twitter is an online social networking service with more than 300 million users, generating a huge amount of information every day. Twitter's most important characteristic is its ability for users to tweet about events, situations, feelings, opinions, or even something totally new, in real time. Currently there are different workflows offering real-time data analysis for Twitter, presenting general processing over streaming data. This study will attempt to develop an analytical framework with the ability of in-memory processing to extract and analyze structured and unstructured Twitter data. The proposed framework includes data ingestion and stream processing and data visualization components with the Apache Kafka messaging system that is used to perform data ingestion task. Furthermore, Spark makes it possible to perform sophisticated data processing and machine learning algorithms in real time. We have conducted a case study on tweets about the earthquake in Japan and the reactions of people around the world with analysis on the time and origin of the tweets.

Additional Information

Publication

Thesis

Language: English

Date: 2016

Keywords

Real-time, Twitter, Big Data

Subjects

Social media--Data processing; Qualitative research--Computer programs

Email this document to