Social media data mining and analytics / Gabor Szabo, Gungor Polatkan, Oscar Boykin, Antonios Chalkiopoulos.

By: Szabó, Gábor [author.]
Contributor(s): Polatkan, Gungor [author.] | Boykin, Oscar [author.] | Chalkiopoulos, Antonios [author.]
Language: English Publisher: Indianapolis, IN : John Wiley & Sons, [2019]Description: xxxv, 316 pages : illustrations ; 24 cmContent type: text Media type: unmediated Carrier type: volumeISBN: 9781118824856 (pbk.); 1118824857Subject(s): Consumer profiling -- Data processing | Consumer behavior -- Forecasting | Business planning -- Data processing | Social media -- Data processing | Data miningDDC classification: 658.83402856312
Contents:
Table of contents Introduction xvii Chapter 1 Users: TheWho of Social Media 1 Measuring Variations in User Behavior in Wikipedia 2 The Diversity of User Activities 3 The Origin of the User Activity Distribution 12 The Consequences of the Power Law 20 The Long Tail in Human Activities 25 Long Tails Everywhere: The 80/20 Rule (p/q Rule) 28 Online Behavior on Twitter 32 Retrieving Tweets for Users 33 Logarithmic Binning 36 User Activities on Twitter 37 Summary 39 Chapter 2 Networks: The How of Social Media 41 Types and Properties of Social Networks 42 When Users Create the Connections: Explicit Networks 43 Directed Versus Undirected Graphs 45 Node and Edge Properties 45 Weighted Graphs 46 Creating Graphs from Activities: Implicit Networks 48 Visualizing Networks 51 Degrees: The Winner Takes All 55 Counting the Number of Connections 57 The Long Tail in User Connections 58 Beyond the Idealized Network Model 62 Capturing Correlations: Triangles, Clustering, and Assortativity 64 Local Triangles and Clustering 64 Assortativity 70 Summary 75 Chapter 3 Temporal Processes: The When of Social Media 77 What Traditional Models Tell You About Events in Time 77 When Events Happen Uniformly in Time 79 Inter-Event Times 81 Comparing to a Memoryless Process 86 Autocorrelations 89 Deviations from Memorylessness 91 Periodicities in Time in User Activities 93 Bursty Activities of Individuals 99 Correlations and Bursts 105 Reservoir Sampling 106 Forecasting Metrics in Time 110 Finding Trends 112 Finding Seasonality 115 Forecasting Time Series with ARIMA 117 The Autoregressive Part (“AR”) 118 The Moving Average Part (“MA”) 119 The Full ARIMA(p, d, q) Model 119 Summary 121 Chapter 4 Content: The What of Social Media 123 Defining Content: Focus on Text and Unstructured Data 123 Creating Features from Text: The Basics of Natural Language Processing 125 The Basic Statistics of Term Occurrences in Text 128 Using Content Features to Identify Topics 129 The Popularity of Topics 138 How Diverse Are Individual Users’ Interests? 141 Extracting Low-Dimensional Information from High-Dimensional Text 144 Topic Modeling 145 Unsupervised Topic Modeling 147 Supervised Topic Modeling 155 Relational Topic Modeling 162 Summary 169 Chapter 5 Processing Large Datasets 171 Map Reduce: Structuring Parallel and Sequential Operations 172 Counting Words 174 Skew: The Curse of the Last Reducer 177 Multi-Stage MapReduce Flows 179 Fan-Out 180 Merging Data Streams 181 Joining Two Data Sources 183 Joining Against Small Datasets 186 Models of Large-Scale MapReduce 187 Patterns in MapReduce Programming 188 Static MapReduce Jobs 188 Iterative MapReduce Jobs 195 PageRank for Ranking in Graphs 195 K-means Clustering 199 Incremental MapReduce Jobs 203 Temporal MapReduce Jobs 204 Rollups and Data Cubing 205 Expanding Rollup Jobs 211 Challenges with Processing Long-Tailed Social Media Data 212 Sampling and Approximations: Getting Results with Less Computation 214 HyperLogLog 217 HyperLogLog Example 219 HyperLogLog on the Stack Exchange Dataset 221 Performance of HLL on Large Datasets 222 Bloom Filters 223 A Bloom Filter Example 226 Bloom Filter as Pre-Computed Membership Knowledge 228 Bloom Filters on Large Social Datasets 229 Count-Min Sketch 231 Count-Min Sketch—Heavy Hitters Example 233 Count-Min Sketch—Top Percentage Example 235 Aggregating Approximate Data Structures 235 Summary of Approximations 236 Executing on a Hadoop Cluster (Amazon EC2) 237 Installing a CDH Cluster on Amazon EC2 237 Providing IAM Access to Collaborators 241 Adding On-Demand Cluster Capabilities 242 Summary 243 Chapter 6 Learn, Map, and Recommend 245 Social Media Services Online 246 Search Engines 246 Content Engagement 246 Interactions with the Real World 248 Interactions with People 249 Problem Formulation 251 Learning and Mapping 253 Matrix Factorization 255 Learning, Training 257 Under- and Overfitting 257 Regularizing in Matrix Factorization 259 Non-Negative Matrix Factorization and Sparsity 260 Demonstration on Movie Ratings 261 Interpreting the Learned Stereotypes 265 Exploratory Analysis 269 Prediction and Recommendation 274 Evaluation 277 Overview of Methodologies 278 Nearest Neighbor-Based Approaches 278 Approaches Based on Supervised Learning 280 Predicting Movie Ratings with Logistic Regression 280 Common Issues with Features 288 Domain-Specific Applications 289 Summary 290 Chapter 7 Conclusions 293 The Surprising Stability of Human Interaction Patterns 293 Averages, Standard Deviations, and Sampling 296 Removing Outliers 303 Index 309
Summary: "Social media is a rich source of big data, so much so that 90% of Fortune 500 companies are investing in big data initiatives to help them predict consumer behavior. Knowing the most effective ways to mine social media data can help you acquire information that generates amazing business results. Social media is unstructured, dynamic, and future-oriented. Effective, insightful data mining requires new analytical tools and techniques. Written by experts at social networking companies, Social Media Data Mining and Analytics provides a hands-on course that teaches you how to use state-of-the-art tools and sophisticated data mining techniques specifically geared to social media. It digs deeply into the mechanics of collecting and applying social media data to understand customers, define trends, and make predictions that can improve analytics for growth and sales. "--Amazon.com
Tags from this library: No tags from this library for this title. Log in to add tags.
    Average rating: 0.0 (0 votes)
Item type Current location Home library Call number Status Date due Barcode Item holds
BOOK BOOK COLLEGE LIBRARY
COLLEGE LIBRARY
SUBJECT REFERENCE 		658.83402856312 Sz12 2019 (Browse shelf) Available CITU-CL-49704
Total holds: 0

Includes index.

About the Author

GABOR SZABO, PHD, is a Senior Staff Software Engineer at Tesla and a former data scientist at Twitter, where he focused on predicting user behavior and content popularity in crowdsourced online services, and on modeling large-scale content dynamics. He also authored the PyCascading data processing library.

GUNGOR POLATKAN, PHD, is a Tech Lead/Engineering Manager designing and implementing end-to-end machine learning and artificial intelligence offline/online pipelines for the LinkedIn Learning relevance backend. He was previously a machine learning scientist at Twitter, where he worked on topics such as ad targeting and user modeling.

P. OSCAR BOYKIN, PHD, is a software engineer at Stripe where he works on machine learning infrastructure. He was previously a Senior Staff Engineer at Twitter, where he worked on data infrastructure problems. He is coauthor of the Scala big-data libraries Algebird, Scalding and Summingbird.

ANTONIOS CHALKIOPOULOS, MSC, is a Distributed Systems Specialist. A system engineer who has delivered fast/big data projects in media, betting, and finance, he is now leading the effort on the Lenses platform for data streaming as a co-founder and CEO at https://lenses.stream.
Permissions

Request permission to reuse content from this site

Table of contents

Introduction xvii

Chapter 1 Users: TheWho of Social Media 1

Measuring Variations in User Behavior in Wikipedia 2

The Diversity of User Activities 3

The Origin of the User Activity Distribution 12

The Consequences of the Power Law 20

The Long Tail in Human Activities 25

Long Tails Everywhere: The 80/20 Rule (p/q Rule) 28

Online Behavior on Twitter 32

Retrieving Tweets for Users 33

Logarithmic Binning 36

User Activities on Twitter 37

Summary 39

Chapter 2 Networks: The How of Social Media 41

Types and Properties of Social Networks 42

When Users Create the Connections: Explicit Networks 43

Directed Versus Undirected Graphs 45

Node and Edge Properties 45

Weighted Graphs 46

Creating Graphs from Activities: Implicit Networks 48

Visualizing Networks 51

Degrees: The Winner Takes All 55

Counting the Number of Connections 57

The Long Tail in User Connections 58

Beyond the Idealized Network Model 62

Capturing Correlations: Triangles, Clustering, and Assortativity 64

Local Triangles and Clustering 64

Assortativity 70

Summary 75

Chapter 3 Temporal Processes: The When of Social Media 77

What Traditional Models Tell You About Events in Time 77

When Events Happen Uniformly in Time 79

Inter-Event Times 81

Comparing to a Memoryless Process 86

Autocorrelations 89

Deviations from Memorylessness 91

Periodicities in Time in User Activities 93

Bursty Activities of Individuals 99

Correlations and Bursts 105

Reservoir Sampling 106

Forecasting Metrics in Time 110

Finding Trends 112

Finding Seasonality 115

Forecasting Time Series with ARIMA 117

The Autoregressive Part (“AR”) 118

The Moving Average Part (“MA”) 119

The Full ARIMA(p, d, q) Model 119

Summary 121

Chapter 4 Content: The What of Social Media 123

Defining Content: Focus on Text and Unstructured Data 123

Creating Features from Text: The Basics of Natural Language Processing 125

The Basic Statistics of Term Occurrences in Text 128

Using Content Features to Identify Topics 129

The Popularity of Topics 138

How Diverse Are Individual Users’ Interests? 141

Extracting Low-Dimensional Information from High-Dimensional Text 144

Topic Modeling 145

Unsupervised Topic Modeling 147

Supervised Topic Modeling 155

Relational Topic Modeling 162

Summary 169

Chapter 5 Processing Large Datasets 171

Map Reduce: Structuring Parallel and Sequential Operations 172

Counting Words 174

Skew: The Curse of the Last Reducer 177

Multi-Stage MapReduce Flows 179

Fan-Out 180

Merging Data Streams 181

Joining Two Data Sources 183

Joining Against Small Datasets 186

Models of Large-Scale MapReduce 187

Patterns in MapReduce Programming 188

Static MapReduce Jobs 188

Iterative MapReduce Jobs 195

PageRank for Ranking in Graphs 195

K-means Clustering 199

Incremental MapReduce Jobs 203

Temporal MapReduce Jobs 204

Rollups and Data Cubing 205

Expanding Rollup Jobs 211

Challenges with Processing Long-Tailed Social Media Data 212

Sampling and Approximations: Getting Results with Less Computation 214

HyperLogLog 217

HyperLogLog Example 219

HyperLogLog on the Stack Exchange Dataset 221

Performance of HLL on Large Datasets 222

Bloom Filters 223

A Bloom Filter Example 226

Bloom Filter as Pre-Computed Membership Knowledge 228

Bloom Filters on Large Social Datasets 229

Count-Min Sketch 231

Count-Min Sketch—Heavy Hitters Example 233

Count-Min Sketch—Top Percentage Example 235

Aggregating Approximate Data Structures 235

Summary of Approximations 236

Executing on a Hadoop Cluster (Amazon EC2) 237

Installing a CDH Cluster on Amazon EC2 237

Providing IAM Access to Collaborators 241

Adding On-Demand Cluster Capabilities 242

Summary 243

Chapter 6 Learn, Map, and Recommend 245

Social Media Services Online 246

Search Engines 246

Content Engagement 246

Interactions with the Real World 248

Interactions with People 249

Problem Formulation 251

Learning and Mapping 253

Matrix Factorization 255

Learning, Training 257

Under- and Overfitting 257

Regularizing in Matrix Factorization 259

Non-Negative Matrix Factorization and Sparsity 260

Demonstration on Movie Ratings 261

Interpreting the Learned Stereotypes 265

Exploratory Analysis 269

Prediction and Recommendation 274

Evaluation 277

Overview of Methodologies 278

Nearest Neighbor-Based Approaches 278

Approaches Based on Supervised Learning 280

Predicting Movie Ratings with Logistic Regression 280

Common Issues with Features 288

Domain-Specific Applications 289

Summary 290

Chapter 7 Conclusions 293

The Surprising Stability of Human Interaction Patterns 293

Averages, Standard Deviations, and Sampling 296

Removing Outliers 303

Index 309

"Social media is a rich source of big data, so much so that 90% of Fortune 500 companies are investing in big data initiatives to help them predict consumer behavior. Knowing the most effective ways to mine social media data can help you acquire information that generates amazing business results. Social media is unstructured, dynamic, and future-oriented. Effective, insightful data mining requires new analytical tools and techniques. Written by experts at social networking companies, Social Media Data Mining and Analytics provides a hands-on course that teaches you how to use state-of-the-art tools and sophisticated data mining techniques specifically geared to social media. It digs deeply into the mechanics of collecting and applying social media data to understand customers, define trends, and make predictions that can improve analytics for growth and sales. "--Amazon.com

600-699

There are no comments for this item.

to post a comment.