Search icon CANCEL
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Python Social Media Analytics
Python Social Media Analytics

Python Social Media Analytics: Analyze and visualize data from Twitter, YouTube, GitHub, and more

Arrow left icon
Profile Icon Siddhartha Chatterjee Profile Icon Baihaqi Siregar Profile Icon Michal Krystyanczuk
Arrow right icon
€22.99 €32.99
Full star icon Full star icon Full star icon Full star icon Empty star icon 4 (2 Ratings)
eBook Jul 2017 312 pages 1st Edition
eBook
€22.99 €32.99
Paperback
€41.99
Subscription
Free Trial
Renews at €18.99p/m
Arrow left icon
Profile Icon Siddhartha Chatterjee Profile Icon Baihaqi Siregar Profile Icon Michal Krystyanczuk
Arrow right icon
€22.99 €32.99
Full star icon Full star icon Full star icon Full star icon Empty star icon 4 (2 Ratings)
eBook Jul 2017 312 pages 1st Edition
eBook
€22.99 €32.99
Paperback
€41.99
Subscription
Free Trial
Renews at €18.99p/m
eBook
€22.99 €32.99
Paperback
€41.99
Subscription
Free Trial
Renews at €18.99p/m

What do you get with eBook?

Product feature icon Instant access to your Digital eBook purchase
Product feature icon Download this book in EPUB and PDF formats
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want
Table of content icon View table of contents Preview book icon Preview Book

Python Social Media Analytics

Harnessing Social Data - Connecting, Capturing, and Cleaning

The first step to realize the promise of social data, which we went through in Chapter 1, Introduction to the Latest Social Media Landscape and Importance, is by harnessing it. A proper harnessing strategy can help to remove obstacles to and expedite processing. As we saw in the last chapter, many sources of social data can be used through the Application Protocol Interfaces (APIs) of these platforms. However, the data coming from APIs is not readily usable for multiple cases, hence it requires several steps before the data is ready to be analyzed and then applied. Therefore, we have dedicated a chapter that explains in detail how to do this. We have briefly touched upon the technical notion of an API in the first chapter. Here we intend to go deeper into it and help you to understand its types and usage. We also want...

APIs in a nutshell

An API is the medium that allows the exchange of data points between a service and the programmer or user. API concepts have been widely used in the software industry when we needed different software to exchange data with with another. Mobile and internet applications have been using web services and APIs to enrich information from external sources. Social media also started creating APIs to share their data with third-party application developers. The popularity of data science has made APIs emerge also as a source for mining and knowledge creation. The nature of all social media is different, so are their APIs. The steps involved in making a connection may not differ greatly, but the data points we capture do.

Different types of API

...

Introduction to authentication techniques

Getting data from different APIs requires a good understanding of the data structure and authentication techniques that allow external users to access the resources served by an API. Historically, there were multiple ways of accessing API resources, but nowadays there is one common protocol used by all the main social media networks. When you get into the developer documentation you will most probably encounter the problem of authentication referred to by an enigmatic term, OAuth.

What is OAuth?

OAuth is simply an authorization protocol that allows users to share data with an application without sharing the password. It is a way to obtain a secure authorization scheme based on a token...

Parsing API outputs

The following subchapter will show you how to connect to different social networks and how to retrieve sample data.

Twitter

Twitter proposes three main APIs: the REST API, Streaming API, and the Ads API. We will be focused on the first two APIs, which provide respectively on-demand or stream data.

Creating application

As explained in the section about OAuth, you have to obtain credentials to be able to collect data from Twitter. There are some simple steps to perform this action:

  1. Create a Twitter account or use your existing one.
  2. Go to https://apps...

Basic cleaning techniques

Social media contains different types of data: information about user profiles, statistics (number of likes or number of followers), verbatims, and media. Quantitative data is very convenient for an analysis using statistical and numerical methods, but unstructured data such as user comments is much more challenging. To get meaningful information, one has to perform the whole process of information retrieval. It starts with the definition of the data type and data structure. On social media, unstructured data is related to text, images, videos, and sound and we will mostly deal with textual data. Then, the data has to be cleaned and normalized. Only after all these steps can we delve into the analysis.

Data type and encoding

...

MongoDB to store and access social data

According to Wikipedia:

MongoDB (from humongous) is a cross-platform document-oriented database. Classified as a NoSQL database, MongoDB eschews the traditional table-based relational database structure in favor of JSON-like documents with dynamic schemas (MongoDB calls the format BSON), making the integration of data in certain types of applications easier and faster. Released under a combination of the GNU Affero General Public License and the Apache License, MongoDB is free and open-source software.

Even though the objective of the chapter is not to explore the architecture of MongoDB in depth we are however going to explain the points that justify the use of MongoDB.

Along with ease of use, MongoDB is recognized for the following advantages:

  • Schema-less design: Unlike traditional relational databases, which require the data to fit its...

APIs in a nutshell


An API is the medium that allows the exchange of data points between a service and the programmer or user. API concepts have been widely used in the software industry when we needed different software to exchange data with with another. Mobile and internet applications have been using web services and APIs to enrich information from external sources. Social media also started creating APIs to share their data with third-party application developers. The popularity of data science has made APIs emerge also as a source for mining and knowledge creation. The nature of all social media is different, so are their APIs. The steps involved in making a connection may not differ greatly, but the data points we capture do.

Different types of API

Currently, two types of API are available. They are as follows:

  • RESTful API
  • Stream API

RESTful API

This is the most common type of API that most social media provides. The information from a REST API is static and is from historical data. The...

Introduction to authentication techniques


Getting data from different APIs requires a good understanding of the data structure and authentication techniques that allow external users to access the resources served by an API. Historically, there were multiple ways of accessing API resources, but nowadays there is one common protocol used by all the main social media networks. When you get into the developer documentation you will most probably encounter the problem of authentication referred to by an enigmatic term, OAuth.

What is OAuth?

OAuth is simply an authorization protocol that allows users to share data with an application without sharing the password. It is a way to obtain a secure authorization scheme based on a token-based authorization mechanism. There are two API authentication models using OAuth:

  • User authentication
  • Application authentication

User authentication

This is the most common form of resource authentication implementation. The signed request both identifies an application...

Left arrow icon Right arrow icon
Download code icon Download Code

Key benefits

  • Acquire data from various social media platforms such as Facebook, Twitter, YouTube, GitHub, and more
  • Analyze and extract actionable insights from your social data using various Python tools
  • A highly practical guide to conducting efficient social media analytics at scale

Description

Social Media platforms such as Facebook, Twitter, Forums, Pinterest, and YouTube have become part of everyday life in a big way. However, these complex and noisy data streams pose a potent challenge to everyone when it comes to harnessing them properly and benefiting from them. This book will introduce you to the concept of social media analytics, and how you can leverage its capabilities to empower your business. Right from acquiring data from various social networking sources such as Twitter, Facebook, YouTube, Pinterest, and social forums, you will see how to clean data and make it ready for analytical operations using various Python APIs. This book explains how to structure the clean data obtained and store in MongoDB using PyMongo. You will also perform web scraping and visualize data using Scrappy and Beautifulsoup. Finally, you will be introduced to different techniques to perform analytics at scale for your social data on the cloud, using Python and Spark. By the end of this book, you will be able to utilize the power of Python to gain valuable insights from social media data and use them to enhance your business processes.

Who is this book for?

If you are a programmer or a data analyst familiar with the Python programming language and want to perform analyses of your social data to acquire valuable business insights, this book is for you. The book does not assume any prior knowledge of any data analysis tool or process.

What you will learn

  • Understand the basics of social media mining
  • Use PyMongo to clean, store, and access data in MongoDB
  • Understand user reactions and emotion detection on Facebook
  • Perform Twitter sentiment analysis and entity recognition using Python
  • Analyze video and campaign performance on YouTube
  • Mine popular trends on GitHub and predict the next big technology
  • Extract conversational topics on public internet forums
  • Analyze user interests on Pinterest
  • Perform large-scale social media analytics on the cloud

Product Details

Country selected
Publication date, Length, Edition, Language, ISBN-13
Publication date : Jul 28, 2017
Length: 312 pages
Edition : 1st
Language : English
ISBN-13 : 9781787126756
Category :
Languages :
Concepts :

What do you get with eBook?

Product feature icon Instant access to your Digital eBook purchase
Product feature icon Download this book in EPUB and PDF formats
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want

Product Details

Publication date : Jul 28, 2017
Length: 312 pages
Edition : 1st
Language : English
ISBN-13 : 9781787126756
Category :
Languages :
Concepts :

Packt Subscriptions

See our plans and pricing
Modal Close icon
€18.99 billed monthly
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Simple pricing, no contract
€189.99 billed annually
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just €5 each
Feature tick icon Exclusive print discounts
€264.99 billed in 18 months
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just €5 each
Feature tick icon Exclusive print discounts

Frequently bought together


Stars icon
Total 108.97
Learning Data Mining with Python
€36.99
Python Web Scraping
€29.99
Python Social Media Analytics
€41.99
Total 108.97 Stars icon

Table of Contents

9 Chapters
Introduction to the Latest Social Media Landscape and Importance Chevron down icon Chevron up icon
Harnessing Social Data - Connecting, Capturing, and Cleaning Chevron down icon Chevron up icon
Uncovering Brand Activity, Popularity, and Emotions on Facebook Chevron down icon Chevron up icon
Analyzing Twitter Using Sentiment Analysis and Entity Recognition Chevron down icon Chevron up icon
Campaigns and Consumer Reaction Analytics on YouTube – Structured and Unstructured Chevron down icon Chevron up icon
The Next Great Technology – Trends Mining on GitHub Chevron down icon Chevron up icon
Scraping and Extracting Conversational Topics on Internet Forums Chevron down icon Chevron up icon
Demystifying Pinterest through Network Analysis of Users Interests Chevron down icon Chevron up icon
Social Data Analytics at Scale – Spark and Amazon Web Services Chevron down icon Chevron up icon

Customer reviews

Rating distribution
Full star icon Full star icon Full star icon Full star icon Empty star icon 4
(2 Ratings)
5 star 50%
4 star 0%
3 star 50%
2 star 0%
1 star 0%
Neha Aug 14, 2018
Full star icon Full star icon Full star icon Full star icon Full star icon 5
A really good book for a fresher who wants to study social meadia analytics.
Amazon Verified review Amazon
casatishum Dec 12, 2018
Full star icon Full star icon Full star icon Empty star icon Empty star icon 3
some codes no longer works since social media tend to change fast. on top of that, there're also errors in code, which makes it confusing and frustrating to follow. not recommending.
Amazon Verified review Amazon
Get free access to Packt library with over 7500+ books and video courses for 7 days!
Start Free Trial

FAQs

How do I buy and download an eBook? Chevron down icon Chevron up icon

Where there is an eBook version of a title available, you can buy it from the book details for that title. Add either the standalone eBook or the eBook and print book bundle to your shopping cart. Your eBook will show in your cart as a product on its own. After completing checkout and payment in the normal way, you will receive your receipt on the screen containing a link to a personalised PDF download file. This link will remain active for 30 days. You can download backup copies of the file by logging in to your account at any time.

If you already have Adobe reader installed, then clicking on the link will download and open the PDF file directly. If you don't, then save the PDF file on your machine and download the Reader to view it.

Please Note: Packt eBooks are non-returnable and non-refundable.

Packt eBook and Licensing When you buy an eBook from Packt Publishing, completing your purchase means you accept the terms of our licence agreement. Please read the full text of the agreement. In it we have tried to balance the need for the ebook to be usable for you the reader with our needs to protect the rights of us as Publishers and of our authors. In summary, the agreement says:

  • You may make copies of your eBook for your own use onto any machine
  • You may not pass copies of the eBook on to anyone else
How can I make a purchase on your website? Chevron down icon Chevron up icon

If you want to purchase a video course, eBook or Bundle (Print+eBook) please follow below steps:

  1. Register on our website using your email address and the password.
  2. Search for the title by name or ISBN using the search option.
  3. Select the title you want to purchase.
  4. Choose the format you wish to purchase the title in; if you order the Print Book, you get a free eBook copy of the same title. 
  5. Proceed with the checkout process (payment to be made using Credit Card, Debit Cart, or PayPal)
Where can I access support around an eBook? Chevron down icon Chevron up icon
  • If you experience a problem with using or installing Adobe Reader, the contact Adobe directly.
  • To view the errata for the book, see www.packtpub.com/support and view the pages for the title you have.
  • To view your account details or to download a new copy of the book go to www.packtpub.com/account
  • To contact us directly if a problem is not resolved, use www.packtpub.com/contact-us
What eBook formats do Packt support? Chevron down icon Chevron up icon

Our eBooks are currently available in a variety of formats such as PDF and ePubs. In the future, this may well change with trends and development in technology, but please note that our PDFs are not Adobe eBook Reader format, which has greater restrictions on security.

You will need to use Adobe Reader v9 or later in order to read Packt's PDF eBooks.

What are the benefits of eBooks? Chevron down icon Chevron up icon
  • You can get the information you need immediately
  • You can easily take them with you on a laptop
  • You can download them an unlimited number of times
  • You can print them out
  • They are copy-paste enabled
  • They are searchable
  • There is no password protection
  • They are lower price than print
  • They save resources and space
What is an eBook? Chevron down icon Chevron up icon

Packt eBooks are a complete electronic version of the print edition, available in PDF and ePub formats. Every piece of content down to the page numbering is the same. Because we save the costs of printing and shipping the book to you, we are able to offer eBooks at a lower cost than print editions.

When you have purchased an eBook, simply login to your account and click on the link in Your Download Area. We recommend you saving the file to your hard drive before opening it.

For optimal viewing of our eBooks, we recommend you download and install the free Adobe Reader version 9.