Packt+ | Advance your knowledge in tech

You're reading from Stream Analytics with Microsoft Azure Real-time data processing for quick insights using Azure Stream Analytics

Product type Paperback

Published in Dec 2017

Publisher Packt

ISBN-13 9781788395908

Length 322 pages

Edition 1st Edition

Languages

PowerShell

Tools

Azure

Concepts

Cloud Computing

Authors (4):

Krishnaswamy Venkataraman

Ryan Murphy

Manpreet Singh

Anindita Basak

View More author details

Table of Contents (12) Chapters

Preface

1. Introducing Stream Processing and Real-Time Insights FREE CHAPTER

2. Introducing Azure Stream Analytics and Key Advantages

3. Designing Real-Time Streaming Pipelines

4. Developing Real-Time Event Processing with Azure Streaming

5. Building Using Stream Analytics Query Language

6. How to achieve Seamless Scalability with Automation

7. Integration of Microsoft Business Intelligence and Big Data

8. Designing and Managing Stream Analytics Jobs

9. Optimizing Intelligence in Azure Streaming

10. Understanding Stream Analytics Job Monitoring

11. Use Cases for Real-World Data Streaming Architectures

Reference data streams with Azure Stream Analytics

Reference data can be static or finite datasets which are slowly modifying, executed to perform a lookup, or joining/correlating input data streams of Azure Stream Analytics. Reference data streams supported by Azure Blob storage have a limit of 100 MB per Blob, but each Stream Analytics job can execute multiple Blobs with appropriate path patterns simultaneously. Reference data Blobs support a collection of file streams by partitioning through the same date/time identifiers as the name of the Blob. Each Blob is concatenated at the end of the Blob collection sequence, by specifying a date/time identifier greater than the last modified Blob in the sequence.

Configuration of Reference data for Azure Stream Analytics jobs

In order to configure the reference data stream for an Azure Stream Analytics job, the static dataset needs to be uploaded first as reference data to the Azure Block Blob storage, using Azure SDK/CLI/PowerShell/Azure Portal...