Search icon Close icon
Search icon CANCEL
Subscription
0
Cart icon
Cart
Close icon
You have no products in your basket yet
Save more on your purchases!
Savings automatically calculated. No voucher code required
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Home > Data > Databases > Microsoft Azure Data Lake Storage Service (Gen1 and Gen2) [Video]
Microsoft Azure Data Lake Storage Service (Gen1 and Gen2) [Video]
Microsoft Azure Data Lake Storage Service (Gen1 and Gen2) [Video]

Microsoft Azure Data Lake Storage Service (Gen1 and Gen2): How to ingest, process, and export data in Azure Data Lake using Databricks and HDInsight [Video]

By Eshant Garg
$183.99
Video Feb 2022 6 hours 13 minutes 1st Edition
Video
$183.99
Subscription
$15.99 Monthly
Video
$183.99
Subscription
$15.99 Monthly

What do you get with a video?

Product feature icon Download this video in MP4 format
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want
Buy Now
Table of content icon View table of contents Download code icon Download Code

Key benefits

  • Discover Microsoft Azure Data Lake
  • Learn to use Azure Databricks and HDInsight to process data in ADLS
  • Explore data lifecycle and architecture around Data Lake

Description

Azure Data Lake Storage Gen2 (ADLS) is a cloud-based repository for both structured and unstructured data. For example, you could use it to store everything, from documents to images to social media streams. This is one of the most effective ways to go for big data processing; that is, to store your data in ADLS and then process it using Spark, which is a faster version of Hadoop, on Azure Databricks. This is a comprehensive hands-on course for anyone who is interested in Azure’s big data analytics services. You will learn hands-on with examples to import data into ADLS and then securely access it and analyze it using Azure Databricks and Azure HDInsight. You will also learn how to monitor and optimize your Data Lake storage. This course provides an end-to-end demonstration for one to have a noticeably clear understanding of Data Lake. By the end of this course, you will learn how to ingest, process, and export data using Databricks and HDInsight. You will have a solid understanding of Microsoft Azure Data Lake Storage Service (Gen1 and Gen2) and its features and properties, which will help you further in your professional endeavors. All the resources for this course are available at https://github.com/PacktPublishing/Microsoft-Azure-Data-Lake-Storage-Service-Gen1-and-Gen2-

What you will learn

Explore Data Lake optimization strategy Learn to monitor the performance of your Data Lake Explore different tools and scenarios to ingest data into Data Lake Discover the five layers of security to protect Data Lake Explore data security and configure them using the Azure portal Learn to monitor Azure Storage Service through Metrics

Product Details

Country selected
Publication date : Feb 25, 2022
Length 6 hours 13 minutes
Edition : 1st Edition
Language : English
ISBN-13 : 9781803236407
Vendor :
Microsoft
Category :
Data
Concepts :
Databases

What do you get with a video?

Product feature icon Download this video in MP4 format
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want
Buy Now

Product Details

Publication date : Feb 25, 2022
Length 6 hours 13 minutes
Edition : 1st Edition
Language : English
ISBN-13 : 9781803236407
Vendor :
Microsoft
Category :
Data
Concepts :
Databases

Table of Contents

10 Chapters
1. Â Course Introduction Chevron down icon Chevron up icon
Course Introduction
2. Â Introduction to Azure Cloud Computing Chevron down icon Chevron up icon
Create Azure Free Subscription
Azure Portal Overview
Azure Services Overview
Resource Management Group and Subscription
Resource Groups
Tagging
Delete Resources and Set Budget
3. Introduction to Azure Data Lake Chevron down icon Chevron up icon
Problem Statement
What is Data Lake?
Data Lake Versus Hadoop
How Data Lake Gen2 Evolved
Azure Data Lake Versus Azure Blob storage
Provision Azure Data Lake Gen2 Account
Azure Data Lake Gen2 Account Overview
Hierarchical Namespace
Other Data Lake Gen 2 Features
4. Data Ingestion Chevron down icon Chevron up icon
Tools to Ingest Data in Data Lake
Demo - Ingest Using Portal and SE
Demo- Ingest Data Using Azcopy
Demo: Azure Blob Storage to Data Lake Gen2 Using Data Factory
Demo: SQL Server to Data Lake Gen2 Using Data Factory
Demo: Amazon S3 to Data Lake Gen2 Using Data Factory
5. Data Flow Around Data Lake Chevron down icon Chevron up icon
Data Flow Around Data Lake
Data Lake and Transient Clusters
6. Azure Data Lake Processing Through Databricks Chevron down icon Chevron up icon
Demo Overview
Demo: Provision Databricks, Clusters, and Workbook
Demo: Mount Data Lake to Databricks DBFS
Demo: Explore, Analyze, Clean, Transform, and Load Data
7. Azure Data Lake Processing Through HDInsight Chevron down icon Chevron up icon
Demo Overview
Create Azure Data Lake Storage Gen2 (Source) and SQL Server (Destination)
What is Managed Identity
Add Managed Identity to Gen2 and Database Accounts
Create HDInsight Interactive Query Cluster
Ambari Overview and UI
Ingest Dataset into Data Lake Storage
Data Extraction with Hive
Data Transformation with Hive
Data Export Using Sqoop
Summary
8. Security Layers in Data Lake Chevron down icon Chevron up icon
Introduction
Storage Access Keys
SAS - Shared Access Signature
Azure Active Directory
Access Control List (ACL)
Firewalls and Virtual Networks
Encryption in Transit
Encryption at Rest
Advanced Threat Protection
9. Data Lake Monitoring and Optimization Chevron down icon Chevron up icon
Activity Log
Demo - Activity Logs
Metrics
Demo: Metrics
Demo: Insights
Demo: Alerts
Diagnostic Settings
Demo: Diagnostic Settings
Optimization
10. Practice Tests and Bonus Chevron down icon Chevron up icon
Delete Resources

Recommendations for you

Left arrow icon
Building LLM Powered Applications
Building LLM Powered Applications
Read more
May 2024 342 pages
ebook
eBook
  • ebook eBook $39.99
  • print Print $49.99
$39.99
$49.99
Machine Learning with PyTorch and Scikit-Learn
Machine Learning with PyTorch and Scikit-Learn
Read more
Feb 2022 774 pages
Full star icon 5
ebook
eBook
  • ebook eBook $43.99
  • print Print $54.99
$43.99
$54.99
Transformers for Natural Language Processing and Computer Vision
Transformers for Natural Language Processing and Computer Vision
Read more
Feb 2024 728 pages
ebook
eBook
  • ebook eBook $43.99
  • print Print $54.99
$43.99
$54.99
The Definitive Guide to Power Query (M)
The Definitive Guide to Power Query (M)
Read more
Mar 2024 758 pages
ebook
eBook
  • ebook eBook $43.99
  • print Print $54.99
$43.99
$54.99
Building Smart Chatbots with LangChain
Building Smart Chatbots with LangChain
Read more
Jun 2024 4h 15m
video Video
$298.99
The Machine Learning Solutions Architect Handbook
The Machine Learning Solutions Architect Handbook
Read more
Apr 2024 602 pages
ebook
eBook
  • ebook eBook $32.99
  • print Print $40.99
$32.99
$40.99
Microsoft Azure AI Fundamentals AI-900 Exam Guide
Microsoft Azure AI Fundamentals AI-900 Exam Guide
Read more
May 2024 288 pages
ebook
eBook
  • ebook eBook $35.99
  • print Print $44.99
$35.99
$44.99
Generative AI with LangChain
Generative AI with LangChain
Read more
Dec 2023 360 pages
Full star icon 3
ebook
eBook
  • ebook eBook $39.99
  • print Print $39.98
$39.99
$39.98 $49.99
Mastering NLP from Foundations to LLMs
Mastering NLP from Foundations to LLMs
Read more
Apr 2024 340 pages
ebook
eBook
  • ebook eBook $42.99
  • print Print $52.99
$42.99
$52.99
Python Data Cleaning Cookbook
Python Data Cleaning Cookbook
Read more
May 2024 486 pages
ebook
eBook
  • ebook eBook $39.99
  • print Print $49.99
$39.99
$49.99
Right arrow icon

Customer reviews

Top Reviews
  • Top Reviews
  • Most Recent
Rating distribution
Empty star icon Empty star icon Empty star icon Empty star icon Empty star icon 0
(0 Ratings)
5 star 0%
4 star 0%
3 star 0%
2 star 0%
1 star 0%
Top Reviews
  • Top Reviews
  • Most Recent
No reviews found

People who bought this also bought

Left arrow icon
Machine Learning with PyTorch and Scikit-Learn
Machine Learning with PyTorch and Scikit-Learn
Read more
Feb 2022 774 pages
Full star icon 5
ebook
eBook
  • ebook eBook $9.99
  • print Print $54.99
$9.99 $43.99
$54.99
Machine Learning for Time-Series with Python
Machine Learning for Time-Series with Python
Read more
Oct 2021 370 pages
ebook
eBook
  • ebook eBook $9.99
  • print Print $54.99
$9.99 $43.99
$54.99
Modern Time Series Forecasting with Python
Modern Time Series Forecasting with Python
Read more
Nov 2022 552 pages
Full star icon 5
ebook
eBook
  • ebook eBook $9.99
  • print Print $52.99
$9.99 $42.99
$52.99
Deep Learning with TensorFlow and Keras – 3rd edition
Deep Learning with TensorFlow and Keras – 3rd edition
Read more
Oct 2022 698 pages
Full star icon 5
ebook
eBook
  • ebook eBook $9.99
  • print Print $49.99
$9.99 $39.99
$49.99
Hands-On Data Preprocessing in Python
Hands-On Data Preprocessing in Python
Read more
Jan 2022 602 pages
Full star icon 5
ebook
eBook
  • ebook eBook $9.99
  • print Print $54.99
$9.99 $43.99
$54.99
Microsoft Azure Data Lake Storage Service (Gen1 and Gen2)
Microsoft Azure Data Lake Storage Service (Gen1 and Gen2)
Read more
Feb 2022 6h 13m
video Video
$9.99 $183.99
Right arrow icon

About the author

Left arrow icon
Profile icon Eshant Garg
LinkedIn
Eshant Garg has 16 years of extensive professional experience with expertise in database and business intelligence solutions, advanced analytics, design and solution architecture, reporting, and cloud computing technologies (Azure and AWS). He loves to explain complicated things in a simple and effective way. As a developer and architect, he has worked closely with customers, users, and colleagues to support business solutions across a variety of industries including healthcare, insurance, finance, and government ranging from small companies to Fortune 500 companies. Outside of the technical world, he loves yoga and meditation. He is a student of the ancient yogic text, the Bhagavad Gita, and loves to discuss and practice philosophical teachings.
Read more
See other products by Eshant Garg
Right arrow icon
Get free access to Packt library with over 7500+ books and video courses for 7 days!
Start Free Trial

FAQs

How can I download a video package for offline viewing? Chevron down icon Chevron up icon
  1. Login to your account at Packtpub.com.
  2. Click on "My Account" and then click on the "My Videos" tab to access your videos.
  3. Click on the "Download Now" link to start your video download.
How can I extract my video file? Chevron down icon Chevron up icon

All modern operating systems ship with ZIP file extraction built in. If you'd prefer to use a dedicated compression application, we've tested WinRAR / 7-Zip for Windows, Zipeg / iZip / UnRarX for Mac and 7-Zip / PeaZip for Linux. These applications support all extension files.

How can I get help and support around my video package? Chevron down icon Chevron up icon

If your video course doesn't give you what you were expecting, either because of functionality problems or because the content isn't up to scratch, please mail customercare@packt.com with details of the problem. In addition, so that we can best provide the support you need, please include the following information for our support team.

  1. Video
  2. Format watched (HTML, MP4, streaming)
  3. Chapter or section that issue relates to (if relevant)
  4. System being played on
  5. Browser used (if relevant)
  6. Details of support
Why can’t I download my video package? Chevron down icon Chevron up icon

In the even that you are having issues downloading your video package then please follow these instructions:

  1. Disable all your browser plugins and extensions: Some security and download manager extensions can cause issues during the download.
  2. Download the video course using a different browser: We've tested downloads operate correctly in current versions of Chrome, Firefox, Internet Explorer, and Safari.