0

Explore Products

Best Sellers

New Releases

Books

Videos

Audiobooks

Free Learning

Databricks ML in Action

You're reading from Databricks ML in Action Learn how Databricks supports the entire ML lifecycle end to end from data ingestion to the model deployment

Product type Paperback

Published in May 2024

Publisher Packt

ISBN-13 9781800564893

Length 280 pages

Edition 1st Edition

Languages

Python

Tools

Spark NLP

Concepts

Machine Learning

Authors (4):

Hayley Horn

Amanda Baker

Anastasia Prokaieva

Stephanie Rivera

View More author details

Table of Contents (13) Chapters

Preface

1. Part 1: Overview of the Databricks Unified Data Intelligence Platform FREE CHAPTER

2. Chapter 1: Getting Started and Lakehouse Concepts

3. Chapter 2: Designing Databricks: Day One

4. Chapter 3: Building the Bronze Layer

5. Part 2: Heavily Project Focused

6. Chapter 4: Getting to Know Your Data

7. Chapter 5: Feature Engineering on Databricks

8. Chapter 6: Tools for Model Training and Experimenting

9. Chapter 7: Productionizing ML on Databricks

10. Chapter 8: Monitoring, Evaluating, and More

11. Index

Why subscribe?

12. Other Books You May Enjoy

DLT, starting with Bronze

As we touched upon in a previous chapter, remember that DLT actively simplifies your pipeline operations, empowering you to focus on setting clear objectives for your pipeline rather than getting bogged down in operational details. Building on this foundation, we will now delve into DLT’s capabilities. Auto Loader’s schema evolution is integrated with DLT, underscoring its utility in handling dynamic data schemas with minimal manual intervention.

DLT benefits and features

DLT is a sophisticated framework designed to construct reliable data pipelines. DLT automates and streamlines complex operations such as orchestration and cluster management, significantly boosting the efficiency of data workflows. All you need to do is specify your transformation logic to be up and running. We will focus on just a few of the benefits of DLT as they pertain to creating your Bronze data layer, but we’ve included a link to DLT documentation in the...

The rest of the chapter is locked

Register for a free Packt account to unlock a world of extra content!

A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.

Unlock this book and the full library FREE for 7 days

Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of

Start free trial

Renews at €18.99/month. Cancel anytime

Authors (4)

Stephanie Rivera

Stephanie Rivera

Stephanie Rivera has worked in big data and machine learning for 12 years. She collaborates with teams and companies as they design their Lakehouse as a Sr. Solutions Architect for Databricks. Previously Stephanie was the VP, Data Intelligence for a global company, taking in 20+ terabytes of data daily. She led the data science, data engineering, and business intelligence teams.

See other products by Stephanie Rivera

Hayley Horn

Hayley Horn

Hayley Horn started her data career 15 years ago as a data quality consultant on enterprise data integration projects. As a data scientist, she specialized in customer insights and strategy, and presented at Data Science and AI conferences in the US and Europe. She is currently a Sr. Solutions Architect for Databricks, with expertise in data science and technology modernization. A graduate of the MS Data Science program at Southern Methodist University in Dallas, Texas, USA, she is now a capstone advisor to students in their final semesters of the program.

See other products by Hayley Horn

Amanda Baker

Amanda Baker

Mandy Baker began her career in data 8 years ago. She loves leveraging her skills as a data scientist to orchestrate transformative journeys for companies across diverse industries as a Solutions Architect for Databricks. Her experiences have brought her from large corporations to small startups and everything in between. Mandy is a graduate of Carnegie Mellon University and the University of Washington.

See other products by Amanda Baker

Anastasia Prokaieva

Anastasia Prokaieva

Anastasia Prokaieva began her career 9 years ago as a research scientist at CEA (France), focusing on large data analysis and satellite data assimilation, treating terabytes of data. She has been working within the big data analysis and machine learning domain since then. In 2021, she joined Databricks and became the regional AI subject matter expert. On a daily basis, Anastasia consults Databricks users on best practices for implementing AI projects end-to-end. She also delivers training and workshops to democratize AI. Anastasia holds two MSc degrees in theoretical physics and energy science.

See other products by Anastasia Prokaieva

Personalised recommendations for you

Based on your interests and search pattern

Modern Computer Vision with PyTorch

Modern Computer Vision with PyTorch

This book provides a hands-on approach to solving over 30 prominent real-world computer vision problems using PyTorch 2.x on actual datasets. Here you'll learn to build a neural network from scratch and optimize hyperparameters, perform image classification, multi-object detection, segmentation, and more. You'll also explore facial expression manipulation and combining CV with NLP and RL techniques, build generative AI applications, and take your model to production on AWS. By the end of this book, you'll master modern NN architectures and confidently solve real-world CV problems.

Jun 2024 24h 52m

Modern Computer Vision with PyTorch

Modern Computer Vision with PyTorch

This book provides a hands-on approach to solving over 30 prominent real-world computer vision problems using PyTorch 2.x on actual datasets. Here you'll learn to build a neural network from scratch and optimize hyperparameters, perform image classification, multi-object detection, segmentation, and more. You'll also explore facial expression manipulation and combining CV with NLP and RL techniques, build generative AI applications, and take your model to production on AWS. By the end of this book, you'll master modern NN architectures and confidently solve real-world CV problems.

Jun 2024 24h 52m

Data Governance Handbook

Data Governance Handbook

This book provides a highly focused view of real business outcomes powered by data governance, that resonate with non-data executives such as CFOs and CEOs. You'll also find useful insights into how to implement data governance initiatives.

May 2024 13h 8m

Data Engineering with Databricks Cookbook

Data Engineering with Databricks Cookbook

This book shows you how to use Apache Spark, Delta Lake, and Databricks to build data pipelines, manage and transform data, optimize performance, and more. Additionally, you'll implement DataOps and DevOps practices, and orchestrate data workflows.

May 2024 14h 36m

Azure Data Engineer Associate Certification Guide

Azure Data Engineer Associate Certification Guide

Unlock the power of Azure data engineering with this certification guide, elevating your skills in data processing, storage, and security with the help of practical insights, hands-on exercises, and the latest advancements.

May 2024 18h 16m

Microsoft Power BI Cookbook

Microsoft Power BI Cookbook

Microsoft Power BI is the most sought-after platform for BI professionals' visualization needs. Explore the latest Power BI features, future AI enhancements, and integration with other Power Platform tools via new recipes in this updated edition.

Jul 2024 19h 56m

Python Data Cleaning Cookbook

Python Data Cleaning Cookbook

The book shows you how to clean, wrangle, and view data from multiple perspectives, including dataset and column attributes. You will cover common and not-so-common challenges that are faced while cleaning messy data for complex situations and learn to manipulate data to get it down to a form that can be useful for making the right decisions.

May 2024 16h 12m

Microsoft Azure AI Fundamentals AI-900 Exam Guide

Microsoft Azure AI Fundamentals AI-900 Exam Guide

This AI-900 study guide will help you prepare and practice for the certification exam. You'll delve into AI workloads, ML principles, computer vision, NLP, knowledge mining, and generative AI using Azure cloud services.

May 2024 9h 36m

Using Stable Diffusion with Python

Using Stable Diffusion with Python

This book shows you how to use Python to control Stable Diffusion and generate high-quality images. In addition to covering the basic usage of the diffusers package, the book provides solutions for extending the package for more advanced purposes.

Jun 2024 11h 44m

Getting Started with DuckDB

Getting Started with DuckDB

This hands-on book teaches you to analyze large datasets with blazing speed and ease. You will learn how to use DuckDB to quickly load, query, transform, analyze, and visualize data effectively through a series of practical examples.

Jun 2024 12h 44m

Databricks Certified Associate Developer for Apache Spark Using Python

Databricks Certified Associate Developer for Apache Spark Using Python

This guide gets you ready for certification with expert-backed content, key exam concepts, and topic reviews. Additionally, you'll be able to make the most of Apache Spark 3.0 to modernize workloads and more using specific tools and techniques.