Data Engineering on Azure

This invaluable guide includes clear, practical guidance for setting up infrastructure, orchestration, workloads, and governance.

Data Engineering on Azure

Build a data platform to the industry-leading standards set by Microsoft’s own infrastructure. Summary In Data Engineering on Azure you will learn how to: Pick the right Azure services for different data scenarios Manage data inventory Implement production quality data modeling, analytics, and machine learning workloads Handle data governance Using DevOps to increase reliability Ingesting, storing, and distributing data Apply best practices for compliance and access control Data Engineering on Azure reveals the data management patterns and techniques that support Microsoft’s own massive data infrastructure. Author Vlad Riscutia, a data engineer at Microsoft, teaches you to bring an engineering rigor to your data platform and ensure that your data prototypes function just as well under the pressures of production. You'll implement common data modeling patterns, stand up cloud-native data platforms on Azure, and get to grips with DevOps for both analytics and machine learning. Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications. About the technology Build secure, stable data platforms that can scale to loads of any size. When a project moves from the lab into production, you need confidence that it can stand up to real-world challenges. This book teaches you to design and implement cloud-based data infrastructure that you can easily monitor, scale, and modify. About the book In Data Engineering on Azure you’ll learn the skills you need to build and maintain big data platforms in massive enterprises. This invaluable guide includes clear, practical guidance for setting up infrastructure, orchestration, workloads, and governance. As you go, you’ll set up efficient machine learning pipelines, and then master time-saving automation and DevOps solutions. The Azure-based examples are easy to reproduce on other cloud platforms. What's inside Data inventory and data governance Assure data quality, compliance, and distribution Build automated pipelines to increase reliability Ingest, store, and distribute data Production-quality data modeling, analytics, and machine learning About the reader For data engineers familiar with cloud computing and DevOps. About the author Vlad Riscutia is a software architect at Microsoft. Table of Contents 1 Introduction PART 1 INFRASTRUCTURE 2 Storage 3 DevOps 4 Orchestration PART 2 WORKLOADS 5 Processing 6 Analytics 7 Machine learning PART 3 GOVERNANCE 8 Metadata 9 Data quality 10 Compliance 11 Distributing data

More Books:

Data Engineering on Azure
Language: en
Pages: 336
Authors: Vlad Riscutia
Categories: Computers
Type: BOOK - Published: 2021-08-17 - Publisher: Simon and Schuster

Build a data platform to the industry-leading standards set by Microsoft’s own infrastructure. Summary In Data Engineering on Azure you will learn how to: Pick the right Azure services for different data scenarios Manage data inventory Implement production quality data modeling, analytics, and machine learning workloads Handle data governance Using
Data Engineering on Azure
Language: en
Pages: 336
Authors: Vlad Riscutia
Categories: Computers
Type: BOOK - Published: 2021-09-21 - Publisher: Simon and Schuster

Build a data platform to the industry-leading standards set by Microsoft’s own infrastructure. Summary In Data Engineering on Azure you will learn how to: Pick the right Azure services for different data scenarios Manage data inventory Implement production quality data modeling, analytics, and machine learning workloads Handle data governance Using
Azure Data Engineering Cookbook
Language: en
Pages: 454
Authors: Ahmad Osama
Categories: Computers
Type: BOOK - Published: 2021-04-05 - Publisher: Packt Publishing Ltd

Over 90 recipes to help data scientists and AI engineers orchestrate modern ETL/ELT workflows and perform analytics using Azure services more easily Key Features Discover how to work with different SQL and NoSQL data stores in Microsoft Azure Create and execute real-time processing solutions using Azure Databricks, Azure Stream Analytics,
The Definitive Guide to Azure Data Engineering
Language: en
Pages: 612
Authors: Ron C. L'Esteve
Categories: Computers
Type: BOOK - Published: 2021-08-24 - Publisher: Apress

Build efficient and scalable batch and real-time data ingestion pipelines, DevOps continuous integration and deployment pipelines, and advanced analytics solutions on the Azure Data Platform. This book teaches you to design and implement robust data engineering solutions using Data Factory, Databricks, Synapse Analytics, Snowflake, Azure SQL database, Stream Analytics, Cosmos
Azure Data Engineer Associate Certification Guide
Language: en
Pages: 574
Authors: Newton Alex
Categories: Computers
Type: BOOK - Published: 2022-02-28 - Publisher: Packt Publishing Ltd

Become well-versed with data engineering concepts and exam objectives to achieve Azure Data Engineer Associate certification Key Features Understand and apply data engineering concepts to real-world problems and prepare for the DP-203 certification exam Explore the various Azure services for building end-to-end data solutions Gain a solid understanding of building