Azure Data Factory For Data Engineers - Project on Covid19

Real world project for Data Engineers using Azure Data Factory, SQL, Data Lake, Databricks, HDInsight, CI/CD [DP203]

4.60 (15865 reviews)

Udemy

platform

English

language

Other

What you will learn

You will learn how to build a real-world data pipeline in Azure Data Factory (ADF).

You will acquire good Data Engineering skills in Azure using Azure Data Factory (ADF), Azure Data Lake Storage Gen2, Azure SQL Database and Azure Monitor

You will learn how to ingest data from sources such as HTTP and Azure Blob Storage into Azure Data Lake Gen2 using Azure Data Factory (ADF)

You will learn how to transform data using Data Flows in Azure Data Factory (ADF) and load into Azure Data Lake Storage Gen2

You will learn how to transform data using Databricks Notebook Activity in Azure Data Factory (ADF) and load into Azure Data Lake Storage Gen2

You will learn how to transform data using Azure HDInsight Activity in Azure Data Factory (ADF) and load into Azure Data Lake Storage Gen2

You will learn how to load transformed data from Azure Data Lake Storage Gen2 to Azure SQL Database using Azure Data Factory (ADF)

You will learn extensively about Triggers in Azure Data Factory (ADF) and how to use them to schedule the data pipelines.

You will learn how to monitor pipelines using Azure Data Factory (ADF), Azure Monitor and Log Analytics with a real-world project.

You will learn how to build production ready pipelines and good practices and naming standards

You will learn the topics required on Azure Data Factory to pass the Azure Data Engineer Associate Certification Exam DP203

You will learn about how to create CI/CD pipelines in Azure Devops to release ADF pipelines to higher environments (Testing/ Production)

Loading charts...

Comidoc Review

Our Verdict

This course offers in-depth knowledge of Azure Data Factory, CI/CD pipelines, and best practices for production-ready pipelines. While there are minor concerns regarding the HDInsights section, outdated UI, and speaker's pace, the pros still outweigh the cons with its comprehensive content, real-world examples, and valuable tips. The course serves as an excellent starting point for those wanting to become Azure data engineers or ADF developers.

What We Liked

Comprehensive coverage of Azure Data Factory (ADF) and associated tools with a real-world project on Covid19 data
In-depth explanations of CI/CD pipelines in Azure DevOps for releasing ADF pipelines to higher environments
Valuable tips and best practices for building production-ready pipelines, monitoring, and naming conventions
High-quality content with real-world datasets that help build confidence in creating simple ADF Pipelines

Potential Drawbacks

The HDInsights section needs improvement, with outdated content affecting the overall learning experience
The speaker's pace can be too fast at times, requiring constant pausing and rewinding which may disrupt the flow
Lacks in-depth coverage of Data Quality and Datawarehouse implementation using star or snowflake schema
Minor issues with outdated Azure UI and a need for more imagery to visualize outputs