Azure Data Engineer

1. Introduction to Microsoft Azure and its Services

  • Azure Subscriptions
  • Azure Resources
  • Azure Free Tier Account
  • Azure Resource Manager
  • Azure Resource Manager Template
  • Azure Storage
  • Types of Azure Storage

2. Introduction To Azure Data Engineering

  • Understand the evolving world of data
  • Data abundance
  • Understanding the Data Engineering Problem
  • Understand job responsibilities
  • Understanding Data Engineering Processing – Extract Transform and Load
  • Overview of Azure Data Engineering Services
  • Understand data storage in Azure Storage
  • Understand data storage in Azure Data Lake Storage
  • Understand Azure Cosmos DB
  • Understand Azure SQL Database
  • Understand Azure Synapse Analytics
  • Understand Azure Stream Analytics
  • Understand Azure HDInsight
  • Understand other Azure data services

3. Storing Data in Azure

  • How to choose an Azure Storage Service in Azure
  • Create an Azure Storage Account
  • Connect an app to Azure Storage API
  • Connect to your Azure storage account
  • Explore Azure Storage security features
  • Understand storage account keys
  • Understand shared access signatures
  • Control network access to your storage account
  • Understand Advanced Threat Protection for Azure Storage
  • Explore Azure Data Lake Storage security features
  • Introduction to Blob storage
  • What are blobs?
  • Design a storage organization strategy

4. Azure Data Factory

  • Integrate data with Azure Data Factory or Azure Synapse Pipeline
  • Understand Azure Data Factory
  • Describe data integration patterns
  • Explain the data factory process
  • Understand Azure Data Factory components
  • Azure Data Factory security
  • Set-up Azure Data Factory
  • Create linked services
  • Create datasets
  • Create data factory activities and pipelines
  • Manage integration runtimes
  • Petabyte-scale ingestion with Azure Data Factory or Azure Synapse Pipeline
  • List the data factory ingestion methods
  • Describe data factory connectors
  • Understand data ingestion security considerations

5. Azure Databricks

  • Get started with Azure Databricks
  • Identify Azure Databricks workloads
  • Understand key concepts
  • Use Apache Spark in Azure Databricks
  • Create a Spark cluster
  • Use Spark in notebooks
  • Use Spark to work with data files
  • Visualize data
  • Get Started with Delta Lake
  • Create Delta Lake tables
  • Create and query catalog tables
  • Use Delta Lake for streaming data
  • Get started with SQL Warehouses
  • Create databases and tables
  • Create queries and dashboards
  • Understand Azure Databricks notebooks and pipelines
  • Create a linked service for Azure Databricks
  • Use a Notebook activity in a pipeline
  • Use parameters in a notebook
Share this Post!

About the Author : ABrilliants


Skip to toolbar