Jobs Description
"Advises on Azure toolset for data engineering Develops data engineering solutions on Azure Cloud ecosystem Supports and maintains data engineering solutions on Azure Cloud ecosystem Designs, builds and operationalises batch and realtime data pipelines using Azure services - Azure Synapse Analytics, Azure Data Factory, Azure DataBricks and Event Hub Designs,builds and operaionalises data layer on Azure Synapse Analytics, SQL DW and Cosmos Db Design, builds data migration scripts and migrates data using Azure services Proficient with Azure Data Platform components for Data Platform and Delta Lake - ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL,Azure functions with Python, Azure Purview and Cosmos DB Proficient with Azure Event Hub and Streaming Analytics and Managed Streaming for Apache Kafka Proficient with Azure DataBricks with Spark Proficient with using other open source technologies like Apache Airflow and dbt, Spark / Python or Spark / Scala Experience in developing batch and real time data pipelines for Data Warehouse and Datalake Experience in Scheduling and managing the data platform on Azure Data Factory"