Azure Data Engineer

Dec. 12, 2022


As an Azure Data Engineer you can expect to… Help with Cloud data enablement for our customers, including On-Premise to Microsoft Azure transformation, D365 to Azure Data Lake and Azure Synapse implementation Participate and work among teams to architect, build, and deploy cloud data solutions for highly complex distributed software systems in Microsoft Azure Sound interesting? If so, you’ll have… 5+ years of experience with data platforms, data warehouses, Data Lake, and ETL At least 3 years experience around ADF, Spark, Databricks, Python, Azure Synapse, ADLS, and Azure Functions Deep Experience with performance tuning and optimization code running in databricks environment or Azure Synapse Strong knowledge on Common Data Model (CDM), Dataverse and Power BI Data Flows, as well as Git and GitHub Ability to use SQL, T-SQL stored procedures as well as experience in using Azure key vault, logic apps, and Azure DevOps Strong understanding of Cloud concepts – IaaS, PaaS, SaaS Experience with Data API Gateways to extract data from 3rd party apps Requirements Concepting and implementing Data Mesh architecture, Azure Purview, and Data Governance frameworks Building near real-time data ingestion and processing frameworks Implementing Delta Lake concepts: delta tables, SCD, schema evolution Working with PowerShell Scripting, and ARM templates Designing and building efficient pipelines to get data from different source systems like D365 F&O, CE, Salesforce, Workday, and SAP Using Azure Data Factory (ADF) or Synapse to create multiple complex pipelines and activities using both Azure and On-Prem data stores for full and incremental data loads into ADLS Working on reusable data extraction, transformation, and loading processes by creating Synapse pipelines Designing/Redesigning current flows to increase throughput and streamline data for downstream Applications/Consumers BenefitsWe offer competitive pay with and performance-based bonus. Our employees also enjoy unlimited paid time off and a flexible and affordable benefits program designed to help you be and stay well, including: medical, dental & vision coverage, flexible spending accounts, health reimbursement account, and a 401(k) plan with a company match. Additionally, you’ll have the benefit of working alongside enthusiastic and energetic teammates in a dynamic and thriving environment.HSO is an Equal Opportunity Employer. #LI-BD1#LI-REMOTE

Built with ❤️ for the ML Community by Dom © 2023 RemoteML