LEAD DATA ENGINEER – MICROSOFT FABRIC & AZURE

HSO India Pvt. Ltd.

Experience

10+ Years

Work Mode

Remote / Work From Home

Notice Period

Immediate to 30 Days

Employment Type

Full-Time

Salary

Best in the Market

About the Role

HSO is looking for an experienced Lead Data Engineer with 10+ years of experience in designing, developing, and implementing scalable data engineering solutions. The ideal candidate will have strong hands-on expertise in Microsoft Fabric and Microsoft Azure, along with experience in modern data platforms, data pipelines, data warehousing, ETL/ELT, and cloud-based data engineering.

Microsoft Fabric and Microsoft Azure are MANDATORY requirements for this position.

Key Responsibilities

• Lead the design and development of enterprise-grade data engineering solutions using Microsoft Fabric and Azure.
• Design scalable and reliable data pipelines for batch and real-time data processing.
• Develop and optimize ETL/ELT processes using modern Azure and Microsoft Fabric technologies.
• Work extensively with Microsoft Fabric Data Factory, Lakehouse, Data Warehouse, OneLake, and related Fabric components.
• Design and implement solutions using Azure Data Factory, Azure Data Lake Storage Gen2, Azure Synapse Analytics, Azure SQL, and other Azure data services.
• Develop data ingestion, transformation, cleansing, and integration processes from multiple source systems.
• Implement data models and data warehouse solutions supporting analytics and reporting requirements.
• Optimize data pipelines, queries, storage, and processing performance.
• Establish data quality, security, governance, and monitoring practices.
• Collaborate with Data Architects, Solution Architects, BI Developers, and business stakeholders.
• Provide technical leadership and mentoring to data engineering teams.
• Participate in solution design, estimation, code reviews, troubleshooting, and production support.

Mandatory Skills – Microsoft Fabric

• Strong hands-on experience with Microsoft Fabric Data Factory.
• Hands-on experience with Fabric Lakehouse and Fabric Data Warehouse.
• Strong understanding of OneLake.
• Experience with data pipelines, notebooks, and Dataflows Gen2.
• Experience with Fabric architecture, workspace management, data ingestion, transformation, and optimization.

Mandatory Skills – Microsoft Azure

• Strong hands-on experience with Azure Data Factory (ADF).
• Azure Data Lake Storage Gen2.
• Azure Synapse Analytics and Azure SQL.
• Azure Databricks and Azure Storage.
• Azure Functions / Logic Apps.
• Azure Key Vault, monitoring, and security services.

Technical Skills

• 10+ years of experience in Data Engineering / Data Platform development.
• Strong SQL and database development skills.
• Experience with Python and/or PySpark.
• Strong understanding of ETL/ELT and data pipeline development.
• Experience with Data Warehousing, dimensional modelling, and Lakehouse architecture.
• Knowledge of batch and real-time data processing.
• Experience with APIs, structured and unstructured data sources.
• Experience with Git, CI/CD, and DevOps practices.
• Knowledge of data security, governance, lineage, and data quality.
• Experience troubleshooting and optimizing complex data pipelines.

Leadership & Collaboration

• Proven ability to lead technical discussions and data engineering initiatives.
• Ability to translate business requirements into scalable technical solutions.
• Strong stakeholder management and communication skills.
• Experience mentoring data engineers.
• Ability to work independently in a remote environment.
• Strong analytical and problem-solving capabilities.

Preferred / Good-to-Have Skills

• Microsoft Certified: Azure Data Engineer Associate or equivalent certification.
• Experience with Power BI and Microsoft Power Platform.
• Experience integrating Dynamics 365 / Dataverse data.
• Experience with Microsoft Purview and Azure DevOps.
• Knowledge of real-time analytics and event-driven architectures.
• Experience with enterprise data migration and modernization projects.

Education

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
• Relevant Microsoft/Azure certifications will be an advantage.

Candidate Profile

• 10+ years of relevant Data Engineering experience.
• Strong hands-on experience with Microsoft Fabric – Mandatory.
• Strong hands-on experience with Microsoft Azure Data Services – Mandatory.
• Available to join immediately or within 30 days.
• Excellent communication and stakeholder management skills.
• Ability to independently lead data engineering projects and provide technical guidance.

Why Join HSO?

• Opportunity to work on global enterprise data and cloud transformation projects.
• Work with modern Microsoft technologies including Microsoft Fabric and Azure.
• Remote / Work From Home opportunity.
• Exposure to international clients and large-scale data platforms.
• Opportunity to work with a highly skilled and collaborative technology team.