Role Overview:
Join our high-impact Data AI team as a Lead Data Engineer (Microsoft Fabric / Azure). This role offers a chance to shape and build a modern, Fabric-first data platform. As a Technical Lead, you’ll spend ~70% of your time on hands-on engineeringand the rest on technical leadership—guiding best practices, designing architecture, and collaborating across teams and with clients. We need a data expert ready to lead by example and deliver business value through scalable, cloud-native (Fabric)data solutions.
What You Will Do:
End-to-End Data Engineering (Hands-On Development ~70%):Architect, develop, and orchestrate data pipelines and ETL/ELT workflows using Microsoft Fabric and Azureservices. Write and optimize SQL, Spark, and Python code to ingest, transform, and integrate large datasets from multiple sources (including APIs) into our data platform (e.g., OneLake, Fabric Lakehouse, Data Warehouse).
Platform Architecture Best Practices: Lead the design of a scalable, reusable Fabric-first data platform. Establish standards for data modeling, pipeline configuration, and system integration. Introduce reusable frameworks (e.g., config-driven pipeline architectures, centralized metadata) that streamline development across the team. Support the coexistence and integration of new Fabric components with existing Azure data services during the transition.
Data Consumption Analytics Enablement:Deliver analytics-ready datasets and well-defined semantic data models. Work with Power BI developers and analysts to ensure pipelines produce reliable, high-quality data for business reporting and self-service analytics. Partner with data scientists and AI/ML teams to deliver the data needed for advanced analytics and machine learning use cases.
DevOps Quality Assurance:Implement robust CI/CD pipelines (e.g., Azure DevOps) for data projects. Uphold code quality standards, testing practices, and documentation to ensure consistent, secure releases across development, test, and production. Manage deployments across multiple environments (internal and client) to ensure reliability and compliance with enterprise standards.
Technical Leadership Collaboration (~30%):Act as a “player-coach” in our small team. Mentor and guide developers through code reviews and design sessions, cultivating best practices in data engineering. Work closely with data architects, software engineers, business stakeholders, and client teams to align solutions with needs and to plan project delivery. Take a lead role in the adoption of Microsoft Fabric—guiding the migration of data pipelines and assets to Fabric, and championing its benefits across the organization.
What You Will NotDo:
Line Management:This is not a people-manager role. You will lead technicallybut not be responsible for direct HR management (no direct reports or performance appraisals).
Work in Isolation:You won’t be expected to single-handedly own every aspect of the data platform. Collaboration is key—you’ll work with a team and engage stakeholders rather than working in a silo.
Experience Technical Skills:
Ways of Working Behaviours:
Hands-On Leadership:You thrive on tackling technical challenges directly and leading by doing, while guiding teammates through example and support.
Accountability Ownership:You are a self-driven professional who takes full responsibility for delivering end-to-end solutions. You follow through on commitments and are dedicated to building robust, reliable systems.
Collaborative Communicative:You work effectively across disciplines and with external partners. You can translate complex technical concepts for non-technical stakeholders and value open communication and collaboration.
Adaptable Curious:You stay current with new technologies (especially Microsoft Fabric) and enjoy working in a fast-paced, evolving environment. You are pragmatic, focusing on delivering meaningful results while navigating new tools and challenges.
Mentorship Growth Mindset:You invest time in helping others improve. You provide constructive feedback, share knowledge, and foster a culture of continuous learning within the team.
This role represents a unique opportunity to take a lead role in shaping an Azure-based data platform that leverages the cutting-edge capabilities of Microsoft Fabric.
