Job Role: Fabric Data Engineer with Market Data
Job Location: Letterkenny, Ireland (Hybrid)
Job Type:3 months
Job Description:
Looking for a candidate with 7+ to 10 years of hands-on experience in Data Engineering and Microsoft Fabric. The candidate will be responsible for designing, building, maintaining scalable data solutions and reporting using Fabric.
Key Responsibilities:
- Experience in financial services, particularly with market data platforms, vendor data ingestion (Bloomberg, MSCI, LSEG, ICE), and entitlement management.
- Design and implement a Medallion Architecture (Landing/Bronze, Conformed/Silver, Data Products/Gold) on Microsoft Fabric Lakehouse using Delta tables.
- Implement SCD Type 2 patterns for slowly changing dimension tracking across conformed and product layers.
- Contribute to the design and integration of a Data Quality (DQ) Studio framework, including push-down execution, rule catalogs (Technical, Business, Custom Business, Monitoring), and API-first resilience patterns.
- Support BCDR (Business Continuity & Disaster Recovery) strategies, including workspace replication patterns for Fabric Warehouse, Fabric SQL Database (via SqlPackage), and Mirrored Cosmos DB.
- Experience in financial services, particularly with market data platforms, vendor data ingestion (Bloomberg, MSCI, LSEG, ICE), and entitlement management.
- Collaborate with Stakeholders and get requirements.
- Design and implement data pipelines using Data Factory in Microsoft Fabric.
- Ingest data from multiple data sources to Microsoft Fabric Lakehouse/Datawarehouse.
- Create OneLake shortcuts in Microsoft Fabric.
- Work on data transformations using PySpark/ Spark SQL
- Create semantic models and create power BI reports.
- Create CI/CD deployments
- Create Fabric Data Agents
- Troubleshoot performance issues.
Required Skills:
- Experience with Microsoft Fabric/ Lakehouse/Data Pipelines
- Knowledge of PySpark/Python/T-SQL
- Experience in Azure Data Factory
- Experience in ETL workflows
- Power BI experience
Regards,
Anusha
[email protected]
