Data Engineer
Main Technology & Mandatory skills: Data Bricks, Snowflake, PySpark, MS Fabric, Power Platforms
Responsibilities
- Design, build, and maintain scalable ETL/ELT pipelines using Databricks (PySpark) and Snowflake optimizing performance, cost, and reliability
- Author and tune complex SQL and implement transformations, stored procedures, streams/tasks, and CDC patterns for analytical workloads.
- Orchestrate and integrate data flows across Microsoft Fabric (Power Query, Fabric pipelines), Databricks, and Snowflake, ensuring lineage, governance, and monitoring.
- Enable Power Platform and BI consumers by providing curated datasets, semantic models and guidance for Power BI, Power Apps, and Power Automate usage.
- Collaborate with stakeholders, troubleshoot production issues, document data contracts/metadata, and mentor peers to drive best practices and measurable data platform outcomes.
Qualifications
Mandatory Skills:
- Building and maintaining scalable ETL/ELT pipelines
- Performance-tuning SQL for analytical workloads
- Building and scheduling pipelines
- Creating/curating datasets and semantic models
- Strong coding experience in Python (Pyspark)
- Stakeholder engagement, Documentation of workflows, mentoring peers
Required Skills
Optional Skills:
- Advanced PowerBI