Lead Data Engineer

Lead Data Engineer

  • Expected Joining Time: Immediate

  • Job Role and Designation: Lead Data Engineer

  • Experience Level: 10+ years

  • No. of Positions: 1

    About the Role:
    We are looking for a seasoned Lead Data Engineer with hands-on experience in Azure Data Factory, Databricks, and Python to lead data engineering initiatives for a major banking client. This is a leadership role requiring deep technical expertise and the ability to guide a team while collaborating with stakeholders to design scalable and efficient data solutions.

    Key Responsibilities:

    • Lead the development and optimization of data pipelines on Azure (Data Factory, Databricks).

    • Architect and implement data lakehouse solutions, ensuring data quality, performance, and reliability.

    • Drive data integration, transformation, and ingestion strategies across systems.

    • Collaborate with cross-functional teams to gather requirements and convert them into scalable data solutions.

    • Mentor and guide junior engineers, promote best practices, and conduct code reviews.

    • Support CI/CD for data workflows and contribute to automation initiatives.

    • Align data architecture with business strategy and governance policies.

    Required Skills:

    • Strong expertise in Azure Data Factory, Azure Databricks, ADLS, and Lakehouse Architecture

    • Proficiency in Python, SQL, PL/SQL, and SCD implementation

    • Experience with DevOps, CI/CD pipelines, Azure Synapse, and Data Architecture

    • Hands-on knowledge of Banking Domain and Data Governance

    • Excellent leadership, communication, and problem-solving skills

    Good to Have:

    • Familiarity with SSIS, SSAS, TFS, Power BI, Cosmos DB, UC4

    • Experience with Azure DevOps, Terraform, IaC tools

    • Certifications in Data Platforms (e.g., Microsoft Certified: Azure Data Engineer Associate)