Skip navigation EPAM

Lead Data Software Engineer Portugal

Lead Data Software Engineer Description

DESCRIPTION


As a Data Software Lead, you will design, develop, and maintain data systems and solutions. You will collaborate with cross-functional teams to ensure data integration, quality, and security.

We are looking for a hands-on and lead data software engineer focused on Azure Data stack (Databricks) to join our growing Data Practice.

Responsibilities

  • Lead modern data platforms implementation starting from requirements identification and up to production releases
  • Design and develop highly scalable, maintainable and data centric solutions using Azure cloud and Databricks
  • Design, create, optimize and maintain EL/ETL/ELT data pipelines and orchestration processes
  • Design, create, optimize and maintain data models
  • Ensure data quality processes, monitoring and data cleansing
  • Contribute to data governance activities
  • Collaborate with cross-functional teams to integrate data into various systems and applications
  • Drive and facilitate direct communication with project sponsors and business stakeholders

Requirements

  • Azure Data stack experience: Databricks, Data Lakehouse, Delta Lake, ADF, ADLS, Apache Spark, SQL/NoSQL, Key vault
  • Strong experience with Python, PySpark
  • Strong understanding of data processing design patterns: EL, ETL, ELT, incremental/delta loads and data streaming (optional)
  • Strong knowledge of RDBMS, data marts and Lakehouse design concepts
  • Ability to support infrastructure, security, network, and data exchange and distribution topics
  • Ability to work collaboratively with cross-functional teams
  • Excellent problem-solving skills and attention to detail
  • Upper-Intermediate level of English, both spoken and written (B2+)

We Offer

  • Competitive compensation depending on experience and skills
  • Variety of projects within one company
  • Being a part of a project following engineering excellence standards
  • Individual career path and professional growth opportunities
  • Internal events and communities
  • Flexible work hours

Hello. How Can We Help You?

Our Offices