Skip navigation EPAM

Senior / Lead Data Software Engineer Georgia or Remote

  • hot

Senior / Lead Data Software Engineer Description

Job #: 86080

DESCRIPTION


We are looking for an open-minded Senior / Lead Data Engineer to develop and maintain data-driven architecture. On our projects, we are developing pipelines to build business-related data products and design cloud-based platform solutions to support DataHub functionality.

#LI-DNI
#LI-DNP

What You’ll Do

  • Design and implement data pipelines
  • Perform data ingestion processes to include existing data sources in the new platform
  • Participate in platform engineering, including cloud-based solutions to support solution architecture, such as Ingestion Frameworks, Platform Orchestrators, Exploratory environments etc
  • Conduct MLOps activities to build production-ready cloud-based solutions to support existing ML pipelines
  • Take part in the design of on-prem to cloud migration activities

What You Have

  • Solid experience in Java, Python or Scala
  • Proficiency in SQL
  • Understanding of common Big Data problems (splitability, massive parallel processing, load-balancing, data locality, streaming, etc.) and related technologies (Apache Spark, Map-Reduce, HDFS)
  • Acquaintance with data modeling: relational/dimensional data, SCD, snowflaking, etc
  • English level – B1+, both written and spoken

Nice to have

  • Familiarity with common data-related architectures such as Data-Hub/Data Lake
  • Experience in cloud-based solutions, GCP, Terraform, Kubernetes

Technologies

  • Apache Spark, Kubernetes, Hadoop, Cloud Storage (S3, ADLS, GS, etc.), Cloud Functions, Airflow, Apache Kafka, Jenkins, Terraform, Avro, Parquet

We offer

  • Outstanding career development opportunities with a transparent roadmap to accelerate your journey
  • Knowledge sharing within the community of 61,300+ industry’s top professionals worldwide
  • Various opportunities for self-development: hard & soft skills internal training courses, mentoring programs, and unlimited access to 8,000+ LinkedIn Learning courses
  • Free English classes with certified teachers
  • Competitive compensation, regular assessments, and salary reviews
  • Participation in the Employee Stock Purchase Plan
  • Flexible working schedule
  • Friendly team, and enjoyable working environment
  • Relocation opportunities within our offices in 50+ countries
  • Social package – medical & family care
  • Five trust days a year (sick leave without a medical certificate)

About EPAM

  • EPAM Georgia is a team of innovators united by a passion for technology. The dynamic and inclusive culture we embrace helps positively impact our communities, customers, and employees. Here you will collaborate with multi-national teams, contribute to numerous cutting-edge projects, deliver the most creative solutions, and have an opportunity to learn. Our people are at the heart of our success, and we are proud to provide talents with a solid ground to develop and grow

Hello. How Can We Help You?

Our Offices