Senior Data Engineer Prague, Czech Republic or Remote
Senior Data Engineer Description
We are looking for a Senior Data Engineer to make a team even stronger.
#LI-DNI
Responsibilities
- Develop, monitor, and operate the most used and most critical curated data pipeline - Sales Order Data (incl. Post-order information, e.g. shipment, return, payment). This pipeline is processing hundreds of millions of records to provide high-quality datasets for analytical and machine learning use-cases
- Consulting with analysts, data scientists, and product managers to build and continuously improve "Single Source of Truth" KPI for business steering such as the central Profit Contribution measurement (PC II)
- Leverage and improve a cloud-based tech stack that includes AWS(Azure), Databricks, Kubernetes, Spark, Airflow, Python, and Scala
Requirements
- Expertise in Apache Spark along with Spark streaming & Spark SQL
- Good hands on experience with Databricks and delta-lake
- Fluency in Scala programming language
- Good understanding & hands-on experience with CI/CD
- Rich working experience with Github
- Fluency working with any cloud (AWS, Azure, GCP) landscape
- Ability to build Apache Airflow pipelines
We offer
- Opportunity to work in a fast-paced, agile, software engineering culture
- Comfortable modern office in Prague 7, with support of hybrid or fully remote mode
- Benefit program (5 weeks of vacation, paid sick days, paid days off for special occasions, meal vouchers, flexi pass, Prague city public transport annual coupon, multisport cards, optional contribution to pension fund, health insurance for family member)
- EPAM Employee Stock Purchase Plan (ESPP) (subject to certain eligibility requirements)
- English language courses
- Czech language courses upon request
- Referral bonuses for recommended candidates
- Mobile Phone Tariff’s program for managerial-level candidates
- Great learning and development opportunities, including in-house professional training, career advisory and coaching, sponsored professional certifications, well-being programs, LinkedIn Learning Solutions and much more
Certain benefits and perks may be subject to eligibility requirements and may be available only after you have passed your probationary period.