Data Engineer with Databricks Croatia or Remote
Data Engineer with Databricks Description
Job #: 90270No less important is the safety, well-being, and experience of our applicants. Therefore, until further notice, all EPAM employment interviews will be conducted remotely. Our recruitment professionals and hiring managers are standing by to ensure a robust and engaging virtual candidate experience. We look forward to speaking with you!
DESCRIPTION
We are looking for a Data Engineer with Databricks knowledge to join our team in Croatia. As a Data Engineer, you will be supporting 1000+ stakeholders focusing on data transformation and pipeline orchestration technologies. By constantly challenging the status quo, you will ensure stakeholder teams to deliver high-performance data processing solutions that are efficient and remain reliable at scale.
Responsibilities
- Consult and help our diverse teams to develop, implement and maintain sustainable, high-performance, growth-ready data-processing and data integration systems
- Consulting with analysts, data scientists, and product managers to build and continuously improve KPI for business steering such as the central Profit Contribution measurement (PC II)
- Gather business requirements, analyze them, join the dots using data and drive the implementation
- Leverage and improve a cloud-based tech stack that includes AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala
- Prioritizing customer queries and escalating serious technical issues, automation of support activities (e.g cluster creations, configuration changes), documentation
- Maintenance of existing data pipelines, bug fixing, testing
Requirements
- 3+ years of hands-on experience in data processing focused projects
- Expertise in Apache Spark along with Spark streaming & Spark SQL
- Good hands on experience with Databricks and delta-lake
- Ability to build Apache Airflow pipelines
- Proficiency with Python or Scala and SQL
- Good hands on experience with cloud provider such as AWS or Azure
- Understanding of relational database management systems
- Relevant experience with version control and code review
- Knowledge of Agile methodologies
Nice to have
- Presto
- Superset
- Starburst
- Exasol
- Microstrategy
We offer
- Flexible working schedule and opportunity to work remotely from any place in Croatia
- Community of 65,000+ industry’s top professionals united for exchanging knowledge with experts from anywhere in the world
- Outstanding career development opportunities with a transparent career path and a roadmap to accelerate your journey
- Travel and relocation opportunities within our offices in 35+ countries and relocation support for you and your family
- Wide range of professional training, workshops, and mentoring programs plus unlimited access to LinkedIn Learning
- Learning resources and financial support for completing certification programs
- Competitive salary
- Xmas bonus
- Vacation bonus
- Food allowance
- Corporate health insurance (basic and supplementary)
- Free yearly Medical check-ups
- MultiSport Card
- 25 days of vacation