Skip navigation EPAM

Senior/Lead Big Data Software Engineer Malaga, Spain

Senior/Lead Big Data Software Engineer Description

Job #: 53730
Striving for excellence is in our DNA. Since 1993, we have been helping the world’s leading companies imagine, design, engineer, and deliver software and digital experiences that change the world. We are more than just specialists, we are experts.

EPAM is committed to providing our global team of 36,700+ EPAMers with inspiring careers from day one. EPAMers lead with passion and honesty and think creatively. Our people are the source of our success and we value collaboration, try to always understand our customers’ business, and strive for the highest standards of excellence. In today’s new market conditions, we continue to support operations for hundreds of clients around the world remotely, with the vast majority of our teams working from home. No matter where you are located, you’ll join a dedicated, diverse community that will help you discover your fullest potential.

Project technologies and tools

  • AWS (glue, stepFn, S3, EKS)
  • Automation (Terraform, helm)
  • Hadoop (Hive, Spark, Sqoop)
  • Python, GitHub actions, Snowflake, Airflow and NiFi


  • Participate in full cycle of Big Data solutions engineering, including project scope definition and estimating (including work with the stakeholders); architecture design, modelling complex relationships in heterogeneous data environments; technical decision making; functionality implementation; refactoring and optimization
  • Provide technical leadership for the teammates, mentorship
  • Participate in knowledge sharing and best practices elaboration within our Big Data competency center


  • Strong Java development skills (must have an experience with Java 8 or 9)
  • Expertise in Scala will be very desirable, Python and/or R is a plus
  • Expertise in multithreading, functional programming
  • Strong mathematical and computer science background
  • 3+ years of production experience in modelling and engineering complex heterogeneous data solutions
  • Experience in Big Data stack, like Hadoop, MapReduce, Spark, Hive
  • Familiarity with AWS or other cloud platforms
  • Practical knowledge of microservices architecture approach, including usage of Netflix’s, Lighbend’s or other industry leading components for Service Discovery, API Gateway, Load balancing and Orchestration
  • Relational database experience using one of the following Oracle9i/10g/11g, SQL Server, DB2, MySQL, or PostgreSQL
  • Experience in No-SQL and Caching databases, one of the following: MongoDB, Cassandra, Redis, Terracotta, Ehcache
  • Knowledge of messaging middleware: RabbitMQ, Kafka, etc
  • Experience in web servers: Apache, Nginx or similar
  • Experience in one of the following application servers: Tomcat, JBoss, WildFly, Jetty, servers based on Netty, etc

We offer

  • Extended opportunity to grow professionally in a cross-cultural environment
  • Access to various on-line courses from leading provider
  • Access to engineering communities on a global scale
  • Unlimited access to LinkedIn learning solutions
  • Social benefits in line with local legislation
  • Health insurance and meal vouchers programs
  • Special discount program for EPAMers with providers across Malaga and in other cities around the world
  • Regular team collaboration events
  • Office in a good location with easy access
  • Referral bonuses
  • Relocation support (for people from other countries)

About the Project

Our client is an American petroleum-and-natural gas exploration and production company headquartered in Houston, Texas.

The task is to develop a Data Factory and help the client to become a data-driven organization.

Hello. How Can We Help You?

Our Offices