Lead Software Engineer (Big Data, AWS) India
Lead Software Engineer (Big Data, AWS) Description
Job #: 90220
Join our dynamic team as a highly skilled and motivated Lead Big Data Engineer with expertise in Amazon Web Services (AWS). As the Lead Engineer, you will take charge of architecting, executing, and elevating complex Big Data solutions on the AWS platform. If you are passionate about innovation and dedicated to delivering excellence, we welcome you to be a part of our team and make a significant impact.
What You Have
- 8 to 13 Years of in Big Data & Data related technology experience
- Expert level understanding of distributed computing principles
- Expert level knowledge and experience in Apache Spark
- Hands on programing with Python / Java / Scala
- Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop
- Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming
- Experience with messaging systems, such as Kafka or RabbitMQ
- Good understanding of Big Data querying tools, such as Hive, and Impala
- Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files
- Good understanding of SQL queries, joins, stored procedures, relational schemas
- Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
- Knowledge of ETL techniques and frameworks
- Performance tuning of Spark Jobs
- Experience with native Cloud data services AWS or AZURE or GCP (Preferred)
- Ability to lead a team efficiently
- Experience with designing and implementing Big data solutions
- Practitioner of AGILE methodology
Technologies
- Data Engineering
- AWS
We Offer
- Opportunity to work on technical challenges that may impact across geographies
- Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications
- Opportunity to share your ideas on international platforms
- Sponsored Tech Talks & Hackathons
- Unlimited access to LinkedIn learning solutions
- Possibility to relocate to any EPAM office for short and long-term projects
- Focused individual development
- Benefit package: Health benefits, Retirement benefits, Paid time off, Flexible benefits
- Forums to explore beyond work passion (CSR, photography, painting, sports, etc.)
