Data & Analytics - Lead Azure Data Engineer Bangalore, India
Data & Analytics - Lead Azure Data Engineer Description
Job #: 90225
We are looking for a highly skilled and motivated Lead Data Azure Engineer. This role requires a deep understanding of distributed computing principles, extensive experience with Big Data technologies, and expertise in Azure services. As a Lead Engineer, you will play a critical role in designing, implementing, and optimizing complex Big Data solutions on the Azure platform.
#REF_IN_AzS
#REF_IN_AZS
#REF_IN_AzS
#REF_IN_AZS
What You Have
- 8 to 13 Years of IT & Big Data technologies experience
- Prior experience in ETL, data pipelines, data flow techniques using Azure Data Services
- Working experience in Python, Py Spark, Azure Data Factory, Azure Data Lake Gen2, Databricks, Azure Synapse and file formats like JSON & Parquet
- Experience in creating ADF Pipelines to source and process data sets
- Experience in creating Databricks notebooks to cleanse, transform and enrich data sets
- Good understanding about SQL, Databases, NO-SQL DBs, Data Warehouse, Hadoop and various data storage options on the cloud
- Development experience in orchestration of pipelines
- Experience in deployment and monitoring techniques
- Working experience with Azure DevOps CI/CD pipelines to deploy Azure resources
- Experience in handling operations / Integration with source repository
- Must have good knowledge on Datawarehouse concepts and Datawarehouse modelling
Technologies
- Big Data
- Azure
- Spark
We Offer
- Opportunity to work on technical challenges that may impact across geographies
- Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications
- Opportunity to share your ideas on international platforms
- Sponsored Tech Talks & Hackathons
- Unlimited access to LinkedIn learning solutions
- Possibility to relocate to any EPAM office for short and long-term projects
- Focused individual development
- Benefit package: Health benefits, Retirement benefits, Paid time off, Flexible benefits
- Forums to explore beyond work passion (CSR, photography, painting, sports, etc.)
