Azure Data Engineer | 4 to 10 years | Navi Mumbai | 18 to 30 LPA | Big4

india, Maharashtra, Mumbai

Full–time

Posted on: 7 days ago

Job Title: Azure Data EngineerExperience: 5 to 10 YearsBudget: 20 to 30 LPALocation: Navi MumbaiType: Full-TimeSkills Required: Azure, Synapse, ADF, spark, SQL, Pyspark, spark-SQLJob Description:Key Responsibilities: Designs, implements and maintains reliable and scalable data infrastructure Writes, deploys and maintains software to build, integrate, manage, maintain,and quality-assure dataDevelops, and delivers large-scale data ingestion, data processing, and datatransformation projects on the Azure cloud Mentors and shares knowledge with the team to provide design reviews,discussions and prototypes Works with customers to deploy, manage, and audit standard processes forcloud products Adheres to and advocates for software & data engineering standard processes(e.g. Data Engineering pipelines, unit testing, monitoring, alerting, sourcecontrol, code review & documentation) Deploys secure and well-tested software that meets privacy and compliancerequirements; develops, maintains and improves CI / CD pipeline Service reliability and following site-reliability engineering standard processes:on-call rotations for services they maintain, responsible for defining andmaintaining SLAs. Designs, builds, deploys and maintains infrastructure as code.Containerizes server deployments. Part of a cross-disciplinary team working closely with other data engineers,Architects, software engineers, data scientists, data managers and businesspartners in a Scrum/Agile setupJob Requirements:Education :Bachelor or higher degree in computer science, Engineering, InformationSystems or other quantitative fieldsExperience :1) Years of experience: 6 to 9 years relevant experience2) Deep and hands-on experience building, productionizing, maintaining anddocumenting reliable and scalable data infrastructure and data products incomplex environments3) Hands on experience with:a) Spark for data processing (batch and/or real-time) - mustb) Configuring Delta Lake on Azure Databricks good to havec) Languages: SQL, pyspark, python - mustd) Cloud platforms: Azure - muste) Azure Data Factory (must) , Azure Data Lake (must), Azure SQL DB (must),Synapse (must), SQL Pools (must), Databricks (good to have)f) Building data solutions in Azure incl. data distributions and partitions,scalability, cost-management, disaster recovery and high availabilityg) Azure Devops (or similar tools) for source control & building CI/CD pipelines good to have4) Experience in implementing large-scale distributed systems5) Customer management and front-ending and ability to lead largeorganizations through influenceDesirable Criteria : Strong customer management- own the delivery for Data track with customerstakeholders Continuous learning and improvement attitudeKey Behaviors : Empathetic: Cares about our people, our community and our planet Curious: Seeks to explore and excel Creative: Imagines the extraordinary Inclusive: Brings out the best in each other