Senior Data Engineer Location: Bangalore (On-site)
Experience: 4+ Years
Employment Type: Full-Time

Role Overview
We are seeking a Senior Data Engineer with strong hands-on expertise in building scalable data platforms, modern ingestion pipelines, and high-performance data transformation workflows on Azure and Databricks.
The ideal candidate should have deep experience in distributed data processing, orchestration, CI/CD-driven data engineering, and delivering production-grade data solutions that support analytics, AI/ML, and business decision-making.

Key Responsibilities
Design, build, and maintain scalable data ingestion pipelines for structured and unstructured data sources.
Develop and optimize ETL/ELT workflows using PySpark, Python, and Databricks.
Implement complex data transformations, data cleansing, and enrichment processes.
Manage and optimize Databricks clusters, jobs, and performance tuning.
Work with Azure Storage Accounts, data lakes, and cloud-native data architectures.
Build robust data solutions using SQL and advanced query optimization techniques.
Develop and integrate data services using FastAPI and REST-based interfaces when required.
Design high-performance data models and optimize database queries for large-scale datasets.
Implement CI/CD pipelines for data engineering workflows using up-to-date DevOps practices.
Collaborate with Data Scientists, Architects, and Product teams to deliver reliable data products.
Ensure data quality, governance, monitoring, and operational excellence across pipelines.
Troubleshoot production issues and improve pipeline reliability and scalability.

Required Skills & Experience
Technical Skills
Strong experience in Azure Cloud services (Storage Accounts, Data Lake concepts).
Hands-on expertise with Databricks and cluster management.
Advanced proficiency in Python and PySpark.
Experience building large-scale data ingestion pipelines.
Strong understanding of ETL/ELT architectures.
Advanced SQL