Manager - Data Engineering
Pine Labs · Delhi
- Experience10–15 yrs
- SalaryNot disclosed
- Work modeonsite
- Levelexecutive
- Posted17 Sept 2026
About Pine Labs
Pine Labs is hiring in Delhi in financial services. This role looks for around 10+ years of experience.
Skills
- Apache Kafka
- Debezium
- real-time event-driven architectures
- Apache Pinot
- Amazon Redshift
- RocksDB
- NoSQL
- Java
- Python
- Apache Airflow
- Apache Superset
- Apache Iceberg
- Amazon Athena
- AWS Glue
- Amazon Web Services
- AWS IAM
- Amazon S3
- AWS Lambda
- Amazon ECS
- Amazon EKS
- Amazon CloudWatch
- data lake architecture
- streaming processing
- batch processing
- change data capture
- Parquet
- Apache Avro
The role
A data engineering manager at a financial technology company builds data lake architecture and real-time event-driven architectures, using Apache Kafka and Apache Pinot for streaming ingestion and analytics-ready data layers. The role also applies Apache Airflow and Amazon Web Services to orchestrate and deploy scalable data platforms.
Full job description
Role Purpose:
We are looking for a highly skilled and motivated Data engineering manager with 10-15 years of experience to join our growing team. You will create data pipelines to move data from source to data lake, Maintain the data lake, real time transform the data to uncover actionable insights and contribute to strategic decision-making across various departments. The ideal candidate will have strong analytical and programming skills, a solid understanding of data pipeline and programming logic, and the ability to collaborate effectively with cross-functional teams. You will be helping all application teams by providing data interface, also will be ensuring that data analytics team is getting required data for their initiatives.
The responsibilities we entrust you
Own the data engineering roadmap – from streaming ingestion to analytics-ready layers.Lead and evolve our real-time data pipelines using Apache Kafka/MSK, Debezium CDC, and Apache Pinot.Design and maintain custom-built Java/Python-based frameworks for data ingestion, validation, transformation, and replication.Design and manage data lakes using Apache Iceberg, Glue, and Athena over S3.Define and enforce data modelling standards across Pinot, Redshift and warehouse layers.Lead implementation and scaling of open-source tools and orchestration platforms (Airflow).Drive cloud-native deployment strategies using ECS/EKS, Terraform/CDK, Docker.Collaborate with ML, product, and business teams to support advanced analytics and AI use cases.Mentor data engineers and evangelize modern architecture and engineering best practices.Ensure observability, lineage, data quality, and governance across the data stack.
Wha mattters in this role:
Must-Have:Proven expertise in Kafka/MSK, Debezium, and real-time event-driven architecturesHands-on experience with Pinot, Redshift, RocksDB or noSQL DBStrong background in custom tooling using Java and PythonExperience with Apache Airflow, Superset, Iceberg, Athena, and GlueStrong AWS ecosystem knowledge (IAM, S3, Lambda, Glue, ECS/EKS, CloudWatch, etc.)Deep understanding of data lake architecture, streaming vs batch processing, CDC conceptsFamiliarity with modern data formats (Parquet, Avro) and storage abstractionsNice-to-Have:Exposure to dbt, Trino/Presto, ClickHouse, or DruidFamiliarity with data security practices, encryption at rest/in-transit, GDPR/PCI complianceExperience with DevOps practices, GitHub Actions, CI/CD, and Terraform/CloudFormation
EducationBachelor's or Master's degree in Computer Science, Engineering, or a related field.
Communication & Ownership:Strong communication, interpersonal, and conflict resolution skillsAble to work both independently and as part of team
Location: Sector 62, Noida
Things you should be comfortable with:
Working from office: 5 days a weekPushing the boundaries: Have a big idea? See something that you feel we should do but haven’t done? We will hustle hard to make it happen. We encourage out of the box thinking, and if you bring that with you, we will make sure you get a bag that fits all the energy you bring along.
What we value inour people:You take the shot: You decide fast and deliver right.You are the CEO of what you do: You show ownership and make things happen.You sing your work like an artist: You seek to learn and take pride in thework you do.