Senior Data Specialist (Lead Data Engineer)

Career Area

Technology, Digital and Data

Job Description

Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

Your Impact Shapes the World at Caterpillar Inc

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

Job Summary

We are seeking a skilled Senior Data Specialist (Lead Data Engineer) join our Financial Systems Tech Support -CAT IT Division

who can operate as a strong hands-on individual contributor while providing technical leadership and guidance across enterprise data initiatives. This role is responsible for designing, developing, implementing, and supporting scalable data solutions, analytics platforms, and automation capabilities that enable data-driven decision making across the organisation.

The ideal candidate will possess deep expertise in Data Engineering, Power BI, Microsoft Power Platform, Database Technologies, Cloud Platforms, System Design, and Modern Data Architectures. This individual should be capable of independently solving complex technical challenges, driving solution design, evaluating emerging technologies, mentoring team members, and ensuring the successful delivery of high-quality data products.

The role requires a balance of strong technical execution, architectural thinking, debugging expertise, stakeholder collaboration, and continuous innovation.

The preference for this role is to be based out of Bangalore – Caterpillar PSN

What You Will Do

Data Engineering & Platform Development

Hands-on Data Engineering

Design, develop, and maintain scalable, reliable batch, near real-time or streaming data pipelines.Build and optimise ETL/ELT solutions that process large volumes of structured and unstructured data.Develop reusable data integration frameworks, ingestion components, and orchestration workflows.Design and implement enterprise-grade data warehouses, data lakes, and modern data platforms.Integrate data from databases, APIs, enterprise applications, SaaS platforms, files, and external systems.Ensure data accuracy, consistency, reliability, and traceability across all data assets.Develop scalable data models that support reporting, analytics, operational workloads, and future AI/ML initiatives.

Data Quality & Governance

Implement data quality controls, validation frameworks, and reconciliation processes.Establish monitoring, observability, lineage, metadata management, and auditing capabilities.Ensure compliance with data governance, privacy, security, and retention requirements.Partner with governance and business teams to improve trust and usability of enterprise data.

Visualization Solutions (Good to have)

Power BI Development

Design and develop enterprise-grade dashboards, reports, scorecards, and executive visualisations using Power BI.Create intuitive, interactive, and business-focused visualisations that provide meaningful insights.Develop and maintain semantic models, datasets, KPIs, metrics, and reporting frameworks.Design star schemas and dimensional models to support reporting and analytics requirements.Implement advanced DAX calculations, measures, and performance optimisation techniques.

Business Intelligence & Reporting

Collaborate closely with business stakeholders to understand reporting requirements and translate them into scalable BI solutions.Establish Power BI development standards, governance practices, and reporting best practices.Optimize report performance, data refresh processes, and dataset management.Implement Row-Level Security (RLS) and data access controls where required.

Power Platform & Automation

Power Automate

Design and implement automated business processes using Microsoft Power Automate.Build workflows for approvals, notifications, data synchronisation, document processing, and operational automation.Integrate Power Automate with SharePoint, Power BI, Dataverse, Microsoft 365, APIs, and enterprise systems.Identify opportunities to automate manual business processes and improve operational efficiency.

Power Platform

Contribute to the design and implementation of solutions using the Microsoft Power Platform ecosystem.Support integration between Power Apps, Power BI, data platforms, and backend systems.Ensure solutions are scalable, maintainable, secure, and aligned with governance standards.

Solution Design & Architecture

Solution Ownership

Translate business requirements into scalable, secure, and maintainable technical solutions.Design end-to-end architectures for data ingestion, transformation, storage, reporting, and automation solutions.Develop high-level and low-level solution designs for complex technical initiatives.Evaluate architectural trade-offs related to performance, scalability, security, reliability, and cost.

System Design

Design enterprise-scale data platforms and distributed systems.Develop integration patterns for APIs, microservices, event-driven architectures, and cloud-native solutions.Define non-functional requirements including:ScalabilityPerformanceAvailabilityReliabilitySecurityMaintainabilityObservabilityParticipate in architecture reviews, design reviews, and technical governance activities.

Problem Solving & Debugging Excellence

Complex Problem Resolution

Lead analysis and resolution of complex technical challenges across data platforms and applications.Apply strong analytical thinking and systems-thinking approaches to troubleshoot issues.Translate ambiguous business problems into actionable technical solutions.

Debugging & Root Cause Analysis

Investigate and resolve issues across Data Pipelines, Power BI Reports, Dashboards, Database Platforms, Cloud Services, APIs and Integrations, and ETL/ELT Processes.Perform root cause analysis (RCA) and implement long-term corrective actions.Identify recurring issues and implement preventive engineering improvements.Develop monitoring, alerting, and observability strategies to proactively identify potential failures.

Performance Optimisation

Optimise SQL queries, ETL workloads, Power BI datasets, data models, and reporting solutions.Improve scalability, throughput, and performance of enterprise data platforms.Identify opportunities for automation and efficiency improvements.

Cloud & Modern Data Technologies

Cloud Platforms

Design and develop cloud-based data solutions leveraging modern cloud technologies.Support cloud migration, modernisation, and optimisation initiatives.Implement secure and scalable cloud-native data architectures.

Preferred Cloud Knowledge

AWS or AzureSnowflakeDatabricks

Responsibilities

Design highly available and fault-tolerant solutions.Support infrastructure automation and cloud governance initiatives.Implement secure storage, processing, and access patterns.Optimise cloud cost, performance, and operational efficiency.

Technology Exploration & Innovation

Emerging Technologies

Continuously evaluate emerging technologies, tools, frameworks, and industry trends.Research modern data engineering, analytics, automation, AI, and cloud platforms.Conduct Proof of Concepts to assess business value and technical feasibility.

Innovation

Explore new tools, frameworks, and engineering practices that improve productivity and scalability.Identify opportunities for automation, operational efficiency, and technical simplification.Drive continuous improvement initiatives across engineering teams.

Team Leadership & Collaboration

Technical Leadership

Provide technical leadership and mentorship to Data Engineers.Support design discussions, code reviews, troubleshooting sessions, and knowledge-sharing activities.Promote engineering standards, best practices, and consistent delivery approaches.

Team Collaboration

Work closely with Product Owners, Architects, Business Analysts, Data Scientists, Infrastructure Teams, and Business Stakeholders.Help prioritise work, remove technical blockers, and support successful project execution.Foster a culture of accountability, ownership, collaboration, and continuous learning.

What You Will Have

Education and Experience

Bachelor’s degree in computer science, Information Technology, Data Science, or a related field.10-14 years of experience in data engineering, data analysis, or software development.

Technical Skills

Strong experience on advanced SQL any Database. (Oracle, Teradata, snowflake).Experience in data integration area and hands on experience in any of the ETL tools like Datastage , Informatica , Snaplogic etc.Able to transform technical requirements into data collection query.Should be capable of working with business and other IT teams and convert the requirements into queries.Good understanding of ETL architecture and design.Good knowledge in Databases, SQL, or PL/SQLGood experience with CI/CD tools such as Github Actions (AzDO pipelines)Good to have knowledge on Unix commandsGood to have an experience on AWS GlueGood to have knowledge on Qlik replication toolThis position requires candidate to work a 5-day -a -week schedule in the office.Shift Timing: 01:00-10:00PM IST

Data Engineering

Advanced SQL and database development expertise.Strong hands-on experience with Python for data engineering and automation.Deep understanding of ETL/ELT architecture, data integration, and modern data engineering patterns.Experience with enterprise data platforms such as Snowflake, Oracle, SQL Server, PostgreSQL, Teradata, or similar technologies.Experience with integration platforms such as AWS Glue, SnapLogic, Informatica, DataStage, or equivalent tools.

Power Platform & Analytics

Strong experience developing Power BI reports, dashboards, and semantic models.Expertise in Power BI DAX, data modelling, report optimisation, and visualisation design.Experience with Power Automate workflow development and process automation.Working knowledge of the broader Microsoft Power Platform ecosystem.

Architecture & Engineering

Experience designing enterprise data platforms and distributed systems.Strong debugging, troubleshooting, and root cause analysis capabilities.Knowledge of API integration, microservices, and modern system design principles.Understanding of DevOps, CI/CD, source control, and deployment automation practices.

Cloud & Infrastructure

Experience with AWS and/or Azure cloud platforms.Knowledge of cloud-native architecture patterns and modern data services.Understanding of security, governance, monitoring, and operational support best practices.

Leadership & Professional Competencies

Strong problem-solving and analytical thinking skills.Excellent communication and stakeholder management capabilities.Ability to independently lead technical initiatives with minimal supervision.Strong ownership mindset and accountability for outcomes.Ability to influence technical decisions and guide engineering teams.Effective mentoring, coaching, and knowledge-sharing abilities.Passion for learning, innovation, and continuous improvement.

Success Measures

Delivery of reliable, scalable, and secure data solutions.High-quality Power BI dashboards and business intelligence capabilities.Increased automation and operational efficiency through Power Automate and Power Platform solutions.Effective resolution of production issues through strong debugging and root cause analysis practices.Successful adoption of new tools and technologies that enhance engineering productivity.Improved team capabilities through technical leadership and mentoring.Consistent delivery of business value through robust data engineering and analytics solutions.

What You Will Get

Work Life HarmonyEarned and medical leave.Relocation assistance

Holistic Development

Personal and professional development through Caterpillar ‘s employee resource groups across the globeCareer developments opportunities with global prospects

Health and Wellness

Medical coverage -Medical, life and personal accident coverageEmployee mental wellness assistance program

Financial Wellness

Employee investment planPay for performance -Annual incentive Bonus plan.

Additional Information

Caterpillar is not currently hiring individuals for this position who now or in the future require sponsorship for employment visa status; however, as a global company, Caterpillar offers many job opportunities outside of the U.S. which can be found through our employment website at www.caterpillar.com/careers

Caterpillar is an Equal Opportunity Employer (EEO)

EEO/AA Employer. All qualified individuals, including minorities, females, veterans and individuals with disabilities - are encouraged to apply.

Posting Dates

Caterpillar is an Equal Opportunity Employer. Qualified applicants of any age are encouraged to apply

Not ready to apply? Join our Talent Community.