Data Engineer

OVERVIEW

The Enterprise Data Development team is responsible for designing & architecting solutions to integrate & transform business data into Data Warehouse to deliver data layer for the Enterprise using cutting edge cloud technologies like GCP. We design solutions to meet the expanding need for more and more internal/external information to be integrated with existing sources; research, implement and leverage new technologies to deliver more actionable insights to the enterprise. We integrate solutions that combine process, technology landscapes and business information from the core enterprise data sources that form our corporate information factory to provide end to end solutions for the business.

KEY ACCOUNTABILITIES

Design, create, code, and support a variety of GCP, ETL & SQL solutions.

Experience with agile techniques or methods

Work effectively in a distributed global team environment.

Effective technical & business communication with good influencing skills

Analyze existing processes and user development requirements to ensure maximum efficiency

Ability to manage multiple stakeholders, tasks and navigate through ambiguity & complexity

Turn information into insight by consulting with architects, solution managers, and analysts to understand the business needs & deliver solutions

Maintain strong technical skills and share knowledge with team members

Work with system users, other members of the IT Department, software vendors, and service providers to resolve problems

Support existing Data warehouses & related jobs.

Task / Job Scheduling experience (Talend, Tidal, Airflow, Linux)

Able to lead small projects/initiatives and contribute/lead effectively to the implementation of enterprise projects.

Proactive research into up-to-date technology or techniques for development

Should have automation mindset to embrace a Continuous Improvement mentality to streamline & eliminate waste in all processes.

Train and educate internal team, IT functions, and business users

Familiarity with real time and streaming data processes

MINIMUM QUALIFICATIONS

7-12+ years of relevant experience of working as Data Engineer or similar levels

Hands on experience on cutting edge cloud data engineering services

Understanding of SAP Landscape

Data Governance Tools (Any)

Basic understanding of Cyber Security requirements

Excellent communication skills- verbal and written

Excellent analytical skills

Excellent stakeholder management skills

Expert level

SQL

Python

Data Warehousing Concepts

Intermediate Level

Cloud (Storage, Modelling, Real time) GCP Preferred

Data Storage (S3 / Blob Storage)

Big Query

SQL

Composer

Cloud Functions (Lambda/Azure function)

dBT

Basic Level/Preferred

Data Modelling concepts

PREFERRED QUALIFICATIONS

GCP Data Engineer certification, GCP certification

Understanding of CPG industry