Cloud Data Engineer

Job Description

We are looking for a Cloud Data Engineer, who will be responsible for planning, design, developing and maintaining data models, data pipelines and standards for various Data Integration & Data Lake and Data Warehouse projects in the AWS Cloud. Ensure new features and subject areas are modelled to integrate with existing structures and provide a consistent view. Develop and maintain documentation of the data architecture, data flow, and data models of the data warehouse appropriate for various audiences. Adopt Cloud technologies and industry best practices in the field of data lakes and data warehouse architecture and modelling.

The role is based in our Gurugram, India location which has a flexible hybrid work model that has employees in-office 2-3 days per week and 2-3 days per week remote.

This role requires a broad range of skills and the ability to step into different roles depending on the size and scope of the project.

Responsibilities

Demonstrated ability to have successfully complete multiple, complex technical data engineering projects and create high-level design and architecture of the solution. Able to communicate the capabilities and improvements offered by data solutions with both the development teams and business user teams. Participate in technical design discussions and implement solutions along with the team and assist in building/maintaining medallion data architecture. Develop and maintain data pipelines using AWS cloud-native data platforms and services following established patterns and team standards. Design, build and maintain robust ETL/ELT pipelines from multiple sources following the best practices. Design data pipes and automate data ingestion and cleansing, transformation activities using the DevOps methodologies. Contribute to migration of legacy pipelines to modern data architecture. Write complex SQL/python/Pyspark transformations and build data models that support analytics, reporting and downstream applications. Monitor, optimize and troubleshoot data pipelines to ensure reliability, scalability, security and compliance with the data quality and governance standards. Collaborate with cross-functional project team to deliver end-to-end solutions.

Qualifications

Minimum 3 years of experience working as a Data Engineer Must have experience with cloud-based data platforms, data lakes, cloud data warehouse (Redshift or Snowflake). Proven direct experience with traditional databases, RedShift, AWS Glue, AWS Bedrock, Athena, AWS Lambda, Sagemaker, Lake Formation, IAM, SQS, S3 and other AWS core services. Expertise in SQL and write optimized SQLs across platforms. Expertise in writing python scripts and ability to manipulate data using Pandas/Pyspark. Familiarity and usage of different file formats in batch processing like Parquet/ORC and Open table formats. Experience integrating data from CRM, ERP, and marketing platforms (Salesforce, Eloqua, Oracle) into data lake/warehouse. Experience in data modelling, ELT, implementing complex stored Procedures and standard DWH and ETL/ELT concepts. Experience in advanced concepts like setting up resource monitors, Role-based access controls (RBAC), query performance tuning, time travel and understanding how to use these features. Experience in deploying features such as data sharing, events, and lake-house patterns. Provide resolution to an extensive range of complicated data pipeline related problems, proactively and as issues surface. Experience with data security and data access controls and design. Strong analytical, troubleshooting, and critical thinking skills. Familiarity with Devops tools for version control, CI/CD, GitHub. Exposure to Enterprise BI tools like Power BI and ThoughtSpot. Experience developing and supporting production data pipelines. Exposure to AI and leveraging AI tools for daily tasks. Effective communication skills with ability to translate complex technical work to business users.

About Us

Our People, Our Culture

For more than 50 years, Verisk has helped property and casualty insurers make smarter decisions about risk through AI-powered risk modeling, advanced analytics, and technology solutions spanning the entire policy lifecycle. We are a leading strategic data, analytics, and technology partner to the global insurance industry, guided by core values of learning, caring, and results while maintaining the highest ethical standards as stewards of the industry's most comprehensive datasets. Learn more about Verisk and what we are doing within the insurance industry.

For the eighth consecutive year, Verisk is proudly recognized as a Great Place to Work® for outstanding workplace culture in the US, the fourth consecutive year in the UK, Spain, and India, and the second consecutive year in Poland. In addition, we’ve been recognized by The Wall Street Journal as one of the Best-Managed Companies and by Forbes as a World’s Best Employer, testaments to the value we place on workplace culture.

Our Culture : Explore our inclusive, people-first culture that fosters innovation, collaboration, and belonging.

Awards & Recognition : See why Verisk is consistently recognized as a Great Place to Work™ around the world.

Our Businesses : Learn about the diverse industries we serve — from insurance and energy to financial services and beyond.

Life at Verisk : Discover what it’s like to work at Verisk through employee stories, team highlights, and culture moments.

Careers at Verisk : Join a global team of problem-solvers and innovators doing meaningful work that’s shaping the future of industries. Whether you're just starting out or looking to take your career to the next level, Verisk offers growth, purpose, and a people-first culture

Let’s build something meaningful together!

Verisk Analytics is an equal opportunity employer.

All members of the Verisk Analytics family of companies are equal opportunity employers. We consider all qualified applicants for employment without regard to race, religion, color, national origin, citizenship, sex, gender identity and/or expression, sexual orientation, veteran's status, age or disability. Verisk’s minimum hiring age is 18 except in countries with a higher age limit subject to applicable law.

https://www.verisk.com/company/careers/

Unsolicited resumes sent to Verisk, including unsolicited resumes sent to a Verisk business mailing address, fax machine, or email address, or directly to Verisk employees, will be considered Verisk property. Verisk will NOT pay a fee for any placement resulting from the receipt of an unsolicited resume.

Verisk Employee Privacy Notice