Senior Enterprise Data Engineer

Overview

Build, manage and optimize data pipelines and move them into production for data and analytics consumers such as business/data analysts and data scientists, operationalizing data and analytics on behalf of the business.

What you'll do

• Create, maintain, and optimize data pipelines from development to production for specific use cases.
• Use innovative and modern tools, data services, techniques, and well architected frameworks to automate the most-common, repeatable and tedious data preparation and integration tasks in order to minimize manual and error-prone processes and improve productivity.
• Assist with optimizing the data management infrastructure to drive automation in data integration and management.
• Implement and use modern data preparation, integration and AI-enabled metadata management tools and techniques, including MLOps framework and infrastructure automation.
• Track data consumption patterns.
• Perform intelligent sampling and caching.
• Monitor schema changes.
• Recommend, or sometimes even automate, existing and future integration flows.
• Collaborate closely with data science teams and with business (data) analysts in refining their data requirements and data consumption requirements for data and analytics initiatives.
• Build, model and curate data lake/warehouse and other data consumption methods.
• Perform other duties as assigned.
• Comply with all policies and standards.

What you'll need

• Bachelor's Degree in Computer Science/Engineering or equivalent experience.
• Typically 8+ years experience in implementation of Data & BI projects in a large-scale enterprise data lake/warehouse environment.
• Typically 8+ years experience in ETL/ELT Architecture and hands-on experience in developing ETL/ELT jobs and tools like Informatica PowerCenter/Informatica Cloud - IICS, AWS Glue.
• Working experience in SFDC and PeopleSoft in areas of Sales, Marketing, Finance, or Support domains.
• Knowledge or experience working with cloud data warehouses like Snowflake or AWS Redshift, and good understanding of ANSI SQL.
• Proven hands-on experience using Informatica components such as Designer, Workflow Manager, Workflow Monitor, Repository Manager, and Python.
• Hands-on experience with database performance tuning in Oracle or Postgres, and strong database languages such as SQL, PL/SQL, ANSI SQL, Unix Shell and Perl Scripting.
• Knowledge of end-to-end SDLC process in EDW, Data Lake, BI & MLOps projects, including advanced dimensional modeling and data warehouse/ODS concepts such as star schemas, snowflakes and normalized data models.
• Advanced ability to coordinate effectively with on-site and offshore resources through Managed Service Providers & IT Teams.
• Advanced excellent verbal and written communication skills.

Nice to have

• Informatica PowerCenter certification preferred.
• Intermediate knowledge of reporting tools like Tableau is desired.

Details

• Location: Hyderabad, Telangana, India.
• Work mode: 100% in office.