Principal Engineer I, BI & Analytics

Overview

Serve as a Principal Data Engineer in the Business Intelligence & Analytics function, owning the end-to-end availability, reliability, and accessibility of data in a Microsoft SQL data mart. Lead the creation, maintenance, support, and data integration processes for the data mart in partnership with BI, business, and technology counterparts.

What you'll do

• Design, develop, and maintain robust database solutions to deliver actionable insights to leadership and cross-functional teams.
• Build data models that support Business Intelligence and self-service reporting, adhering to industry and function-specific standards.
• Develop and maintain data models optimized for analytics and reporting.
• Write complex, efficient SQL queries using best practices and modern methodologies.
• Design, build, and maintain scalable ETL/ELT pipelines to ingest data from diverse internal and external sources.
• Optimize SQL queries and ETL jobs for performance and cost efficiency.
• Ensure the scalability, reliability, and maintainability of data pipelines.
• Collaborate with BI developers and analysts to ensure data availability, quality, and usability.
• Provide technical support for data-related issues and troubleshoot data pipeline failures.
• Implement monitoring and alerting mechanisms for proactive issue detection.
• Maintain comprehensive documentation for data flows, schemas, and processes.
• Continuously improve existing systems and processes by applying innovative solutions, best practices, and strategic thinking in data management.
• Implement processes to detect and resolve blocking, deadlocks, and inefficient queries.
• Proactively address data quality issues and ensure data integrity across systems.
• Own the end-to-end data flow process and understand various data types and their business context.
• Lead the creation, maintenance, and support of the data mart environment, including T-SQL tables, stored procedures, views, and functions.
• Ensure all processes and data imports function as designed and address issues in a timely and efficient manner.
• Set up and maintain ETL processes for the data mart using the most appropriate tool for the connection and data source.

What you'll need

• Minimum of 8 years of experience in a SQL Server database environment, including database design, data loading/unloading, performance tuning, and security best practices.
• Strong expertise in writing complex SQL queries using CTEs, subqueries, joins, and temporary tables.
• Solid experience with ETL/ELT processes and tools like Airbyte, dbt or AWS Glue.
• Proficiency in AWS cloud services such as S3, IAM Roles, Policies, and Lambda for database and data pipeline solutions.
• Experience orchestrating data workflows using Apache Airflow and/or Stonebranch UAC, including workflow design, scheduling, monitoring, and troubleshooting.
• Deep experience in developing SSIS packages and utilizing all data flow task transformations.
• Strong knowledge of data modeling concepts and best practices.
• Ability to manage multiple tasks simultaneously and pay close attention to detail.
• Exceptional oral and written communication skills.
• Comfort participating in team discussions and sharing feedback.
• Ability to communicate with all levels, including junior members and senior management.
• Ability to manage competing priorities.
• Ability to work both independently and as part of a team.
• Ability to work effectively with technical and business staff across geographic areas.

Nice to have

• Knowledge of Snowflake.
• Familiarity with BI tools such as Power BI.

Details

• Location: Hyderabad, Telangana.
• Full-time employment.
• Worker type: Employee.
• Workplace policy requires working in the designated office at least four days a week, with one day working outside an Invesco office.