Sr Engineer Data

Overview

As a Senior Engineer, Data, you will work on the Data and Analytics team to transform data from disparate systems into insights and analytics for business stakeholders. You will design, implement, and operate scalable data engineering solutions using cloud-based infrastructure and Agile methodology.

What you'll do

• Leverage cloud-based infrastructure to implement scalable, resilient, and efficient technology solutions.
• Collaborate with Data Engineers, Data Analysts, Data Scientists, DBAs, cross-functional teams, and business partners.
• Architect, design, implement, and operate data engineering solutions using Agile methodology.
• Apply hands-on experience across the software development lifecycle, from design to deployment.
• Use understanding of the full data lifecycle and the role of high-quality data across applications, machine learning, business analytics, and reporting.
• Facilitate and take ownership of assigned technical projects in a fast-paced environment.
• Communicate in writing and speaking in a collaborative cross-functional environment with the full spectrum of business divisions.
• Mentor junior team members through code reviews and recommend adherence to best practices.
• Write test cases to ensure data quality, reliability, and a high level of confidence.
• Advance new technologies to improve data quality and reliability.
• Continuously improve the quality, efficiency, and scalability of data pipelines.
• Use SQL query performance tuning, indexes, and materialized views to improve query performance.
• Implement efficient design concepts in OLTP and OLAP environments.
• Design and execute NoSQL databases to optimize Big Data storage and retrieval.
• Integrate APIs with external vendors to push and pull data between organizations.
• Use data orchestration pipelines with Argo or Airflow.

What you'll need

• Bachelor of Science degree in Computer Science or equivalent.
• At least 7 years of post-degree professional experience.
• 4+ years of development experience building and maintaining ETL pipelines.
• 3+ years of Python development experience.
• Experience with AWS integrations such as Kinesis, Firehose, Aurora Unload, Redshift, Spectrum, Elastic MapReduce, SageMaker, and Lambda.
• Deep understanding of writing test cases to ensure data quality, reliability, and a high level of confidence.
• Expert skills working with SQL queries, including performance tuning, utilizing indexes, and materialized views to improve query performance.
• Advanced knowledge of both OLTP and OLAP environments with successful implementation of efficient design concepts.
• Proficiency with the design and execution of NoSQL databases to optimize Big Data storage and retrieval.
• Experience with API code integrations with external vendors to push and pull data between organizations.
• Familiarity with data orchestration pipelines using Argo or Airflow.
• Knowledge of analytic tools such as R, Tableau, Plotly, and Python Pandas.
• Self-motivated and self-directed, with solid critical thinking skills and the ability to synthesize complex problems.
• Excellent written and speaking communication skills.

Nice to have

• Financial services industry experience.

Details

• Location: Bangalore, Karnataka, India.