Data Engineer

Overview

Lead the architecture, design and development of data warehousing solutions and mentor the data engineering team.

What you'll do

• Lead the architecture, design, and development of data warehousing solutions.
• Provide technical guidance and mentorship to the data engineering team.
• Ensure best practices in data warehousing, ETL / ELT processes, and data integration.
• Design, develop, and optimize ETL / ELT pipelines using industry-standard tools.
• Ensure data accuracy, integrity, and consistency across data sources.
• Monitor and troubleshoot ETL / ELT processes to ensure timely and accurate data loading.
• Implement and manage data warehousing solutions using Snowflake.
• Utilize AWS Glue for data integration and ETL / ELT tasks.
• Optimize data storage and retrieval processes to enhance performance.
• Apply AI/ML concepts to extract insights from large datasets.
• Integrate AI solutions like Cortex AI/AWS Bedrock into the data warehousing environment.
• Leverage knowledge in Finance, Accounts, and Manufacturing to understand business requirements.
• Develop data solutions that address specific needs within these domains.
• Collaborate with stakeholders to gather and analyse business requirements.

What you'll need

• Overall, 3 to 5 years' experience.
• 2+ years of experience in Data Analytics and Digital solutions with exposure to Lake house architecture.
• BTech in Computer Science or IT.
• Technical expertise with data models, data mining, and segmentation techniques.
• Knowledge of programming languages (e.g. Java and Python).
• Hands-on experience with SQL database design.
• Exposure to Cloud ETL / ELT, Cloud DWH, AI and ML tools.
• Domain expertise in Finance, Accounts, and Manufacturing.
• Strong analytical and problem-solving skills.
• Strong influencing and communication skills (written, verbal, presentation) with the ability to be a thought partner/coach to internal team.
• Exposure to agile software development, and/or development management.
• Positive attitude and motivation to deliver and ensure highest quality deliverables.
• Able to respond positively and calmly to shifting priorities, demands and timelines.

Nice to have

• Exposure to Cortex AI, AWS Bedrock, Copilot studio.

Details

• Location: Bangalore, Karnataka, India.