Senior Software Engineer - Gen AI

Overview

Lead software engineering initiatives focused on complex data migration programs to Google Cloud Platform (GCP) and GenAI-enabled data engineering.

What you'll do

• Design and execute data migration strategies to GCP.
• Migrate structured and semi-structured data to BigQuery, Bigtable, and other GCP storage solutions.
• Build and optimize migration pipelines using Python, SQL, Dataproc, and Apache Spark.
• Implement batch and streaming migration patterns with Cloud Composer, Kafka, and Google Pub/Sub.
• Perform schema mapping, transformation, reconciliation, and validation.
• Lead projects, resolve technical challenges, and guide less experienced staff.
• Apply GenAI and automation to improve migration efficiency and data discovery.

What you'll need

• 4+ years of software engineering experience or equivalent experience, training, military experience, or education.
• Hands-on experience delivering complex data migration programs on GCP.
• Experience with GCP, BigQuery, Dataproc or Apache Spark, Bigtable, and Dataplex or Data Catalog.
• Python experience with ETL/ELT pipelines and automation.
• SQL experience with data transformation, validation, and reconciliation.
• Experience with MySQL, Hive, and MongoDB.
• Strong foundations in data engineering and cloud migration.

Nice to have

• Experience with Vertex AI, BigQuery ML, or GenAI-enabled GCP data services.
• Experience with GenAI, LLMs, embeddings, and prompt engineering.
• Experience with Apigee or REST APIs.
• Experience with metadata management, lineage, and governance.

Details

• Location: Hyderabad, India.