Senior Data Engineer

Overview

Senior Data Engineer role designing, building and supporting the data and software solutions that power clinical research, including data integration, software product development and clinical trial information sharing.

What you'll do

• Design and develop ETL programs and workflows using Databricks
• Develop technical specifications for data loading rules
• Mentor and provide technical guidance to Software Engineers
• Design, implement, and architect software products
• Design, implement, and architect product extensions to meet customer-specific requirements
• Adhere to established standards while producing technical specifications, architectural specifications, data models, installation and qualification guides, and release notes for the software development process
• Support technical consulting activities for clients in the pharmaceutical industry
• Design and support clinical trial information sharing solutions
• Provide application support for existing products
• Support release management using versioning tools such as Azure DevOps Git and execute live deployments

What you'll need

• Bachelor's Degree in technical discipline (Mathematics, Science, Engineering, Computing, etc.) or a related study, or equivalent project-related experience
• Proven relevant experience in systems integration and implementation, or software development, or a related discipline
• Demonstrated ability to liaise with multiple stakeholders
• 5+ years of experience with Microsoft Azure components, in particular Azure SQL, Azure Databricks, and Azure Data Factory
• Experience implementing ETL solutions, particularly using Databricks
• Strong database development skills, particularly implementing SQL solutions in Azure SQL or Databricks environments, with good experience working with large datasets
• Experience improving data quality in data warehouses
• Experience testing ETL solutions, particularly using Genie and MS Copilot
• Experience using enterprise architecture modeling tools, frameworks, and methodologies such as TOGAF, SPARX EA, UML (Unified Modeling Language), BPMN (Business Process Model and Notation), and ArchiMate
• Experience designing data warehouses, applying Kimball's dimensional modeling techniques, and architecting ETL systems
• Experience working in Agile development methodology and authoring technical documents and specifications
• Experience debugging complex software systems
• Significant experience implementing data-driven systems with large-scale relational or object-oriented databases
• Ability to work in a high-pressure, results- and deadline-oriented environment

Details

• Location: India-Hyderabad-Remote
• Works in a matrix environment