Senior PySpark Python Data Engineer - Assistant Vice President

Overview

Senior-level data role bridging complex business requirements and technical data solutions, with a focus on regulatory reporting and liquidity risk initiatives.

What you'll do

• Consult with business clients to determine system functional specifications and partner with multiple management teams and other units to meet organizational objectives.
• Define, document, and validate detailed data requirements, data flows, and data lineage for new or enhanced systems and applications.
• Provide technical input during development and implementation phases, including formulating systems scope, data objectives, and necessary data architecture enhancements for complex, high-impact projects.
• Design and develop robust data models (conceptual, logical, physical) to support reporting, analytics, and business processes.
• Prepare and curate data for AI/ML model development, working closely with AI engineers on data quality, feature engineering, and model validation.
• Utilize advanced SQL for data extraction, manipulation, and analysis from relational databases, data warehouses, and Big Data platforms.
• Develop and maintain data visualization dashboards and reports using tools such as Tableau, Power BI, or QlikView, translating complex data into understandable business insights.
• Lead analysis of complex data sets to identify trends, patterns, and anomalies relevant to regulatory reporting, liquidity risk, and other critical financial functions.
• Identify and communicate data-related risks and impacts and propose risk mitigation options.
• Evaluate new data technologies, analytical tools, and evolving business requirements, and recommend systems alternatives and/or enhancements.
• Serve as advisor or coach to new or lower level analysts.
• Appropriately assess risk when making business decisions, driving compliance with applicable laws, rules and regulations, and escalating and reporting control issues with transparency.

What you'll need

• 8-12 years of experience as a Senior PySpark Python Data Engineer or similar role within the Financial Services industry.
• Experience in regulatory reporting (e.g., Basel, CCAR, FR 2052a) and liquidity risk is preferred.
• Advanced proficiency in PySpark, Python and SQL for complex data querying, analysis, and optimization across large datasets.
• Strong experience with relational databases (e.g., Oracle, SQL Server, DB2) and data warehousing concepts (e.g., dimensional modeling, star/snowflake schemas).
• Demonstrated expertise with Big Data technologies including Hadoop, Spark (PySpark/Scala Spark), Kafka, and cloud-based data platforms (e.g., AWS S3, Databricks).
• Demonstrated experience with data modeling tools and techniques.
• Proficiency in data visualization tools (e.g., Tableau, Power BI, QlikView) and strong Excel skills for data manipulation and presentation.
• Comprehensive knowledge of data analysis principles, methodologies, and data governance frameworks.
• Experience across all phases of the Software Development Life Cycle (SDLC), with a focus on data-centric projects.
• Clear and concise written and verbal communication.
• Demonstrated problem-solving and decision-making skills.
• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements.
• Bachelor's degree/University degree or equivalent experience.

Nice to have

• Master's degree.
• Experience with scripting languages for data analysis (e.g., Python, R).
• Experience with data preparation for AI/ML models and understanding of core AI/ML concepts and workflows.

Details

• Location: Pune, Maharashtra, India.
• Employment type: Full time.