Senior Data Engineering - PSM-Libra

Overview

Senior Data Engineer responsible for building and operating data solutions for large-scale data processing, analytics, and machine learning systems.

What you'll do

• Collect, store, process, and analyze large datasets.
• Select, maintain, implement, and monitor solutions for data processing and analysis.
• Integrate data solutions with company architecture.
• Help build core services that power machine learning and analytics systems.

What you'll need

• Ability to lead and work closely with teams, including virtual teams in non-UK locations.
• Ability to process and rationalize structured, message, and semi/unstructured data.
• Proficiency in distributed computing principles and scalable application design fundamentals.
• Strong knowledge of the Big Data ecosystem, including experience with Hortonworks/Cloudera platforms.
• Practical expertise with Hive and Spark (PySpark) querying tools.
• Strong Scala skills.
• Experience with Python, including the Anaconda environment and Python-based ML model deployment.
• Knowledge of CI/CD tools such as Jenkins/Hudson/Ansible.
• Experience working with Agile methods (SCRUM) and tools like Confluence/JIRA.
• Good written and spoken communication to engage stakeholders and synthesize priorities.
• Knowledge of one or more domains: Party/Client, Trade, Settlements, Payments, Instrument and pricing, Market and/or Credit Risk.

Nice to have

• Knowledge of Python web frameworks (Flask, Tornado, and/or twisted).
• Basic understanding of front-end technologies such as JavaScript, HTML5, and CSS3.
• Good understanding of global markets, markets macrostructure, and macro economics.
• Knowledge of Elastic Search Stack (ELK).
• Experience with Google Cloud Platform (Data Proc / Dataflow).

Details

• Teams may include virtual teams based in non UK locations.