Overview
Senior Data Engineer responsible for building and operating data solutions for large-scale data processing, analytics, and machine learning systems.
What you'll do
- Collect, store, process, and analyze large datasets.
- Select, maintain, implement, and monitor solutions for data processing and analysis.
- Integrate data solutions with company architecture.
- Help build core services that power machine learning and analytics systems.
What you'll need
- Ability to lead and work closely with teams, including virtual teams in non-UK locations.
- Ability to process and rationalize structured, message, and semi/unstructured data.
- Proficiency in distributed computing principles and scalable application design fundamentals.
- Strong knowledge of the Big Data ecosystem, including experience with Hortonworks/Cloudera platforms.
- Practical expertise with Hive and Spark (PySpark) querying tools.
- Strong Scala skills.
- Experience with Python, including the Anaconda environment and Python-based ML model deployment.
- Knowledge of CI/CD tools such as Jenkins/Hudson/Ansible.
- Experience working with Agile methods (SCRUM) and tools like Confluence/JIRA.
- Good written and spoken communication to engage stakeholders and synthesize priorities.
- Knowledge of one or more domains: Party/Client, Trade, Settlements, Payments, Instrument and pricing, Market and/or Credit Risk.
Nice to have
- Knowledge of Python web frameworks (Flask, Tornado, and/or twisted).
- Basic understanding of front-end technologies such as JavaScript, HTML5, and CSS3.
- Good understanding of global markets, markets macrostructure, and macro economics.
- Knowledge of Elastic Search Stack (ELK).
- Experience with Google Cloud Platform (Data Proc / Dataflow).
Details
- Teams may include virtual teams based in non UK locations.
Read the full description and apply on the company’s own careers page.
