London, United Kingdom
Data Engineering Lead – London – Finance
London – Commodities Trading
Salary: Up to £95,000 + Bonus + Benefits
SQL, Relational Databases, Big Data, Message Queuing, AWS, Amazon Web Services, Redshift, EC2, EMR, RDS, Storm, Spark-Streaming, Python, Scala, NoSQL, Luigi, Airflow, Visualization, D3.JS, MongoDB, Cassandra
A global leading commodities trading organisation that have grown rapidly over the last few years and are dominating the physical commodities space. They are a technology driven firm that only seek the best technologists and have a unique role for a data engineering lead to take ownership of all big data solutions.
This role will see you work closely with all areas of the business with the quant, ops and project team and define and implement a cutting-edge data architecture and infrastructure, building data pipelines, manipulating data sets/structures and taken control of the AWS eco-system. You will need to have extensive experience with SQL and NoSQL databases and have excellent analytical skills. You will work on a wide range of projects from streaming data pipelines, assisting quants with data analysis and visualization, building the data lake solution using AWS and providing support for machine learning models and their main data platform.
Key requirements for this role are as follows:
- Advanced SQL knowledge with experience across a variety of databases
- Good experience with AWS cloud services and its associated tools
- Good experience with OO programming with Python
- Good experience in optimising big data pipelines
- Solid analytical skills
- A passion for working within the financial sector
This role offers a chance to join a dynamic global leading commodities trading house with the best IT specialists in the industry. If you enjoy bringing your own solutions and working in a challenging environment, where you are constantly learning and using the best technologies, you will be well suited here. This company offers a great team culture where you will be required to work hard and bring your own innovative ideas to build exceptional big data solutions.
Please get in contact with Jon Kay @ Harrington Starr for more information.