Senior Data Engineer - Financial Flows

<div><span style="font-size: 16px;">At Kpler, we are dedicated to helping our clients navigate complex markets with ease. By simplifying global trade information and providing valuable insights, we empower organisations to make informed decisions in commodities, energy, and maritime sectors. </span></div> <div>&nbsp;</div> <div><span style="font-size: 16px;">Since our founding in 2014, we have focused on delivering top-tier intelligence through user-friendly platforms. Our team of over 850 experts from 69 countries works tirelessly to transform intricate data into actionable strategies, ensuring our clients stay ahead in a dynamic market landscape. Join us to leverage cutting-edge innovation for impactful results and experience unparalleled support on your journey to success.</span></div> <div>&nbsp;</div><div><br></div><h2 data-path-to-node="4">About the Role</h2> <p data-path-to-node="5" id="p-rc_63af09973bbdb9af-222"><span data-path-to-node="5,0">As a Senior Data Engineer on the Financial Flows team, you will take full technical ownership of the end-to-end data pipelines, predictive models, and cloud infrastructure powering Kpler’s commodity finance analytics</span><span data-path-to-node="5,1"></span><span data-path-to-node="5,2">. You will lead the modernization of our data foundation, spearheading the migration of production services to AWS and re-architecting legacy calculation engines into clean, performant Python services</span><span data-path-to-node="5,3"></span><span data-path-to-node="5,4">. Operating at the crossroads of quantitative research and cloud infrastructure, your work will directly ensure that market participants receive real-time, mission-critical insights across global commodities markets</span><span data-path-to-node="5,5"></span><span data-path-to-node="5,6">.</span> </p> <p data-path-to-node="14,3,0" id="p-rc_63af09973bbdb9af-240"></p><br><strong>Key Responsibilities</strong><br><div> <ul data-path-to-node="8"> <li> <p data-path-to-node="8,0,0" id="p-rc_63af09973bbdb9af-223"><span data-path-to-node="8,0,0,0">Design, build, and operate resilient batch and real-time streaming data ingestion pipelines connecting to external financial market data providers via APIs and WebSockets</span><span data-path-to-node="8,0,0,1"></span><span data-path-to-node="8,0,0,2">.</span> </p> </li> <li> <p data-path-to-node="8,1,0" id="p-rc_63af09973bbdb9af-224"><span data-path-to-node="8,1,0,0">Lead the architectural migration of legacy backend infrastructure to modern cloud-native environments on AWS, establishing high standards for system reliability and scalability</span><span data-path-to-node="8,1,0,1"></span><span data-path-to-node="8,1,0,2">.</span> </p> </li> <li> <p data-path-to-node="8,2,0" id="p-rc_63af09973bbdb9af-225"><span data-path-to-node="8,2,0,0">Drive the refactoring and rewrite of the CTA positioning indicator calculation blocks from PHP to Python, ensuring strict mathematical output parity, comprehensive test coverage, and optimized latency</span><span data-path-to-node="8,2,0,1"></span><span data-path-to-node="8,2,0,2">.</span> </p> </li> <l