Senior Data Engineer

Role Summary:

As a Senior Data Engineer, you will be responsible for managing the end-to-end process of integrating disparate data sources for our customers, enabling the aggregation, transformation, and availability of data for reconciliation, analysis and reporting purposes. You will work closely with cross-functional teams, including developers, data scientists, product managers, implementation teams and business stakeholders, to understand data requirements and drive the implementation of robust data integration solutions.

Key Responsibilities:

• Design and oversee the development of data pipelines, ensuring extraction, transformation, and loading (ETL) processes are efficient, reliable, and secure. You will be integrating data from various sources, including internal databases, third-party APIs, and external data providers.
• Develop and maintaining complex data infrastructures from various sources using a range of technologies including Snowflake and Azure SQL.
• Implement appropriate data integration technologies, tools, and frameworks to optimize data flow and integration across systems.
• Monitor data pipelines and proactively resolve issues related to data quality, performance, and availability.
• Ensure compliance with data governance policies, data privacy regulations, and industry standards throughout the data integration process.
• Establish data quality control mechanisms, including data validation, cleansing, and enrichment procedures, to maintain high data accuracy and reliability.
• Ensure documentation is created and maintained in relation to data integration processes, data mappings, and data lineage.
• Work with the Data Science and BI teams to define and execute a comprehensive Data Integration Strategy, standards and guidelines aligned with the company’s objectives and industry best practices.
• Identify opportunities for automation and streamline data integration workflows to enhance operational efficiency and facilitate self-service by our clients.

Requirements:

• Relevant qualifications in Computer Science, Information Systems, or a related field.
• Proven experience in data integration, ETL development, and data pipeline management.
• Strong knowledge of data integration and analysis technologies, tools, and frameworks, such as ETL tools, API integrations, message queues, data warehouses, and data lakes.
• Exposure to cloud technologies and principles (AWS/Azure) of designing and developing data solutions on public cloud – AWS/Azure.
• Proficiency in programming languages commonly used for data integration and data analysis, such as Python, R, Java and SQL.
• Strong communication skills, with the ability to collaborate effectively with cross-functional teams and stakeholders.
• Demonstrated ability to work on multiple projects and priorities in a fast-paced, deadline-driven environment.
• Strong analytical skills and problem-solving abilities.
• Experience working in the fintech/payments or financial services industry would be a plus.

Salary and Benefits:

• Competitive salary, in line with experience
• 25 days annual leave plus bank holidays (plus an extra day on your birthday each year)
• Access to health insurance scheme after probation period
• Remote / Hybrid working available
• City centre office location to use as desired
• An entrepreneurial, can-do team and culture