Senior Data Engineer

Job title:

Senior Data Engineer

Company

Validis

Job description

About Validis
Validis is a dynamic fintech company with a leading software platform, built for the extraction and standardisation of accounting data. Validis is a B2B, SasS firm with operations across the UK, US & Australia. We specialize in providing quality data for both audits and financial services, with the guarantee that our product will streamline processes for the financial industry.Our current client base holds a number of blue- chip companies, mainly comprising audit firms and financial institutions who utilise our software to gather financial information from their clients. Validis has experienced significant growth since its inception and to support this, we are looking to expand our teams across number of strategic areas.At Validis we have a core focus on the two interconnected concepts of diversity & inclusion. We are a collaborative business who empower equal opportunities across all departments. With our innovative approach to hiring, we enable employees to be individual, contribute openly and embrace the integrity of their own ideas. Validis believe in unbelievable talent and in turn provide a valuable and integrated workplace for you to excel in.Different Minds – Better Products.About the role
We are seeking an experienced Senior Data Engineer with a passion for data ingestion, building pipelines and driving impactful projects. We’re looking for someone with a strong background in Python and SQL, and expertise in using dbt for data transformation and modeling.Our ideal candidate thrives on tackling new challenges and enjoys mentoring junior team members to support a collaborative and growth-oriented environment. We need someone whose ability to translate complex business requirements into efficient data solutions, will make them an invaluable asset to our data-driven organization.About You
We’re looking for a passionate and experienced Senior Data Engineer who thrives in a fast-paced startup or SaaS environment. Here’s what makes you a great fit:

• Startup/SaaS Expertise (Desirable)
• Minimum 6+ years of experience as a Data Engineer or similar role.
• Experience designing and implementing CI/CD workflows for data engineering projects.
• Proven ability to leverage CI/CD tools to streamline data pipeline development and deployment.
• Proven expertise in designing and implementing ETL pipelines using tools like Apache Airflow, Luigi, Spark, or similar frameworks.
• Strong understanding of data warehousing concepts and data modelling techniques.
• Experience with SQL and proficiency in writing complex queries (e.g., T-SQL, PostgreSQL).
• Familiarity with cloud platforms AWS, GCP, Azure, (Azure preferred but not essential).
• An understanding of the nuances of both ETL and ELT approaches and can determine the optimal strategy for different scenarios.
• Excellent problem-solving and analytical skills with a strong focus on data quality.
• Effective communication and collaboration skills to work with cross-functional teams.
• Ambitious and eager to be part of a rapidly growing fintech company at the forefront of innovation.

Key responsibilities of the Senior Data Engineer;

• Design, develop, and implement robust ETL pipelines to extract data from various sources (databases, APIs, etc.).
• Cleanse, transform, and validate data to ensure high quality and consistency before loading it into data warehouses or data lakes.
• Designing and implementing CI/CD workflows for data engineering projects.
• Optimize ETL processes for efficiency, scalability, and performance.
• Develop and maintain documentation for data pipelines and data models.
• Troubleshoot and resolve ETL-related issues, ensuring data accuracy and integrity.
• Collaborate with data analysts, data scientists, and other engineers to understand data needs and business requirements.
• Stay up-to-date with the latest trends and technologies in the data engineering field, particularly in the area of ETL tools and frameworks.
• Participate in code reviews and knowledge-sharing sessions within the team.

Interested in joining Validis? You can read more about our benefits & culture on our careers page –

Expected salary

Location

United Kingdom – Australia

Job date

Sun, 01 Dec 2024 06:32:43 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (hiring-jobs.com) you saw this job posting.