Senior Data Engineer

Job title:

Senior Data Engineer

Company

Veup

Job description

19th November, 2024SENIOR DATA ENGINEER
CLIMATE CHANGE SCALE UP BASED DUBAI / 255,301 TO 301,719 PER ANNUM
UAE OPEN TO RELOCATION OF CANDIDATES TO UAE – STAFF EQUITY PROGRAMMEHeadquartered in Oman, but with a fast growing presence and permanent base in Dubai / UAE, VeUP Talent’s client 4401.earth is a tech scale up business making a massive impact on climate change globally. If you are driven by a need to impact climate change then come and meet 4401. They have developed pioneering hardware and software technology that facilitate Co2 capture and storage in rock formations, sealing Co2 away safely for ever. The business is expanding all over the world and now needs to make the key hire of a Senior Data Engineer.Ideally, this person will be motivated to move to the UAE/Dubai metro in order to combine a flexible and hybrid work life balance with sometime spent in the office as part of a broader team.Reporting to the Head of Digitization, the Senior Data Engineer will design, develop, and maintain scalable data pipelines and infrastructure to support advanced data analytics and machine learning initiatives. You will collaborate closely with cross-functional teams, including data scientists, analysts, and software engineers, to drive innovation and efficiency through data-driven solutions.Key responsibilities include:

• Design, develop, and maintain scalable data pipelines and infrastructure for optimal extraction, transformation, loading, and storing of large volumes of data.
• Evaluate and select appropriate technologies and tools to support data pipelines and processing.
• Develop and implement efficient ETL processes to integrate data from various sources into our data systems.
• Ensure data quality and reliability throughout the data lifecycle, including data validation, cleansing, and transformation.
• Utilize big data technologies such as Hadoop, Spark, Kafka, etc., to process and analyze large datasets efficiently.
• Design and implement data models, schemas, and data warehousing solutions.
• Manage and optimize data warehouses and data lakes to ensure high availability, security, and compliance with data governance standards
• Collaborate closely with data scientists, analysts, and software engineers to understand data needs and deliver scalable data solutions.
• Provide technical leadership and mentorship to junior team members, promoting best practices in data engineering and development methodologies.
• Monitor data pipelines, infrastructure, and data quality to identify and resolve issues proactively.
• Document data architecture, processes, and workflows.

The relevant candidate is educated to degree calibre (Masters preferred) in Computer Science, AI/ML Data or an Engineering discipline. You are a proven Senior / Staff / Lead Data Engineer eager to gain some people/management responsibility in a real-world hardware meets software driven tech environment. Programming experience in one of the following C#, Java, Python.The successful candidate has hands-on experience with big data technologies (Hadoop ecosystem, Spark, Kafka) and cloud platforms (AWS, Azure, GCP); understanding of relational databases (SQL, MySQL, PostgreSQL) and NoSQL databases (MongoDB, Cassandra); experience with data warehousing solutions (e.g., Redshift, Snowflake) and data modelling techniques (star schema, dimensional modelling); ideally certifications in cloud platforms (Azure Certified Big Data – Specialty, Azure Data Engineer) or related technologies; knowledge of Agile development methodologies and CI/CD pipelines for automated deployment; experience with containerization and orchestration tools (Docker, Kubernetes).What’s in it for you? An opportunity to make a difference and join a high-potential start-up with a realistic exit/staff options scheme, relocation package, visa sponsorship. A chance to be at the forefront of the fight against climate change. A competitive salary and benefits package. An opportunity to travel regularly to the Middle East, fostering cross-cultural collaboration and enriching professional experiences.To apply to this role please contact our UAE recruitment partner Jake Webster from VeUP Talent.

Expected salary

Location

United Kingdom

Job date

Fri, 22 Nov 2024 23:09:37 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (hiring-jobs.com) you saw this job posting.