Data Engineer

jobshiringnearme.org

Requisition ID: 229303

Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.

The role

We are seeking a highly skilled Data Engineer who also possesses strong Quality Assurance (QA) knowledge. This role is primarily focused on data engineering and development work, but the candidate will also support QA activities to ensure the delivery of high-quality data solutions. The ideal candidate is versatile, detail-oriented, and capable of contributing across the data lifecycle.

What will you do?

  • Development & Data Engineering (Primary Focus)
  • Design, develop, and maintain scalable data pipelines and ETL processes using Python and PySpark.
  • Implement data models, transformations, and integrations for structured and semi-structured data (CSV, JSON, XML).
  • Optimize performance for large-scale data processing and storage.
  • Contribute to Test Automation Framework development, ensuring reusable and scalable automation components.
  • Support Group Intake Automation by translating business needs into technical workflows and backend solutions.
  • Enhance BotData, a smart data generation tool for synthetic data creation and validation.
  • Write, test, and optimize Python scripts for automation, data processing, and transformation tasks.
  • Collaborate with senior developers to troubleshoot issues, implement improvements, and follow best practices in coding and automation.
  • Work with cloud-native development efforts using platforms like GCP (Airflow orchestration, data storage).
  • Use Git/GitHub/GitLab for version control, managing branches, pull requests, and collaborative workflows.
  • Explore emerging technologies such as GenAI, ML, and data privacy tools, contributing to innovation-driven proof-of-concept projects.

What do you need to succeed?

  • Quality Assurance (Secondary Focus)
  • Assist in creating and executing test plans, test cases, and automation scripts for data validation.
  • Perform functional, regression, and integration testing on data workflows.
  • Ensure adherence to data quality standards and help identify defects early in the cycle.
  • Support CI/CD pipelines with automated testing using tools like Jenkins, GitHub Actions, or Azure DevOps.
  • Strong proficiency in Python, PySpark, and SQL.
  • Solid understanding of data engineering principles, ETL design, and best practices.
  • Experience with data manipulation using pandas and handling structured/semi-structured data (CSV, JSON, XML).
  • Knowledge of software development principles, version control (Git), and Agile/Scrum practices.
  • Familiarity with QA methodologies, tools, and automation frameworks (e.g., PyTest).
  • Understanding of CI/CD tools and workflows.
  • Excellent problem-solving skills, attention to detail, and ability to work independently and proactively.
  • Exposure to Apache Spark, PySpark, or Hadoop ecosystem tools.
  • Familiarity with cloud platforms (AWS, Azure, or GCP).
  • Experience with REST APIs, YAML, or data transformation tools.
  • Interest in test automation, data engineering, or DevOps practices.
  • Awareness of CI/CD tools like Jenkins, GitHub Actions, or Azure DevOps.
  • Curiosity about GenAI, machine learning, or data privacy concepts

What’s in it for you?

  • We have an inclusive and collaborative working environment that encourages creativity and curiosity and celebrates success
  • We provide you with the tools and technology needed to create meaningful customer experiences
  • You’ll get to work with and learn from diverse industry leaders, who have hailed from top technology companies around the world
  • We hire you for your talent — not just a job — so you can grow with us. We’ll equip you for success not only in your role, but also in your career as a whole
  • Dress codes don’t apply here: being comfortable does
  • Access to thousands of online and in-person courses so you can hone your current skills, or learn new ones
  • A competitive rewards package that includes a base salary, a performance bonus, company matching programs on pension and profit sharing, paid vacation, personal & sick days, medical, vision, and dental and much more!

Location(s): Canada : Ontario : Toronto

Scotiabank is a leading bank in the Americas. Guided by our purpose: “for every future”, we help our customers, their families and their communities achieve success through a broad range of advice, products and services, including personal and commercial banking, wealth management and private banking, corporate and investment banking, and capital markets.

At Scotiabank, we value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process, please let our Recruitment team know. If you require technical assistance, please click here. Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at Scotiabank; however, only those candidates who are selected for an interview will be contacted.

Read Full Description

Apply
To help us track our recruitment effort, please indicate in your cover/motivation letter where (jobshiringnearme.org) you saw this job posting.

Share

Assistant Professor Limited Term Earth and Environmental Science Department

jobshiringnearme.org The Department of Earth and Environmental Science invites applications for two 24-month, contractually limited…

34 minutes ago

Three-year Limited-Term Assistant Teaching Professor Position

jobshiringnearme.org Department of Computer Science Faculty of Engineering and Computer Science, University of Victoria Three-year…

34 minutes ago

Assistant Teaching Professor of Health and Physical Education

jobshiringnearme.org Job Title Assistant Teaching Professor of Health and Physical Education Job Description Summary, Duties…

1 hour ago

Assistant Professor of Early Childhood Teacher Education with expertise/specialization in special education

jobshiringnearme.org Job Title Assistant Professor of Early Childhood Teacher Education with expertise/specialization in special education…

1 hour ago

Assistant/Associate Professor in Secondary Social Studies Education and Teacher Education

jobshiringnearme.org Job Title Assistant/Associate Professor in Secondary Social Studies Education and Teacher Education Job Description…

1 hour ago

Remote Licensed Customer Service Representative Remote Licensed Customer Service Representative

jobshiringnearme.org Remote Licensed Insurance Customer Service Representative Location: Remote Job Overview Have you ever considered…

5 hours ago
For Apply Button. Please use Non-Amp Version

This website uses cookies.