CYNET SYSTEMS
Job title:
Intermediate DataOps/Cloud Data Engineer – Remote / Telecommute
Company
CYNET SYSTEMS
Job description
Job Description:Responsibilities:
- XXgn and develop scalable, efficient data pipelines using Azure Data Factory and Databricks Workflows.
- Optimize pipeline performance for scalability, throughput, and reliability with minimal latency.
- Implement robust data quality, validation, and cleansing processes to ensure data integrity.
- CollaboXX with stakeholders to gather business and technical requirements for data solutions.
- Troubleshoot and resolve data ingestion, transformation, and orchestration issues.
- Support analytics, data science, and machine learning workloads through seamless data integration.
- Support data governance initiatives, ensuring compliance with data security, privacy, and quality standards.
- Contribute to data migration projects including OLTP/OLAP workloads and very large datasets (VLDs) to cloud platforms (SaaS, PaaS, IaaS).
Required Skills:
- 5+ years of experience in data engineering, Strong proficiency in Python and familiarity with Azure Services is required.
- Expertise with Azure Data Services: Azure SQL Database, Azure Data Lake, Azure Storage, Azure Databricks.
- Experience with data pipeline development, orchestration, deployment, and automation using ADF, Databricks, Azure DevOps/GitHub Actions.
- Proficiency in Python, Scala, and T-SQL.
- Solid understanding of data warehousing and ETL concepts including star/snowflake schemas, fact/dimension modeling, and OLAP.
- Familiarity with DataOps principles, Agile methodologies, and continuous delivery.
- Proficient in data provisioning automation, data flow control, and platform integration.
- Knowledge of both structured, semi-structured, and unstructured data ingestion, exchange, and transformation.
- Experience with cloud-native data services such as DaaS (Data-as-a-Service), DBaaS (Database-as-a-Service), and DWaaS (Data Warehouse-as-a-Service), and infrastructure elements like Key Vault, VMs, and disks.
- Experience with commercial and open-source data platforms, storage technologies (cloud and on-prem), and the movement of data across environments.
- Experience in performance monitoring and tuning for cloud-based data solutions.
- Experience supporting digital product development, data analysis, data security, and secure data exchange across platforms.
- Proven experience designing enterprise-scale data architectures with high availability and security.
- Understanding of data governance, data security, compliance, and metadata management.
- Proficient in entity-relationship (ER) modeling and dimensional modeling.
- Strong knowledge of normalization/denormalization techniques to support analytics-ready datasets.
Expected salary
Location
Toronto, ON
Job date
Tue, 10 Jun 2025 22:41:55 GMT
To help us track our recruitment effort, please indicate in your email/cover letter where (hiring-jobs.com) you saw this job posting.