Cloud Data Infrastructure Engineer

Company Overview

The people of Memorial Sloan Kettering Cancer Center (MSK) are united by a singular mission: ending cancer for life. Our specialized care teams provide personalized, compassionate, expert care to patients of all ages. Informed by basic research done at our Sloan Kettering Institute, scientists across MSK collaborate to conduct innovative translational and clinical research that is driving a revolution in our understanding of cancer as a disease and improving the ability to prevent, diagnose, and treat it. MSK is dedicated to training the next generation of scientists and clinicians, who go on to pursue our mission at MSK and around the globe. 

Please review important announcements about vaccination requirements and our upcoming EHR implementation by clicking here.

Important Note for MSK Employees: 

Your Career Hub profile is submitted to the hiring team as your internal resume. Please be sure your profile is fully complete with your skills, relevant experience and education (if required). Click here to learn more. Please note, this link is only accessible for MSK employees.  

Job Description

Cloud Data Infrastructure Engineer

Exciting Opportunity at MSK

Seeking experienced data infrastructure engineer to help drive MSK’s data modernization journey. You will design, implement, and maintain data infrastructure solutions for a new hybrid and multi-cloud data ecosystem that will be used for multiple purposes including data science and analytics.

Position Overview:

• Collaborate with technical product management and operations, to deliver the engineering roadmap following the agile model.
• Develop templates, playbooks, and automation to make infrastructure support and operations scalable.
• Build the cloud data platform using infrastructure as code (IAC).
• Develop CI/CD pipelines for both Terraform and data ingestion and transformation pipelines.
• Analyze and optimize data processes for efficiency, reliability, cost effectiveness, redundancy, and security.
• Help assess capabilities and integration feasibility of new technologies that are candidates for the ecosystem.
• Mentor team members on best practices for implementation, deployment, and operations for cloud data pipelines.
• Partner with Information Security teams to engineer secure data services on cloud platforms.
• Partner with enterprise cloud platform teams to engineer service implementations that comply with cloud governance standards.

Key Qualifications:

• Minimum 4+ years of Cloud Data Engineer working experience.
• Proficiency in translating designs into fully developed and well-structured Terraform code for managing Databricks and AWS resources.
• Proficiency with large scale data processing using PySpark including development and troubleshooting of PySpark pipelines.
• Proficiency with SQL and database design.
• Experience with GitOps and DataOps (preferably on GitHub)
• Solid understanding of cloud networking concepts, subnets, routing, load balancing, firewalls, and cloud security.
• Implementation expertise on AWS technologies including Cloud Formation, IAM, S3, EC2, Glue, MWAA.
• Experience in enterprise-scale environments, building highly available IaaS and PaaS solutions.
• Experience in shell scripting i.e., Bash
• Experience in Cloud logging, monitoring, and observability tools such as AWS CloudWatch, Datadog

Core Skills:

• An in-depth understanding of both business and technical discussions.
• Excellent communication and collaboration skills.
• Strong analytical, problem solving and organizational skills.

Additional Information:

• Location: 633 Third Avenue, NY
• Reporting to Director, Data Management
• Schedule: Hybrid, 4 days a month onsite

Pay Range: $118,800 – $196,200

Helpful Links:

• MSK Compensation Philosophy
• Review Our Greats Benefits Offerings

#LI-POST

#LI-HYBRID

Closing

MSK is an equal opportunity and affirmative action employer committed to diversity and inclusion in all aspects of recruiting and employment. All qualified individuals are encouraged to apply and will receive consideration without regard to race, color, gender, gender identity or expression, sexual orientation, national origin, age, religion, creed, disability, veteran status or any other factor which cannot lawfully be used as a basis for an employment decision.  

Federal law requires employers to provide reasonable accommodation to qualified individuals with disabilities. Please tell us if you require a reasonable accommodation to apply for a job or to perform your job. Examples of reasonable accommodation include making a change to the application process or work procedures, providing documents in an alternate format, using a sign language interpreter, or using specialized equipment.