Jobs for People with MS: National MS Society

Lead Cloud Data Engineer Senior

Location: This position will work a hybrid model (remote and office). The Ideal candidate will live within 50 miles of one of our Elevance Health PulsePoint locations.

A proud member of the Elevance Health family of companies, Carelon Medical Benefits Management, formerly AIM Specialty Health, is a benefit- management leader in Illinois. Our platform delivers significant cost- of-care savings across an expanding set of clinical domains, including radiology, cardiology and oncology.

The Lead Cloud Data Engineer Senior will be responsible for leading the end-to-end application system development and maintenance on large complex enterprise-wide technology platforms. This person will help our data engineering initiatives with a particular focus on leveraging AWS, GCP, Snowflake, SQL Server, Oracle, Python, Apache Airflow, SSIS, and others. This pivotal role involves leading the design, implementation, and optimization of our cloud-based data infrastructure, ensuring scalability, performance, and security. The successful candidate will be at the forefront of managing our data workflows, supporting analytics, and driving insights that inform strategic business decisions.

How you will make an impact:

• Maintains active relationships with customers to determine business requirements, leads requirements gathering meetings and reviews designs with the business.

• Leads efforts with Web and marketing team to increase the presence of web products.

• Anticipates broad technical change and ensures that company technology stays ahead of the curve.

• Prioritize projects and make trade-offs with respect to the enterprise systems changes based on broader business needs.

• Understands the entire architecture for a major part of our business and is able to articulate the scaling and reliability limits.

• Owns the change request process and coordinates with other teams as necessary.

• Develops and owns list of final enhancements.

• Develops and defines application scope and objectives and supervises the preparation of technical and/or functional specifications from with programs will be written.

• Performs technical design reviews and code reviews.

• Ensures unit test is completed and meets the test plan requirements, system testing is completed and system is implemented according to plan.

• Responsible for delivery of application technology solutions and data information planning effort.

• May participates in developing the multi-year technology strategy for critical areas of the business that may encompass multiple systems.

• Partners with technical and non technical stakeholder to identify the long term technical trajectory of the technology infrastructure.

• Creates architecture and anticipates future technology needs Leads the conversations internally about the direction of major areas of the technology, drives wide-team consensus to the adoption of this direction, and uses this direction when engaging engineers.

• Coordinates and manages on-call support and owns the system monitoring process.

• Reviews and monitors initiatives for end-to-end impact and coordination.

• Participates in review and decision making for enterprise solutions.

In this role the Lead Cloud Data Engineer will have the opportunity to:

• Strategic Data Engineering Leadership : Chart the course for the data engineering team, aligning data strategies with business objectives, and driving the adoption of best practices in data management and engineering.

• Advanced-Data Architecture : Architect and refine a scalable, robust cloud data architecture within AWS or GCP, integrating Snowflake for data warehousing, SQL Server for database management, and leveraging Python, SSIS, and DataStage for complex ETL processes.

• Pipeline Development & Optimization : Spearheaded the development of efficient data pipelines, employing Python for automation and scripting, streamlining data collection, transformation, and loading processes.

• Cloud & Database Management : Oversee deployment, optimizing, and scaling databases in AWS or GCP, ensuring high availability, disaster recovery, and performance tuning Snowflake and SQL Server environments.

• Data Governance and Security : Implement stringent data governance frameworks, ensuring data integrity, compliance with global data protection regulations, and securing sensitive information across all platforms.

• Performance Monitoring & Troubleshooting : Lead the monitoring of all data systems, promptly identifying and resolving any issues to minimize downtime and ensure the smooth operation of data flows.

• Team Leadership & Development : Mentor and cultivate a high-performing data engineering team, encouraging continuous learning and adoption of emerging technologies and methodologies.

• Cross-functional Collaboration : Act as a bridge between the data engineering team and other business units, translating complex data-related requirements into actionable plans and ensuring the delivery of data solutions that support business insights and decision-making.

Minimum Requirements:

• Requires an BA/BS degree in Information Technology, Computer Science or related field of study a minimum of 9 years' experience; multi-dimensional platform experience, expert level experience with business and technical applications; or any combination of education and experience, which would provide an equivalent background.

Preferred Skills, Capabilities, and Experiences:

• Experience mentoring others drive teams to achieve results, lead multiple or large projects and provide troubleshooting supports strongly preferred.

• Proficient in data modeling, data structures (e.g., relational, and non-relational data), databases, and ETL/ELT processes and an in-depth understanding of large-scale data sets including both structured and unstructured data with a solid track record of developing and executing data strategies that support business objectives.

• Proficient in designing, implementing, and delivering scalable data solutions and pipelines on one of the cloud platforms (e.g., AWS, Azure, GCP)

• Evaluate product feasibility and integrate new technologies into current frameworks.

• Expertise in evaluating existing frameworks and providing solutions to improve and modernize.

• Hands-on experience in the development, deployment, and operation of integration technologies (e.g., APIs)

• Proficiency with data warehouses (e.g., Snowflake, SQL Server, Redshift, Big Query, etc.)

• Experience with containerization technologies (e.g., Docker, Kubernetes)

• Experience with DevOps, Git, Bitbucket, CI/CD.

• Expertise in designing and implementing data tokenization.

• Exceptional analytical, problem-solving, and project management skills.

• Excellent communication and interpersonal abilities, capable of effectively leading a team and collaborating with various stakeholders.

• Healthcare experience is preferred.

​