Senior Software Engineer (Big Data)
Zelis
About Us
Zelis is modernizing the healthcare financial experience in the United States (U.S.) across payers, providers, and healthcare consumers. We serve more than 750 payers, including the top five national health plans, regional health plans, TPAs and millions of healthcare providers and consumers across our platform of solutions. Zelis sees across the system to identify, optimize, and solve problems holistically with technology built by healthcare experts – driving real, measurable results for clients.
Why We Do What We Do
In the U.S., consumers, payers, and providers face significant challenges throughout the healthcare financial journey. Zelis helps streamline the process by offering solutions that improve transparency, efficiency, and communication among all parties involved. By addressing the obstacles that patients face in accessing care, navigating the intricacies of insurance claims, and the logistical challenges healthcare providers encounter with processing payments, Zelis aims to create a more seamless and effective healthcare financial system.
Zelis India plays a crucial role in this mission by supporting various initiatives that enhance the healthcare financial experience. The local team contributes to the development and implementation of innovative solutions, ensuring that technology and processes are optimized for efficiency and effectiveness. Beyond operational expertise, Zelis India cultivates a collaborative work culture, leadership development, and global exposure, creating a dynamic environment for professional growth. With hybrid work flexibility, comprehensive healthcare benefits, financial wellness programs, and cultural celebrations, we foster a holistic workplace experience. Additionally, the team plays a vital role in maintaining high standards of service delivery and contributes to Zelis’ award-winning culture.
Position Overview
Senior Software EngineerKey Responsibilities
Tech Experience & Big Data engineering
Demonstrated mastery of Apache Spark (PySpark and/or Scala), with deep understanding of distributed computing, memory management, and performance tuning.
Proven ability to process multi-terabyte datasets efficiently, using techniques such as broadcast joins, caching, spill avoidance, and partitioning strategies.
Experience designing and optimizing memory-efficient Spark jobs for both batch and streaming workloads.
Develop distributed processing frameworks in Apache Spark (PySpark/Scala) to handle multi-terabyte healthcare datasets.
Engineer AWS-native big data solutions (S3, Glue, EMR, Redshift, Athena, Lambda, Step Functions) with focus on scalability and cost efficiency.
Implement schema evolution strategies for MRF and healthcare datasets.
Familiarity with data orchestration tools such as Airflow
Exposure to AI-first/GenAI approaches for metadata generation, anomaly detection, and documentation automation.
Experience building data products including APIs, semantic layers, and BI integrations.
Data Quality, Compliance & Governance
Implement data quality checks, metadata management, and lineage tracking.
Ensure compliance with CMS Transparency mandates and HIPAA data security requirements.
Build automation frameworks for auditability and regulatory reporting.
Collaboration & Business Alignment
Partner with Analytics, BI, and AI/ML teams to deliver structured, model-ready datasets.
Collaborate with US Matrix leaders, Product and Business stakeholders to translate payer, provider, and claims requirements into scalable solutions.
Support downstream systems and data products through clean, reliable data delivery.
Architecture, Cloud Native & Best Practices
Hands-on experience with AWS Big Data services including S3, Glue, EMR, Redshift, Athena, Lambda, and Step Functions.
Skilled in cost-performance optimization across cloud infrastructure, including EMR autoscaling, spot instance strategies, and storage tiering.
Familiarity with monitoring and profiling tools such as Spark UI, Ganglia, CloudWatch, and Datadog.
Contribute to architecture decisions for scaling MRF ingestion and processing systems.
Optimize Spark clusters and AWS infrastructure for cost-performance trade-offs.
Establish engineering standards, documentation practices, and reusable frameworks.
Attitude and Exploration
Maintain a proactive mindset in exploring new analytical techniques, regulatory changes, and healthcare industry trends.
Engage with industry experts, attend relevant healthcare and data conferences, and contribute to continuous learning within the team.
Qualifications
5–7+ years in software/data engineering, with 3+ years in Big Data / Spark.
Strong expertise in Apache Spark (PySpark and/or Scala) for distributed data processing.
Proven experience in AWS data services: S3, Glue, EMR, Redshift, Athena, Lambda.
Background in healthcare data (MRFs, payer-provider pricing, EDI, claims, eligibility).
Proficiency in SQL (optimization, query tuning) and programming with Python/Scala.
Solid understanding of distributed systems, partitioning, parallelization, and performance tuning.
Preferred Qualifications
Prior work in healthcare fintech or payer-provider ecosystems.
Familiarity with data modeling & orchestration tools (Nifi, Oozie).
Awareness of CMS Transparency regulations and healthcare economics.
Exposure to AI-first/GenAI approaches (metadata generation, anomaly detection, automation of documentation).
Experience with data product development (APIs, semantic layers, BI integrations).
Strong background in healthcare data engineering, including payer-provider pricing, claims, eligibility, and EDI formats.
Prior experience working with CMS Price Transparency Machine Readable Files (MRFs) and understanding of their structure, schema evolution, and regulatory context.
Commitment to Diversity, Equity, Inclusion, and Belonging
At Zelis, we champion diversity, equity, inclusion, and belonging in all aspects of our operations. We embrace the power of diversity and create an environment where people can bring their authentic and best selves to work. We know that a sense of belonging is key not only to your success at Zelis, but also to your ability to bring your best each day.
Equal Employment Opportunity
Zelis is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
Accessibility Support
We are dedicated to ensuring our application process is accessible to all candidates. If you are a qualified individual with a disability and require reasonable accommodation with any part of the application and/or interview process, please email talentacquisition@zelis.com.