View All Jobs/Careers

Job Information

Aetna Principal Big Data Engineer (Hadoop/ Pig/Hive) 58696BR in New York, New York

Req ID: 58696BR

Aetna's mandate is to transform health and wellness via products that enable consumer engagement and best-in-class experience. This team is responsible for Aetna's digital transformation and all digital products; as well as the development and execution of the digital roadmap. A key part of the responsibility is to build an integrated platform that enables the delivery of products to drive engagement and revolutionize health and wellness. We want you to be apart of the team that will build this next generation platform.

Leveraging your expertise in Big Data, IoT, Native Cloud Engineering, Machine Learning and Deep Learning, you will join the product team that will deliver the platform that will disrupt the healthcare industry and improve the lives of hundreds of millions of people. Aetna Digital is a highly energetic, highly collaborative team that operates as a startup within the Aetna Enterprise. We want you to bring forward your talent and expertise to drive the change the is desperately needed within the healthcare industry.

Come Join Aetna Digital!

Aetna Digital is looking for Lead Big Data Engineer with Java, Python, Scala and Spark experience to help us leverage data from different sources including files, databases, messages, streams, IoT events from across the enterprise, the cloud and fog in order to transform it into products focused on helping people live healthier lives.

In this role, you will use your experience with System Integration, Big Data, Streaming and Cloud technologies to build our Health Cloud platform as a member of one of our scrum teams in Burlington, MA, Hartford, CT or New York, NY. You will work on cutting-edge applications and products. Brainstorming with architects, product managers, data scientists and fellow engineers to build data products used improve the health outcomes of millions of people.

The Details:

  • Design, implement, and support data ingestion and consumption pipelines for enterprise-scale datasets, using Big Data tools, such as Hive, Pig, Spark, and Kafka

  • Establish frameworks for quickly rolling out new data analysis for standalone data-driven products and micro-services

  • Model data and metadata to support persona-based interactions as defined through interfacing with business customers, gathering requirements, and delivering solutions

  • Demonstrate a deep knowledge of, and ability to operationalize, leading data technologies and best practices

  • Facilitate/lead/participate in architecture discussions

  • Partner end-to-end with Product Managers and Data Scientists to understand customer requirements and design prototypes and bring ideas to production

What we are looking for:

  • We develop real products. You need to be an expert in design, coding and scripting

  • We prioritize professional industry experience; advanced degrees alone do not replace real world experience

  • We have massive scale. You need to have experience in distributed, scalable systems. Youve worked with modern data storage, messaging, and processing tools and demonstrated experience designing and coding in big-data components such as Hadoop, Hive, Pig, Spark, and Kafka or similar

  • Were a growing, diverse team and we work together on delivering a Health Cloud platform. We love to collaborate and help each other, and we want someone to share that ideology

  • We are and need other self-starters who can see the big picture and prioritize their work to make the largest impact on the business and customers vision and requirements

  • You have excellent communication, leadership and collaboration skills


  • 10+ years software development in enterprise/ web/ cloud applications, solutioning, architecture and frameworks.

  • Big Data expertise with cloud and enterprise level design/implementation

  • Should have some notion of how to build, test, and deploy code to run on cloud infrastructure

  • Fluent with functional, imperative and object-oriented languages and methodologies and Design Patterns

  • Strong knowledge of programming languages/tools including: Java, Python, Spark, SQL, R, Hive, JavaScript and Shell Scripts

  • Must have experience with Unix/Linux systems with scripting experience

  • Experience coding, testing and documenting middleware/ server-side modules.

  • Experience working in an agile environment

  • Knowledge and experience of DevOps is desirable.

  • Must have experience building data pipelines and fit for purpose data stores

  • Must have experience in open source programming languages for large scale data.

  • Exposure to PaaS, SaaS, AWS/GCP/Azure platform are advantageous.


The highest level of education desired for candidates in this position is a Bachelors' Degree.

Master's degree isa plus.


Dollar-for-dollar match up-to 6% of your 401(k) contributions!

Health care (HSA/FSA), dental, vision benefits, PTO

Gym / Showers

A top of the line MacBook Pro

Sit/stand desk

Free Parking (Burlington, MA office)

Aetna-sponsored refreshments, Friday lunches, etc.

$200/yr towards wellness - gym membership, fitbit, treadmill

Up-to 5K a year toward tuition reimbursement

Reimbursement also available for additional Certification, Training & Conferences

Aetna is about more than just doing a job. This is our opportunity to re-shape healthcare for America and across the globe. We are developing solutions to improve the quality and affordability of healthcare. What we do will benefit generations to come.

We care about each other, our customers and our communities. We are inspired to make a difference, and we are committed to integrity and excellence.

Together we will empower people to live healthier lives.

Aetna is an equal opportunity & affirmative action employer. All qualified applicants will receive consideration for employment regardless of personal characteristics or status. We take affirmative action to recruit, select and develop women, people of color, veterans and individuals with disabilities.

We are a company built on excellence. We have a culture that values growth, achievement and diversity and a workplace where your voice can be heard.

Benefit eligibility may vary by position. Click here to review the benefits associated with this position.

Aetna takes our candidates's data privacy seriously. At no time will any Aetna recruiter or employee request any financial or personal information (Social Security Number, Credit card information for direct deposit, etc.) from you via e-mail. Any requests for information will be discussed prior and will be conducted through a secure website provided by the recruiter. Should you be asked for such information, please notify us immediately.


Aetna is an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected Veterans status.