Sr. Data Engineer IV

Sr. Data Engineer IV

Contract through 12/31/26 with ongoing extensions

*REMOTE BUT MUST BE ABLE TO INTERVIEW ONSITE IN PHILADELPHIA, PA*

We are seeking a Senior Data Engineer to support enterprise data modernization initiatives focused on inventory, supply, and yield analytics. This role will be responsible for designing, building, and enhancing scalable data pipelines within a modern cloud-based data ecosystem. The ideal candidate brings strong hands-on expertise in Databricks, Python, PySpark, and AWS, along with experience supporting migration efforts, modernizing legacy platforms, and delivering reliable data assets for analytics and reporting environments.

Responsibilities:

• Design, develop, test, and maintain scalable ETL processes and data pipelines using Databricks, Python, PySpark, AWS, and Snowflake.
• Build and enhance data engineering solutions supporting inventory, supply, and yield analytics initiatives.
• Develop core data assets and pipelines that support enterprise reporting and analytics platforms, including Tableau.
• Modernize legacy data engineering jobs and contribute to cloud migration and technical debt reduction efforts.
• Create and maintain technical documentation, specifications, testing artifacts, and quality assurance processes.
• Provide post-deployment support, troubleshoot production issues, and ensure reliable pipeline operations.
• Identify and mitigate risks, including single points of failure (SPOF), to improve platform stability and resiliency.
• Develop and manage infrastructure using Terraform.
• Implement and maintain CI/CD pipelines using tools such as GitHub Actions or Concourse.
• Collaborate with engineering teams, stakeholders, and Agile Release Train (ART) members to define requirements and deliver scalable solutions.
• Participate in code reviews, knowledge sharing, and continuous improvement initiatives.

Requirements

• Strong Data Engineering experience with a focus on ETL development and data pipeline engineering.
• Hands-on experience with Databricks, Python, PySpark, and SQL.
• Strong AWS experience, including S3, EMR, Lambda, and EventBridge.
• Experience building, testing, and maintaining cloud-based data pipelines and data platforms.
• Experience supporting cloud migration and modernization initiatives.
• Experience with Snowflake.
• Experience using Terraform for infrastructure provisioning and management.
• Experience implementing and supporting CI/CD pipelines using GitHub Actions or Concourse.
• Strong troubleshooting, testing, and production support experience.
• Ability to work collaboratively in an Agile development environment.

Preferred Qualifications:

• Approximately 8+ years of Data Engineering experience.
• Experience with Kafka.
• Familiarity with Tableau and/or Looker environments.
• Experience supporting analytics and reporting data platforms.