Software Engineer

About the Role

We are seeking a highly skilled and collaborative Software Engineer to join our Data Services team within the Counterparty Credit Risk organization. This role is focused on modernizing legacy data systems, building scalable data pipelines, and supporting the transition to a new data platform. You will work alongside a team of 7–8 onshore and 6–7 offshore engineers, contributing to both business-as-usual (BAU) operations and strategic platform development.

Responsibilities

• Data Pipeline Modernization: Migrate legacy Ab Initio workflows to modern technologies including PySpark, S3, Airflow, Iceberg, and Parquet.
• Platform Development: Support ingestion of 300+ data feeds for nightly batch processing on a new data platform.
• Engineering Execution: Design and implement scalable backend services using Python and PySpark.
• Team Collaboration: Participate in daily scrum calls, coordinate with team members, and review work orders.
• Agile Practices: Work within Kanban and Scrum environments; manage tasks via Jira.
• Documentation & Modeling: Maintain technical documentation and demonstrate strong understanding of columnar data formats.
• Mentorship: Provide technical guidance and foster collaboration across teams.
• Compliance & Governance: Ensure solutions align with regulatory and data governance standards.

Minimum Qualifications

• 5+ years of experience in software engineering or equivalent (consulting, education, military, etc.)
• 5+ years of experience with SQL
• 3+ years of experience with PySpark, S3, Iceberg, Airflow, and Parquet
• Experience with Git, Python, and data transformation tools
• Familiarity with Agile methodologies and tools (e.g., Jira)
• Strong communication and problem-solving skills

Preferred Qualifications

• Experience with Ab Initio (2+ years)
• Familiarity with Kafka, Docker, Kubernetes, and monitoring tools (Grafana, Prometheus)
• Exposure to Java, IntelliJ, Gradle, and GitHub Copilot
• Experience in regulated environments with a focus on compliance
• Certifications in relevant technologies are a plus
• Banking or financial services background is beneficial but not required

Additional Information

• This is a net-new role as part of a pilot program.
• All resumes must be submitted via Beeline; direct communication with the hiring manager is not permitted during the active posting.