Data Engineer

Key Responsibilities

CI/CD Development: Build and manage CI/CD pipelines using Jenkins and Bazel for continuous integration and testing.
Test Case Management: Define test cases with strict adherence to requirements and ensure documentation is stored in Jama.
Scripting & Automation: Perform heavy scripting and automation tasks to streamline processes.
Datalake Management: Store and manage CI test results in a Datalake accessible through APIs.
AWS Infrastructure: Utilize AWS services, including EC2 and Terraform, to build, maintain, and automate the infrastructure.
API Integration: Drive extensive API integration work for seamless data access and functionality.
Simulation Testing: Conduct sensor simulation tests and provide detailed reports on status and results.
Leadership & Oversight: Assign and manage contractors to ensure smooth project execution, track progress, and address any technical questions or concerns.

Skills & Experience Required

Strong background in CI/CD pipeline development using Jenkins and Basil.
Experience with AWS services (EC2, Datalake, Terraform).
Proficient in scripting and automation with hands-on experience in API integration
Ability to manage test case creation and reporting in Jama.
Experience with full-stack development, with a focus on automation.
Strong problem-solving and project management skills to meet tight deadlines.
Excellent communication and leadership skills, with the ability to manage and mentor contractors.

Preferred Qualifications

Prior experience in sensor simulation testing and familiarity with testing frameworks
Experience with Bazel for build and testing frameworks.
Strong organizational skills to ensure all timelines are met.

System Description!!!

Product Readiness Report Overview

Objective:
Build and test code through CI/CD pipelines.
Store results in the datalake, accessible via API.
Define and execute test cases with strict adherence to requirements recorded in Jama.
Technologies & Tools:
CI/CD: Jenkins pipelines in AWS.
Build & Testing Frameworks: Bazel.
Infrastructure: Terraform, EC2.
Data Storage: Datalake with API integration.
Scripting & Automation: Heavy emphasis on scripting and automation.
Full-Stack Skills: Required, though front-end specifics are uncertain.
Responsibilities:
Create and store CI test results in the datalake.
Drill down into test results to assess basic status and specifics around sensor test simulations.
Manage tight deadlines:
Mid-October for initial results.
End of October for final results.
Team Structure:
Senior engineer assigned to manage contractors.
Drive production, track progress, and address questions.
Project Duration:
3 months.
Start Date:
Immediate start required to meet deadlines.