Data Engineer

Role Overview:

As a Junior/Mid-Level Data Engineer, you will be responsible for designing, building, and maintaining our data infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure our data systems are efficient, reliable, and scalable. This role is ideal for someone with a strong foundation in data engineering principles and a desire to grow in a collaborative, fast-paced environment.

Key Responsibilities:

Data Pipeline Development: Design, develop, and maintain scalable data pipelines to ingest, transform, and load data from various sources into our data warehouse.

Data Integration: Work on integrating data from diverse sources, including APIs, flat files, and third-party services.

Quality Assurance: Implement data quality checks and validations to ensure data accuracy and integrity.

Collaboration: Work closely with data scientists, analysts, and other engineering teams to understand data requirements and deliver solutions that meet their needs.

Monitoring & Maintenance: Monitor data pipeline performance, troubleshoot issues, and make necessary improvements to enhance system reliability.

Documentation: Document data models, ETL processes, and other technical specifications to ensure clarity and maintainability.

Qualifications:

Education: Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field. Relevant experience can substitute for formal education.

Experience: 1-3 years of experience in a data engineering role or related field.

Technical Skills:

Proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL).

Experience with data processing frameworks (e.g., Apache Spark, Apache Airflow) is a plus.

Programming Languages: Proficiency in one or more programming languages such as Python, Java, or Scala.

Data Modeling: Basic understanding of data modeling and schema design.

Problem-Solving: Strong analytical and problem-solving skills with the ability to troubleshoot and resolve data-related issues.

Communication: Good communication skills and the ability to work effectively with cross-functional teams.

Preferred Qualifications:

Experience with data visualization tools (e.g., Tableau, Power BI) and understanding of data warehousing concepts