Job Description:
We are seeking an experienced Data Engineer with a strong background in Python, Relational Databases (RDBMS), and Oracle technologies. The ideal candidate will be responsible for building and maintaining data pipelines, developing ETL processes, and ensuring the efficient storage, retrieval, and processing of data across multiple platforms.
Key Responsibilities:
- Design, build, and maintain scalable and efficient data pipelines
- Develop ETL/ELT workflows using Python and SQL
- Work with relational databases (Oracle, PostgreSQL, SQL Server, etc.)
- Perform data modeling, performance tuning, and optimization of database queries
- Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements
- Ensure data integrity, quality, and compliance with data governance policies
Required Skills:
- 8+ years of hands-on experience as a Data Engineer
- Proficiency in Python for data engineering tasks
- Strong experience with RDBMS such as Oracle, PostgreSQL, or SQL Server
- Solid understanding of SQL and performance tuning of complex queries
- Experience with ETL tools and frameworks (custom or open-source)
- Familiarity with data warehousing concepts and data lakes
Nice to Have:
- Experience with Cloud platforms (AWS, GCP, or Azure)
- Knowledge of NoSQL databases like MongoDB or Cassandra
- Familiarity with Apache Airflow, DBT, or other orchestration tools
- Exposure to Big Data technologies (Spark, Hive, Hadoop)
- Knowledge of data security and compliance frameworks