Description

Job Description:

  • 8-10 Years of total experience.
  • Ability to do code reviews and build the best practices.
  • Strong data engineering experience in AWS cloud.
  • Ingesting and processing data following best practices (error handling, re-processing, performance optimization, etc.) in both ELT and ETL processes.
  • Experience in managing data pipelines and providing production and operations support.
  • Strong experience in the AWS data ecosystem.
  • Strong experience in AWS native components and services such as S3, Glue, Lambda, EMR, Athena, Dynamo CloudFormation, and Step Functions...etc.
  • Experience in writing stored procedures and UDF functions in Python and SQL.
  • Experience in Databricks
  • Good experience in Big Data echo systems, Apache Spark, PySpark with Python
  • Familiarity with at least one cloud data integration tool such as Matillion, Nifi, Fivetran, HVR, SnapLogic, Talend.

Skills:

  • INFOSPHERE INFORMATION SERVER, DATASTAGE, ETL, AWS Cloud, S3, GLUE, LAMBDA, EMR, DYNAMO, Cloud Formation, Data Bricks, Big Data, Apache Spark, PySpark with Python

Nice to have.

  • Strong SQL programming skills.
  • Experience in code versioning using GIT/SVN.
  • Knowledge and experience in Redshift is highly preferred.
  • Collaborate with BI Engineers and other groups to ensure easy-to-use data access.
  • Strong problem-solving and communication skills.



Bravens is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identify, national origin, age, protected veterans or individuals with disabilities.

Education

Any Graduate