Description

  • Work with Business Analysts and Product team to gather data requirements
  • Design and Build AbInitio data graphs and data pipelines to extract the data various databases/flat files/message queues
  • Transform the data to create a consumable data layer for various application uses
  • Support Data pipeline with bug fixes, and additional enhancements
  • Document Technical design , Operational Runbook etc


Qualifications

  • To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required.
  • Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
  • Education Level: Bachelor's Degree
  • Education Details: Computer Science, Information Technology or Engineering or related field


Experience:

  • Total of 10+ Years of IT Experience predominantly in Data Integration/ Data Warehouse area
  • Must have at least 5 years of ETL Design and Development experience using Ab Initio
  • 1-2 years of Data Integration project experience on Hadoop Platform, preferably Cloudera
  • AbInitio CDC ( Change Data Capture ) experience in a Data Integration/ETL project setting is great to have
  • Working knowledge of HDFS, Hive, Impala and other related Hadoop technologies
  • Working knowledge in various AWS services is nice to have
  • Sound understanding of SQL and ability to write well performing SQL queries
  • Good knowledge of OLTP and OLAP data models and other data warehouse fundamentals
  • Rigor in high code quality, automated testing, and other engineering best practices, ability to write reusable code components
  • Ability to unit test the code thoroughly and to troubleshoot issues in production environments
  • Must have some working experience with Unix/Linux shell scripting
  • Must be able to work independently and support other junior developers as needed
  • Some Java development experience is nice to have
  • Knowledge of Agile Development practices is required

Key Skills
Education

Bachelor's degree

Back To Jobs