Description

Job Description

Job responsibility

  • Data domain expert and drive to know everything about the data on the platform
  • Create Functional and Technical Specifications, Epics and User Stories, Process Flows, Data Analysis, Mapping
  • Documents, Implementation Plan, Agile artifacts
  • Migration from Hadoop to AWS using Pipelines, EMR
  • Develop, enhance and test new/existing interfaces. The candidate will be part of existing agile team and will work on developing, enhancing ETL pipelines, design solutions,
  • Handle Dev Ops effort in terms of CICD, Scanning, Code, Performance testing and Test coverage
  • Identify, analyze, and interpret trends or patterns in complex data sets and transforming existing ETL logic into Hadoop Platform
  • Innovate new ways of managing, transforming and validating data
  • Establish and enforce guidelines to ensure consistency, quality and completeness of data assets Apply quality assurance best practices to all work products
  • Experience of working in a development teams, using agile techniques and Object-Oriented development and scripting languages, is preferred.
  • Adds to team culture of diversity, equity, inclusion, and respect

 

Required qualifications, capabilities, and skills

  • 10+ years of Database experience Knowledge of application. data, and infrastructure architecture disciplines
  • ‘Strong experience with documentation and structuring information in tools lke Confluence and Jira
  • Experience in SparkSQLimapala and Bigdata technologies
  • Familiar with Data Science concepts and applying them to analyze large volumes of data
  • Comfortable with data concepts: Oracle, Java, Python. Spark, Kafka, HDFS, Airflow, Elastic Search.
  • Working proficiency in SDLC CV/CO Execution (GitHub, Jenkins. SNOR Spinnaker. AIM etc)
  • Experience in services like Lambda EC2
  • Experience in real time streaming data
  • Strong Experience with UNIX shell srpting is must
  • Experience with relational database environment (Oracle, Teradata, SQL Server. etc) leveraging databases, tables/views,
  • stored procedures, agent jobs, etc. with strong analytical skills withthe ability to collect. organize. analyze, and
  • disseminate significant amounts of information with attention to detail and accuracy
  • ‘Good understanding of Change management process
  • BS. or MS. in computer science, information systems, math, business, or engineering

Key Skills
Education

Any Graduate

Back To Jobs