Description

Key Technologies: DevOps, AWS, Data Lake, SDLC, Python, Data Ingestion & storage : S3, Amazon Kinesis Data Streams

Description

  • Extensive experience in developing/ building AWS Data Lake formation, contributing extensively to design, development and writing code.
  • Experience in modernizing legacy applications, which should include refactoring/migrating in-house legacy applications to the cloud environment.
  • Proficient in utilizing AWS services and related components towards building enterprise level Data Lakes.
  • Must have experience in Data Ingestion & Storage, Data Processing & Transformation and working with AWS Machine Language using appropriate AWS services.
  • Experience in customizing AWS ETL logic using Python code.
  • Knowledgeable and experience in security and data governance covering areas such as fine-grained permissions, managing user and service permissions, data encryption, auditing, and compliance.
  • Experience in software development with hands-on skills in Python scripting, and any prior experience in Object oriented languages is a plus.
  • Experience working with any transactional or RD. databases
  • Experience with DevOps, DevSecOps, Iac, automation, building CI/CD pipelines, monitoring, and logging.
  • Knowledge / experience using any ETL tools, experience with data analytics using PowerBI or AWS QuickSight etc. is plus.
  • Must have experience/familiar with Agile/Scrum Framework environments.

 

Required Skills:

  • Proficient in using various AWS services towards building enterprise level data lakes
  • Experience in modernizing applications, including refactoring, migration, and cloud-native development.
  • Data Ingestion & storage : S3, Amazon Kinesis Data Streams, Amazon Kinesis Data Firehouse, D.
  • Data Processing & Transformation:AWS Glue, AWS Lambda, EMR, Athena, Amazon Managed Service for Apache Flink,AWS Step Functions, AWS SageMaker
  • Experience with DevOps practices and automation tools
  • Experience in software development, hands on coding using python scripts or any other object-oriented languages like Java/.net.
  • Strong communication and collaboration skills to work with cross-functional teams, including developers, business analysts, and stakeholders.
  • Experiencewith Agile/Scrum Framework environments.
  • Experience with data analytics, business intelligence solutions (like Power BI or AWS QuickSight)
  • AWS Certification
  • State Government experience

Education

Any Graduate