Key Technologies: DevOps, AWS, Data Lake, SDLC, Python, Data Ingestion & storage : S3, Amazon Kinesis Data Streams
Description
- Extensive experience in developing/ building AWS Data Lake formation, contributing extensively to design, development and writing code.
- Experience in modernizing legacy applications, which should include refactoring/migrating in-house legacy applications to the cloud environment.
- Proficient in utilizing AWS services and related components towards building enterprise level Data Lakes.
- Must have experience in Data Ingestion & Storage, Data Processing & Transformation and working with AWS Machine Language using appropriate AWS services.
- Experience in customizing AWS ETL logic using Python code.
- Knowledgeable and experience in security and data governance covering areas such as fine-grained permissions, managing user and service permissions, data encryption, auditing, and compliance.
- Experience in software development with hands-on skills in Python scripting, and any prior experience in Object oriented languages is a plus.
- Experience working with any transactional or RD. databases
- Experience with DevOps, DevSecOps, Iac, automation, building CI/CD pipelines, monitoring, and logging.
- Knowledge / experience using any ETL tools, experience with data analytics using PowerBI or AWS QuickSight etc. is plus.
- Must have experience/familiar with Agile/Scrum Framework environments.
Required Skills:
- Proficient in using various AWS services towards building enterprise level data lakes
- Experience in modernizing applications, including refactoring, migration, and cloud-native development.
- Data Ingestion & storage : S3, Amazon Kinesis Data Streams, Amazon Kinesis Data Firehouse, D.
- Data Processing & Transformation:AWS Glue, AWS Lambda, EMR, Athena, Amazon Managed Service for Apache Flink,AWS Step Functions, AWS SageMaker
- Experience with DevOps practices and automation tools
- Experience in software development, hands on coding using python scripts or any other object-oriented languages like Java/.net.
- Strong communication and collaboration skills to work with cross-functional teams, including developers, business analysts, and stakeholders.
- Experiencewith Agile/Scrum Framework environments.
- Experience with data analytics, business intelligence solutions (like Power BI or AWS QuickSight)
- AWS Certification
- State Government experience