Responsibilities
Research and recommend innovative technologies and approaches for private and public cloud infrastructure management, upgrades, or improvements, while adhering to technical or budgetary constraints.
Proactively plan capacity monitoring and scaling of platforms and applications.
Obtain and evaluate information on factors such as costs, performance, and security to determine solution patterns and services.
Participate in software system programming, validation, deployment, and documentation.
Provide technical leadership, including mentoring others, gaining consensus across teams & individuals, substantiating technical decisions, validating team recommendations, integrating efforts into a comprehensive strategy, and delivering results on time.
Writes and/or reviews system specifications, including output requirements, flow charts and technical diagrams.
May occasionally work a non-standard schedule including nights and/or weekends and/or have on-call responsibilities.
Qualifications
Ideally three (3) to five (5) years of large-scale data engineering, with at least one implementation in AWS, ideally using Redshift, Glue, S3, DMS, Step Functions and Lambdas.
Experience in modern development lifecycle including Agile methodology, CI/CD, automated deployments, etc.
Hands on knowledge of orchestration techniques that manage complex dependencies between inputs and processing steps.
Hands on experience in Data Analytics, ETL, Database Queries.
Hands on experience with AWS services is strongly preferred (Glue, Redshift, Lambda functions, S3, EC2, etc…).
Expert in Python or another object-oriented language - you MUST be able to code in PySpark and SQL
Participate in and contribute to peer code reviews.
Willingness to learn new technology.
Must have strong database skills (Oracle, SQL Server, ETL & ELT).
Financial Services industry knowledge is a plus.
Self-starter who can work independently.
Bachelor’s Degree in MIS, Computer Science, Math, Engineering or comparable major.
Strong consulting and communication skills. Ability to work effectively with various organizations in pursuit of problem solutions.
Licenses/Certifications:
AWS Certifications preferred but not required
Any Graduate