Key Requirements and Technology Experience:
- Skills-Power Systems engineering / Utility Industry experience / DER Dispatch
AWS services such as S3, EMR, Glue, Lambda, Athena, Kinesis, EC2, SNS, SQS, Cloudwatch - Infrastructure as Code technology such as Terraform
- Experience with native AWS technologies for data and analytics such as Athena, S3, Lambda, Glue, EMR, Kinesis, SNS, CloudWatch, etc.
- Tools and Languages such as Django, Python, Java, Scala, Pandas
- Infrastructure as Code technology such as Terraform
- AWS services such as S3, EMR, Glue, Lambda, Athena, Kinesis, EC2, SNS, SQS, Cloudwatch
- Experience with databases such as Redshift, Document DB, DynamoDB and Mongo DB
- Experience transitioning on premise big data platforms into cloud based platforms such as AWS
- Hadoop platform (Hive; HBase; Druid)
- Spark
- PySpark
- SQL
- Workflow Automation
- DevOps pipeline (CI/CD); Bitbucket; Concourse
- API frameworks
- Power Systems engineering experience
- DER Dispatch experience
- Automated fault analysis systems experience
- Ability to perform hands on development and peer review for certain components / tech stack on the product
- Standing up of development instances and migration path (with required security, access/roles)
- Develop components and related processes (e.g. data pipelines and associated ETL processes, workflows)
- Lead implementation of integrated data quality framework
- Ensures optimal framework design and load testing scope to optimize performance (specifically for Big Data)
- Supports data scientist with test and validation of models
- Performs impact analysis and identifies risk to design changes
- Ability to build new data pipelines, identify existing data gaps and provide automated solutions to deliver analytical capabilities and enriched data to applications
- Ensures Test Driven development
- Experience leading teams to deliver complex products
- Strong technical skills and communication skills
- Strong skills with business stakeholder interactions
- Strong solutioning and architecture skills
- Experience building real time data ingestion streams (event driven)
- Ensure data security and permissions solutions, including data encryption, user access controls and logging