Data Engineer Consultant

Job Description

Skills Set Required:

• Expert knowledge and experience developing and implementing ETL jobs for data warehouses using SQL and Python.

• Good knowledge of software development language and tools such as SQL, Python, Spark

• Good knowledge and experience with AWS or Azure Big Data tools :Glue, Athena, Redshift, Kinesis, Data bricks, azure analytics, Data explorer.

• Good knowledge and experience with cloud-based storage and functions. (S3, Blob, Lambda, Azure Functions)

• Expert knowledge and experience of data engineering tools and methodologies (Datawarehouse, data lake, star schema).

• Good knowledge and experience with AWS Cloud Formation or Terraform.

• Knowledge of CI/CD concepts in general and AWS CodePipeline/CodeBuild/ CodeDeploy in particular.

• Knowledge of provisioning of data APIs.• Knowledge of information security concepts and terminology

• Excellent written and verbal communication skills that are compelling, convincing and reassuring, with the ability to articulate complex technical ideas to non-technical team.

• Proficient user of Git. Familiarity with Jira and Bitbucket.

• Experience in the implementation of, or demonstrable familiarity with the Gartner ODM framework would be an advantage.