Data Lakehouse Engineer

Required Skills: Data Lakehouse, Snowflake, AWS, JSON, Apache Iceberg

Job Description:

Must have working experience building snowflake external tables against Apache Iceberg tables on AWS S3 and associated concepts.
They will be more successful if they have experience building Apache Iceberg tables on AWS S3 and migrating JSON files to Apache Iceberg tables on AWS S3 based upon configuration based rules.
One JSON file goes in a specific Iceberg table and another JSON file goes in another iceberg table.
The data shall be parsed using a configuration based process, not hard coded rules per JSON file format
 

Responsibilities:

Build snowflake external tables against data saved in AWS S3 in Apache Iceberg.
Using existing pipeline to migrate data from one AWS account in S3 to another AWS account where the data is stored in Apache iceberg tables on S3.