Senior Data Engineer

SCOPE OF SERVICES 
• Looking for a Data Engineer role to ensure the efficient and successful implementation and support of complex data engineering solutions for City agencies.
• This resource should demonstrate a solid understanding of industry-standard implementation methodologies using data engineering technologies, tools, and processes.
TASKS: 
• Create and maintain optimal data pipeline architecture that is coherent and scalable, based on best practices of integrating data into a consolidated repository.
• Perform the technical design, development, and component testing of repository changes.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer engagement and experience, operational efficiency, and other key business performance metrics.
• Build the infrastructure required for optimal extraction, transformation, and loading (ETL) of data from a wide variety of data sources using SQL, cloud, and ‘big data’ technologies.
• Develop ETLs to move data securely from source to target systems.
• Create, update, and maintain system documentation.
• Develop new or build against existing APIs for data access or landing data as output for further downstream consumption in the appropriate target data store.
• Perform special projects and initiatives as assigned.
MANDATORY SKILLS/EXPERIENCE 
• At least 8 years of experience in writing SQL.
• A minimum of 8 years of experience in copying, transferring, manipulating, and automating data operations that were manual processes.
• Experience with tools and components of data architecture such as Informatica Power Center, IICS, SSIS, or similar ETL tools.
• Experience working with Amazon Web Services or Microsoft Azure cloud computing platform and services.
• In-depth knowledge of SQL and other database solutions.
• Experience with data warehousing (Snowflake, Redshift etc.).
• Knowledge of modeling database schemas for large datasets.
• Experience developing cloud-ready applications.
• Experience working with programming languages like Python, Java, and Perl
DESIRABLE SKILLS/EXPERIENCE: 
• Hands on experience developing Microsoft PowerBI solutions.
• 5+ years hands-on experience in development with the suite of tools from Informatica PowerCenter and B2B Data Transformation.
• Experience using Oracle 10g/11g, SQL Server and/or a database appliance.
• Knowledge of metadata-driven enterprise reporting platforms.