Talend Architect/Administrator

Job Description

• 12+ years of experience in Talend development and administration.
• Design, develop, and maintain ETL workflows using Talend, particularly version 8.0 / 7.3.1, to integrate and transform data from various sources, including APIs, flat files, and cloud platforms.
• Expertise in administering the Talend environment, including user management, setting up security, and handling the deployment process.
• Experience in applying patches related to Talend, DB, and OS level.
• Experience in coordinating with database administrators and webmasters to manage the Talend environment.
• Implement robust API integrations and develop strategies to flatten JSON structures effectively for downstream processing.
• Utilize Talend Joblets to promote modularity, reusability, and efficient design within ETL workflows.
• Consolidate and integrate data files from multiple sources, ensuring data consistency and accuracy.
• Troubleshoot and resolve errors in Talend Administration Center (TAC), including diagnosing and addressing issues such as "Generic job not found."
• Perform cloud-based data integration, including data ingestion and extraction to/from AWS S3 using S3Input and S3Output components.
• Handle large-scale data sets and optimize ETL processes for performance and scalability.
• Integrate Talend workflows with data lakes, employing file formats such as Parquet, ORC, or Avro for efficient storage and retrieval.
• Work with NoSQL databases for specific use cases, ensuring seamless integration with Talend workflows.
• Leverage Apache Spark for data processing and transformation tasks as part of big data initiatives.
• Utilize Python for scripting and process automation, maintaining proficiency to enhance ETL capabilities.
• Implement and maintain CI/CD pipelines, working with YAML configuration files and integrating Talend processes as needed.
• Collaborate with cross-functional teams using Agile or Waterfall methodologies, ensuring timely delivery and frequent production releases.
• Explore and implement API integration solutions beyond Talend, leveraging experience with other tools and programming languages as needed.