Job Description
Title: Talend ETL Expert Developer
Location: Reading, PA (Hybrid)
Type: Contract
Job Description:
- We are seeking an experienced and highly skilled Talend ETL Expert Developer for a consulting position. The ideal candidate will have at least 7 years of experience in designing and implementing data integration solutions, with expertise in Talend and related technologies. This role involves working on complex ETL processes, API integrations, and data transformation tasks, as well as contributing to broader data architecture and cloud strategies.
Key Responsibilities
- Design, develop, and maintain ETL workflows using Talend, particularly version 7.3.1, to integrate and transform data from various sources, including APIs, flat files, and cloud platforms.
- Implement robust API integrations and develop strategies to flatten JSON structures effectively for downstream processing.
- Utilize Talend Joblets to promote modularity, reusability, and efficient design within ETL workflows.
- Consolidate and integrate data files from multiple sources, ensuring data consistency and accuracy.
- Troubleshoot and resolve errors in Talend Administration Center (TAC), including diagnosing and addressing issues such as "Generic job not found."
- Perform cloud-based data integration, including data ingestion and extraction to/from AWS S3 using S3Input and S3Output components.
- Handle large-scale data sets and optimize ETL processes for performance and scalability.
- Integrate Talend workflows with data lakes, employing file formats such as Parquet, ORC, or Avro for efficient storage and retrieval.
- Work with NoSQL databases for specific use cases, ensuring seamless integration with Talend workflows.
- Leverage Apache Spark for data processing and transformation tasks as part of big data initiatives.
- Utilize Python for scripting and process automation, maintaining proficiency to enhance ETL capabilities.
- Implement and maintain CI/CD pipelines, working with YAML configuration files and integrating Talend processes as needed.
- Collaborate with cross-functional teams using Agile or Waterfall methodologies, ensuring timely delivery and frequent production releases.
- Explore and implement API integration solutions beyond Talend, leveraging experience with other tools and programming languages as needed.
Minimum Skills Required: Requirements
- At least 7 years of hands-on experience with Talend, including designing and implementing complex ETL workflows.
- Strong understanding of API integration, JSON data handling, and related challenges. Hands-on experience with Talend 7.3.1 is highly preferred.
- Experience with cloud platforms, especially AWS S3, and knowledge of data lake architectures.
- Familiarity with big data tools such as Apache Spark and file formats like Parquet, ORC, and Avro.
- Proficiency in Python for scripting and automation.
- Experience with NoSQL databases and their integration with Talend.
- Solid understanding of CI/CD pipelines and YAML configuration in DevOps contexts.
- Familiarity with Amazon Glue is a plus.
- Strong problem-solving skills and the ability to troubleshoot technical issues effectively.
- Excellent communication skills and a collaborative approach to working with teams.
- Experience in Agile and/or Waterfall development methodologies.
Preferred Qualifications
- Relevant certifications in Talend or related technologies.
- Proven experience with large-scale data integration projects involving complex transformations.
- Knowledge of Talend Administration Center (TAC) and debugging techniques for common errors.
- Strong analytical skills and attention to detail, with a focus on delivering high-quality solutions.
- This is an exciting opportunity for a motivated Talend ETL expert to work on diverse and challenging consulting projects, contribute to innovative solutions, and grow within a dynamic and collaborative environment
Job Tags
Contract work,