Data Engineer (Cloud and DevOps), ETL ,AWS , SQL, Python
Toronto
Roles & Responsibilities
Build, design and implement scalable data lake architecture using AWS S3 and Lakeformation
Build and optimize ETL Pipelines using AWS Glue, EMR and Spark
Implement Event-Driven workflows using EventBridge, SNS and SQS
Design and query datasets using Athena
Manage metadata and data lineage using Amazon Neptune DB
Expose APIs for data subscription and sharing using API Gateway and AWS Lambda
Automate infrastructure provisioning using Terraform and CloudFormation
Ensure data security and compliance by implementing robust IAM policies and access controls.
Develop and maintain a self-serve data portal using Angular and integrate it with backend services
Must Have Technical/Functional Skills
Strong experience in automating infrastructure provisioning using Terraform or CloudFormation (Preferably with Terraform)
Strong Experience with AWS Services: S3, Lake Formation, Glue, EMR, Athena, Lambda, EventBridge, SNS, SQS
Proficiency in Apache Spark for distributed data processing
Familiarity with Amazon Neptune DB for graph-based metadata management
Strong understanding of Data lake architecture, data governance and security best practices
Proficiency in SQL, Python and Spark for Data Engineering tasks
...multitask and act quickly. Welcome to Bojangles in Commerce GA, Cornelia GA, and Lavonia GA; where delicious flavors and genuine hospitality come together to create an unforgettable dining experience. Bojangles is not just a fast-food restaurant; it's a celebration of...
...Adjunct Faculty - Nursing Department: Nursing Program Location: Grand Rapids, MI Grand Rapids Community College department of... ...Monday through Saturday in different modalities such as Hybrid, Online, In-person & Virtual . For semester start and end dates, see...
...We are seeking a motivated, detail-oriented individual to join our team as an Event Coordinator. This is an excellent opportunity for someone looking to start a career in event planning and management. The Event Coordinator will assist in the planning, organization,...
...Parts Counter Person The Parts Counter Person is knowledgeable about automotive parts and accessories and can accurately answer questions and satisfy customer requirements in person or on the phone. They locate automotive parts within the current inventory or from...
...your success from day one. Our client is hiring entry-level Production Operators for their Sterling, Connecticut facility on the overnight shift.Whether you're starting your career or ready for a fresh opportunity, this full-time, contract-to-hire role offers hands-on...