AZURE Data Engineer - ADF, ADB, PySpark, SQL, and architecting ETL frameworks. Job at Atlantis IT group, Ontario, CA

Wnl3T29FNGhic2Q5eUNyK0toNWkwQWVablE9PQ==
  • Atlantis IT group
  • Ontario, CA

Job Description

Role: AZURE Data Engineer - ADF, ADB, PySpark, SQL, and architecting ETL frameworks.

Toronto

Hybrid - 4 days

Role Description:
Looking for a Data Engineer with strong experience in ADF, ADB, PySpark, SQL, and architecting ETL frameworks.


Essential Skills:
Azure Data Factory (ADF)
Azure Databricks (ADB)
PySpark
SQL
Architecting ETL Frameworks


Required Skills:
Strong communication skills with the ability to liaise and coordinate with SMEs and technical partners Strong ability to break down technical requirements into actionable tasks Proficient with relational databases such as MS SQL and SQL scripting Proficient in building and maintaining Azure Data Factory pipelines for data ingestion orchestration Good OOP understanding with experience in Python or Java Proficiency with Git (Bitbucket or GitHub) Good understanding of CI/CD concepts for building and deploying artifacts Understanding of synchronous and asynchronous data encryption/decryption


Nice to Have Skills:
Azure Databricks Notebooks or Apache Spark for data transformations Datadog dashboard and monitoring experience Azure Data Lake Gen2 Understanding of Parquet and Delta Lake concepts Experience with XLR for CI/CD Experience with Flyway for data migrations

Job Tags

Similar Jobs

Better Talent

Managing Attorney (Immigration) Job at Better Talent

 ...Bennett Law Center is seeking a seasoned and strategic Managing Attorney to lead our Legal Department. In this senior-level role, you...  ...of high-quality legal services across a broad range of immigration matters. You will manage your own small case load with a billable... 

Piedmont Healthcare

Charge Nurse - Cardiac Telemetry Job at Piedmont Healthcare

 ...Infusion/Oncology) Required NRP by the end of orientation period (Womens Services: Labor and Delivery, Mother/Baby, NICU, NAT, Nursery) Required AWHONN Intermediate Fetal Monitoring Program within 12 months of start date (Labor and Delivery) within 1 Year Required... 

Tomra

Box Truck Driver Job at Tomra

 ...TOMRA, an international recycling company, is looking for a Box Truck Driver to transport used beverage containers and store supplies in a safe and timely manner for our Farmington, NY location. (No CDL required!). HOURS: Monday through Friday, 7:00a - 5:00p... 

Moses Auto Group

Receptionist Job at Moses Auto Group

 ...industry through purposeful innovation and creativity.The Receptionist within our Business Develop Center is the first contact to greet...  ...manner, and transferring to the correct department. No experience necessary.Our company offers great benefits, including:... 

Cloud Analytics Technologies LLC

UI Path-RPA-Power Platform Developer Job at Cloud Analytics Technologies LLC

 ...Job Description: Overview of project/skills required: We are seeking an experienced UiPath Developerwith strong Microsoft Power Platform skills to design, develop, and maintain intelligent automation solutions. This role will focus on automating business processes...