Lead Data Engineer Job at Snowrelic Inc, Charlotte, NC

aFVxcWhRbEMzY0NuTlZ2b1pZTVVSWHJxK1E9PQ==
  • Snowrelic Inc
  • Charlotte, NC

Job Description

Position: Lead Data Engineer

Location: Cincinnati ,OH / Charlotte ,NC

  • Design and implement scalable data pipelines and architectures on Azure Databricks.

  • Optimize ETL/ELT workflows, ensuring efficiency in data processing, storage, and retrieval.

  • Leverage Apache Spark, Delta Lake, and Azure-native services to build high-performance data solutions.

  • Ensure best practices in data governance, security, and compliance within Azure environments.

  • Troubleshoot and fine-tune Spark jobs for optimal performance and cost efficiency.

  • Lead the migration of Azure SQL to Azure Databricks, ensuring a seamless transition of data workloads.

  • Design and implement scalable data pipelines to extract, transform, and load (ETL/ELT) data from Azure SQL into Databricks Delta Lake.

  • Optimize Azure SQL queries and indexing strategies before migration to enhance performance in Databricks.

Job Tags

Full time, Part time, Seasonal work,

Similar Jobs

JEVS Human Services

HVAC Assistant Instructor Job at JEVS Human Services

 ...join the team at our Orleans Technical College as an HVAC Assistant Instructor. The Instructor will be responsible for teaching students...  ...accredited, degree or certificate level courses ~ Health, Dental, and Vision coverage ~ Ample paid vacation and sick time... 

In House Jobs | JDHuntr

In House Counsel Jobs New York | JDHuntr 63648 Attorney, Litigation Workers Compensation $71K - $133K (Remote), Tarrytown, NY Job at In House Jobs | JDHuntr

In House Counsel Jobs New York | JDHuntr 63648 Attorney, Litigation Workers Compensation $71K - $133K (Remote), Tarrytown, NY Apply on JDHuntr.com Post Date: 12.6.2023*Handles insurance defense/ Workers Compensation coverage matters from pleadings through trial. *... 

Sarasota Jungle Gardens

Custodian Job at Sarasota Jungle Gardens

 ...Custodian Essential commercial cleaning experience is required High School Diploma or GED equivalent is required Must be able to speak and understand English and communicate clearly Must have initiative and organization skills Good customer service skills... 

Set of X

Network Engineer Job at Set of X

 ...do great work, the Set of X team is building an elite group of engineers with a strong sense of shared responsibility and ownership....  ...for the critical review of, and providing recommendations on, networks or network service design, maintenance, and implementation, including... 

AmeriCare Plus

Live-In Companion - Alleghany Job at AmeriCare Plus

 ...Live-In Caregivers Needed! Do you have a heart for caregiving but dont enjoy shift work? Are you looking for a schedule you can count on to plan family time? If so, You may be looking for a career as a Live-In Caregiver providing one-on-one care living in a Client...