Technology Lead | Azure Data Engineering Job at 2T Consulting, Atlanta, GA

YVRiQ1ZpMHA1T05uOWw4TCtMZjk2RDRnVVE9PQ==
  • 2T Consulting
  • Atlanta, GA

Job Description

We are seeking an experienced Technology Lead / Azure Data Engineer with strong hands-on expertise in Azure Synapse Analytics and PySpark. The ideal candidate will have a deep understanding of Apache Spark, distributed data processing, Data Lake architecture, and modern data engineering practices.

Must-Have Skills

  • Azure Synapse Analytics
  • PySpark
  • Apache Spark architecture
  • Spark SQL
  • Data Lake architecture
  • Medallion Architecture
  • Data transformation and processing
  • Strong troubleshooting and problem-solving skills

Nice-to-Have

  • Microsoft Fabric
  • Experience with modern cloud data platforms

Responsibilities

  • Design, develop, and optimize data solutions using Azure Synapse Analytics.
  • Develop scalable data pipelines and transformations using PySpark and Spark SQL.
  • Apply Apache Spark architecture and distributed processing concepts to large-scale data workloads.
  • Design and implement Data Lake and Medallion Architecture solutions.
  • Troubleshoot performance, data quality, and pipeline-related issues.
  • Collaborate with cross-functional teams to understand requirements and deliver scalable solutions.
  • Evaluate and leverage Microsoft Fabric capabilities where appropriate.
  • Provide technical leadership and contribute to solution architecture and development standards.

Required Qualifications

  • 8+ years of experience in data engineering, cloud platforms, or related technology roles.
  • Strong hands-on experience with Azure Synapse Analytics.
  • Strong programming experience with PySpark and Spark SQL.
  • Deep understanding of Apache Spark and distributed data processing.
  • Experience designing and implementing Data Lake architectures.
  • Excellent communication and collaboration skills.
  • Strong analytical, troubleshooting, and problem-solving abilities.

Job Tags

Contract work

Similar Jobs

Douglas County

Deputy Sheriff Job at Douglas County

 ...Job Description Located in Douglas County, SD Position Summary: The Deputy Sheriff works under the authority and general supervision of the Sheriff. He/she serves in a highly responsible and visible capacity in the protection of life and property, preserving the... 

DivaDance

Dance Instructor/ Choreographer Job at DivaDance

DivaDance Rockwall/Wylie is Hiring Instructors! Do you love dance, music, and creating an environment where people feel confident enough to completely let loose? DivaDance Rockwall is looking for energetic, dependable, and charismatic instructors to join our founding...

Wynn Las Vegas

Assistant Director - Crisis Management & Resilience Job at Wynn Las Vegas

 ...Job Description The Assistant Director Crisis Management & Resilience (ADCMR) is responsible for strengthening Wynn's organizational resilience by leading the development, implementation, and continuous improvement of an integrated Crisis Management and... 

NOLA Detox

General Application Job at NOLA Detox

Don't See Your Role? We Still Want to Hear From You!Interested in joining the NOLA Detox &...  ...could bring to the NOLA Detox team.Use this General Application to submit your resume and tell us where you see yourself fitting in.Help Us Get Your Application to the Right PlacePlease... 

Melben

Service Technician (CNC Machines) - Maintenance Tech Job at Melben

 ...time, direct hire, start date flexible. Type: Direct Hire. Melben is recruiting a Service Technician to maintain and repair CNC machines for a manufacturer in Cincinnati, OH. This is a direct-hire, full-time position on the employer's payroll, with one opening. Pay...