Local to Cary NC only!
Design and build batch and streaming data pipelines using Azure, Databricks, and Kafka.
Develop ETL/ELT solutions using Spark, SQL and Python/Pyspark, or Scala
Implement and support Data Lake / Lakehouse architectures
Integrate data from legacy and modern platforms. Preferred postgres DB migration to Azure Cloud.
Expertise in handling Data migration using API's.
Apply data quality checks and support data governance basics (metadata, lineage, access controls)
Optimize Spark jobs for performance, reliability, and cost
Collaborate with cross-functional teams, Product owners, Admin teams, BSAs, Scrum & Project managers
Required Skills & Experience:
8+ years of experience in data engineering in azure using Azure Databricks.
Strong experience with Azure Data Lake, Databricks, ADF, Postgres.
Strong Data Engineering experience in Big Data (Cloudera)
Hands-on expertise in SQL, Python and PySpark or Scala
Proven experience with batch & real-time ingestion
Experience with Kafka and big data processing
Added good to have experience with:
Informatica PowerCenter
Informatica IDMC or equivalent cloud data integration tools
SQL Server, Oracle, Azure SQL
Cosmos DB
Unix/Linux
Maestro (or similar enterprise schedulers)
Data tools such as Precisely or equivalent
Added Advantage
Insurance domain knowledge (Policy, Claims, Billing, Underwriting, Actuarial, Regulatory data)
Experience with Azure DevOps (AzDO) and GitHub-based CI/CD
Practical usage of Copilot for data engineering and development productivity
Exposure to Generative AI / GenAI use cases in data platforms and analytics
Role Descriptions: Microsoft Azure (ADB/ADF)
Essential Skills: Microsoft Azure (ADB/ADF)
...and explore a career with Dal-Tile. Are you passionate about serving others? Do you have experience in employee relations, recruiting and onboarding, employee engagement, and training? Would you like to join a dynamic Human Resources team in a Distribution environment...
...qualified candidate to support the Missile Defense Agency (MDA) as an Entry level Cost Estimating Analyst. This position will perform Cost... ...'s Degree in Mathematics, Engineering, Operations Research, Economics, Statistics, Business Analytics, or related field.Experience:...
...Springs, GA location. If you have had it with your "Big 4" or 10 firm not providing the promotion potential you feel you need, and or... ...sheets, this could be a great opportunity. Top ranked local boutique CPA firm with less than 100 employees, is growing through new client...
...Everlight is seeking a skilled Recruitment Assistant to assist in attracting candidates, screening them and matching them to appropriate positions. These collaborative individuals use high communication skills to manage a variety of functions related to recruitment, including...
...autism, physical disabilities, neurobehavioral disorders, and other special needs. The Evergreen Center welcomes all individuals from... ...Evergreen Center is seeking a bright and energetic Special Education Teacher who is responsible for direct instruction and curriculum...