UAE
Senior Azure Databricks Data Engineer — AI Lakehouse Lead
Efforts Solutions IT LLC
- Industry Type
- IT
- Functional Area
- IT Industry IT
- Nationality
- Any
- Keywords
- Data Engineering Senior level Azure Data Platform Data Ingestion Pipelines Unity Catalog Management AIdriven Data Workflows Medallion Layers Int
Job Description
Efforts Solutions IT LLC is looking for a Senior Azure Databricks Data Engineer to lead AI Lakehouse projects. The role involves building data ingestion pipelines, managing data governance with Unity Catalog, and supporting AI-driven data workflows. The position is based in Abu Dhabi, UAE, initially remote with possible onsite or hybrid work.
- Position
- Senior Azure Databricks Data Engineer — AI Lakehouse Lead
- Company
- Efforts Solutions IT LLC
- Location
- Abu Dhabi, UAE
- Industry
- IT
- Experience
- 1 to 20 years
Responsibilities
- Build ingestion pipelines
- Govern data using Unity Catalog
- Enable AI-driven data workflows across Medallion layers
Show the original advert
Please register or log in to see the full job description. Register / Log in
About the role: Senior Azure Databricks Data Engineer — AI Lakehouse Lead
General information about this type of role, not from the employer. The employer's actual requirements may differ, so always check the job details above.
Senior Azure Databricks Data Engineers specializing as AI Lakehouse Leads design and manage advanced data solutions using Azure Databricks platforms. They typically work in IT companies or departments focused on cloud computing, big data, and artificial intelligence projects. Their role involves leading data engineering efforts to build scalable and efficient data lakes and AI-driven data architectures.
What this role usually involves
- Design and implement data pipelines and workflows using Azure Databricks.
- Lead the development and management of AI lakehouse architectures.
- Collaborate with data scientists and analysts to support AI and machine learning initiatives.
- Optimize data storage and processing for performance and scalability.
- Ensure data quality, security, and compliance within the data environment.
- Mentor junior data engineers and provide technical guidance.
Skills employers usually look for
- Proficiency in Azure Databricks and related cloud data services.
- Strong knowledge of big data technologies and data lakehouse concepts.
- Experience with programming languages such as Python, Scala, or SQL.
- Understanding of AI and machine learning workflows and integration.
- Ability to design scalable and efficient data architectures.
- Good communication and leadership skills.
Usual qualifications
- A degree in computer science, information technology, or a related field is usually expected.
- Certifications in Azure cloud services or data engineering are advantageous.
- Experience with big data and AI technologies is often required.
- Continuous learning in emerging data engineering tools and practices is beneficial.
Similar jobs
- 24/7 IT Infrastructure Engineer – MHS & PLC Integration Lodige Industries
- IT Support Engineer — Microsoft 365 & Helpdesk Confidential Company
- Tax - ITTS - Transfer Pricing - Senior EY
- IT Support Specialist (L1/L2) – Windows & Network Expert Jobenvo
- IT Support Specialist Opportunity at ONOV8 AE Jobs
- Senior Contact Center Solutions Lead (24/7 IT Ops) Abu Dhabi Islamic Bank PJSC