Job Details

📍 Location: Cape Town, Western Cape, South Africa (Hybrid – Pinelands)
🏢 Company: Confluent Services South Africa
💼 Job Title: Data Engineer (Intermediate) / Databricks Engineer
📊 Industry: Financial Services
🧑‍💻 Job Type: Permanent
📅 Closing Date: 30 May 2026

Company Overview

Confluent Services is South Africa’s largest and multi-award-winning debt management company. The organisation operates at scale, delivering impactful financial solutions that help improve the financial well-being of South Africans.

The company fosters a collaborative, innovative, and growth-focused culture, where engineers are encouraged to contribute ideas, influence architecture, and continuously develop their skills. With a strong focus on modern technologies, Confluent provides exposure to cutting-edge platforms shaping the future of data engineering.

Job Overview

The Databricks Engineer will form part of the Data Team and will be responsible for designing, building, and maintaining scalable data solutions across cloud and on-premise environments.

This role goes beyond maintenance work—you will actively contribute to building modern data platforms using technologies such as Azure Databricks and Microsoft Fabric, supporting analytics, machine learning, and data-driven decision-making.

Key Responsibilities

Data Engineering & Architecture

Design and contribute to the architecture of the data platform
Develop scalable data pipelines and ingestion frameworks
Support cloud-based and on-premise data environments

Development & Implementation

Build and maintain ETL processes using Python, PySpark, and SQL
Implement solutions on Microsoft Azure, including Azure Data Factory and Databricks
Optimise data workflows for performance and scalability

Data Management & Quality

Ensure data integrity, quality, and security across systems
Manage data storage solutions such as Azure Data Lake and SQL Server

Collaboration & Stakeholder Engagement

Work closely with data scientists, analysts, and business stakeholders
Translate business requirements into technical data solutions

Innovation & Continuous Improvement

Contribute to AI and machine learning initiatives
Participate in architectural decisions and technical discussions

Qualifications

Education

Bachelor’s Degree in Computer Science, Engineering, or a related field
Relevant certifications in Azure, Microsoft Fabric, or Databricks (advantageous)

Experience

Minimum 3 years’ experience in data engineering or similar roles
Experience with data pipelines, ETL processes, and data integration
Background in technical data roles such as data analytics or data science

Skills

Strong Python / PySpark and SQL / SparkSQL skills
Experience with Azure Data Factory and Azure Databricks
Knowledge of data storage solutions (SQL Server, Azure Data Lake)
Strong problem-solving and analytical thinking
Excellent communication and teamwork abilities

CV Tips for Applicants

Highlight hands-on experience with Azure, Databricks, and ETL pipelines
Include specific projects where you built or optimised data pipelines
Clearly show your programming skills (Python, SQL) with real examples
Mention any cloud certifications or data engineering tools
Quantify achievements (e.g., improved pipeline efficiency, reduced processing time)

Benefits of Joining Confluent

Exposure to cutting-edge tools like Databricks and Microsoft Fabric
Opportunity to work on AI and machine learning initiatives
Collaborative and knowledge-sharing engineering culture
Career growth and internal mobility opportunities
Access to benefits such as medical aid, retirement annuity, and bursaries
Work in a dynamic, diverse, and supportive team environment

Company Policy

Confluent Services is committed to diversity, inclusion, and equal opportunity employment. All applications will be handled in line with relevant data protection and employment legislation.

If you do not receive feedback within a reasonable period after the closing date, please consider your application unsuccessful.

To apply for this job please visit intelligent-debt-management.simplify.hr.