Data Engineer

Join a global financial services organisation whose core purpose is to seek out and invest in exceptional individuals who understand and support their core purpose, and whose values align and pride themselves with attracting intellectual leaders who are the best in their respective field you will be accountable for assisting in designing, building, and maintaining scalable data pipelines using Python, AWS services and Databricks.

Responsibilities:

• Data pipeline development: Design, build, and maintain scalable data pipelines using Python, AWS services (E.G., S3, Glue, Lambda), and databricks to support data ingestion, transformation, and storage.
• Data integration: Integrate structured and unstructured data from various sources, including policy administration systems, claims databases, and customer relationship management (CRM) platforms.
• Collaboration: Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that support analytics and reporting needs.
• Data quality assurance: Implement data validation and cleansing processes to ensure the accuracy and reliability of data used for decision-making.
• Documentation: Maintain comprehensive documentation of data workflows, schemas, and processes to facilitate knowledge sharing and compliance.
• Continuous learning: Stay updated with emerging technologies and best practices in data engineering to contribute to the team's growth and innovation

Qualifications and experience:

• Bachelor’s degree in computer science, information systems, engineering, or a related field.
• Proficiency in Python for data manipulation and scripting.
• Experience with AWS services such as S3, Glue, Lambda, and Redshift.
• Familiarity with databricks and spark for big data processing.
• Strong SQL skills for querying and managing relational databases.
• Industry experience: Prior experience in the insurance sector, with an understanding of insurance data structures and regulatory requirements.

The reference number for this position is NG60471 which is a permanent, Hybrid role in Johannesburg offering a salary of R350k to R450k per annum CTC negotiable based on experience. E-mail Nokuthula on e-Merge.co.za or call her for a chat on 011 463 3633 to discuss this and other opportunities.

Are you ready for a change of scenery? e-Merge IT recruitment is a niche recruitment agency. We offer our candidates options so that we can successfully place the right people with the right companies, in the right roles. Check out the e-Merge IT website www.e-merge.co.za for more great positions.

Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!

Posted on 24 Jul 15:20, Closing date 22 Sep