Job Search

Databricks Engineer

Job Title: Databricks Engineer
Location: Sydney
Reference: 3195032
Job Published: November 30, 2020 21:00

Job Description

The Role:
  • Our client is looking for a Databrick's Engineer to work on greenfield projects across Data Lake integrations and data transformations.

The Opportunity:
  • Continuously improve the data load performance and presentation of data to external systems and users
  • Assist in planning and implementation of software releases or changes to the environment
  • You will be responsible for application and end-to-end technical support for the data lake.
  • Previous experience in data validation, system monitoring and improving data load performance is highly beneficial.
  • Upskilling peers and sharing knowledge on Databricks and Azure.

About You:
  • Extensive Experience with Databricks or Apache Spark – Databricks preferable
  • Knowledge of Spark/Databricks configuration and management
  • Experience managing and setting up Spark streaming and batch processing
  • Knowledge of Azure – Datalake, Data Factory 
  • Experience with Microsoft SQL Server 
  • Good understanding of Security principles, certificates, firewalls and PCI

Get similar jobs like these by email

By submitting your details you agree to our T&C's