Connecting...

W1siziisimnvbxbpbgvkx3rozw1lx2fzc2v0cy9wzxjpz29ulwdyb3vwl2pwzy9iyw5uzxitzgvmyxvsdc5qcgcixv0

Job Search

Big Data Engineer

Job Title: Big Data Engineer
Location: Sydney
Industry:
Reference: 1729983
Contact Name: Sam Marshall
Contact Email: sam.marshall@perigongroup.com.au
Job Published: May 12, 2020 18:15

Job Description

The Company 

Leading organisation firm in Sydney is about to start a Big Data implementation project
 
The role 

In this team you will be part of the the overall data team, and will have involvement in multiple projects to deliver a data service to within the organisation. 

Responsibilities 

  • Analyse content , integrity and coherency of new and ad hoc data sources to be used in data mining
  • Collaborate with the data science team 
  • Create and maintain ETL transforms and flows for data sources being presented to the big data platform
Skills required 

  • 2+ years working in data processing development and operations functions
  • Experience in working with large amounts of diverse data using S3/HDFS/Hadoop and MapReduce in an AWS framework 
  • Strong programming skills in one or more of Python, Java, javascript, pig , hive 
Desirable 

  • Experience in implementing google Big Query and or Redshift
  • Knowledge of analytics tools such as SAS, SPSS with machine learning being an advantage 

If you have experience of the above but not Hadoop, you are likely to still be considered