Connecting...

W1siziisimnvbxbpbgvkx3rozw1lx2fzc2v0cy9wzxjpz29ulwdyb3vwl2pwzy9iyw5uzxitzgvmyxvsdc5qcgcixv0

Job Search

Big Data Engineer

Job Title: Big Data Engineer
Location: Sydney
Industry:
Reference: 3130431
Contact Email: sam.marshall@perigongroup.com.au
Job Published: May 13, 2020 12:00

Job Description

The Company 

Leading Global organisation firm in Sydney is about to start a Big Data implementation project
 
The role 

In this team you will be part of the the overall data team, and will have involvement in multiple projects to deliver a data service to within the organisation. 

Responsibilities 

  • Analyse content , integrity and coherency of new and ad hoc data sources to be used in data mining
  • Collaborate with the data science team 
  • Create and maintain ETL transforms and flows for data sources being presented to the big data platform
Skills required 


  • 2+ years working in data processing development and operations functions
  • Experience in working with large amounts of diverse data using S3/HDFS/Hadoop and MapReduce in an AWS framework 
  • Strong programming skills in one or more of Python, Java, javascript, pig , hive 
Desirable 

  • Experience in implementing google Big Query and or Redshift
  • Knowledge of analytics tools such as SAS, SPSS with machine learning being an advantage