Job Search

Senior Data Engineer

Job Title: Senior Data Engineer
Contract Type: Permanent
Location: Sydney
Reference: 3187803
Contact Name: Reece Richardson
Contact Email:
Job Published: November 11, 2020 14:16

Job Description

We're looking for a Senior Data Engineer to join a globally recognised financial services organisation. Reporting to the Data Management and Governance Manager, this newly created Senior Cloud Data Engineer position is to increase the company’s profits through the efficient and high-quality management of data to support analysts throughout the company. This individual will be a key member of an exciting, fast-paced, and growing team that is making an immediate impact across the entire company. This is a great opportunity for a talented data engineer to take his/her next career step by playing a leading role in the transformation to an AWS or Azure analytics environment and by deeply learning the company’s data and processes to gain the essential knowledge needed to support a wide variety of high-visibility projects. As the senior developer/analyst on the team, the Senior Data Cloud Developer will be challenged with projects that can span from tactical to strategic in nature!

What you will be doing in this role:
  • Support the COO, CFO, and Directors of Decision Science, Marketing, Marketing Analytics, and Credit Risk Management by enabling their departments’ analysts with trustworthy data and act as their liaison to the BI and AppDev teams for their data needs
  • Play a key role in the company’s transformation to a new Cloud paradigm, including the implementation of Cloud analytics AWS, Azure Data Lake Analytics, SQL Database, and Data Factory
  • Develop a broad knowledge of the company’s data assets and business processes that collect or produce data, and help the Data Management and Governance Manager to establish a culture of continuous learning about the business and financial services industry
  • Serve on an internal committee made up of senior analysts from across the company in defining the data vision, strategy, and tactics for the company and communicating changes to data systems
  • Assist in the development of standards for the company’s analytics platform, data quality, naming conventions, and data formats, as well as coordinate across the business an agreement of definitions consistent with the consumer credit industry
  • Act as an evangelist and internal resource to all business analysts on data assets
  • Facilitate and accelerate iterative learning and innovation using data assets
  • Assist business teams in the finalization of business requirements for the purpose of providing to the BI team for productionalising dashboards and reports
  • Translate business requirements into data harvesting prototypes (e.g. develop code to connect to APIs of new data sources for preliminary analysis as requested by business users, explore innovative approaches to harvest data, harvest data into a data lake, and establish processes to allow future requests to become more efficient
  • Create and maintain data catalogue and dictionaries
  • Create, extend and maintain ETL pipelines to form our data lake, data warehouse and analytics platform (currently using the AWS, Microsoft Azure set of tools and service)
  • Add new data sources to the data lake
  • Design and develop prototype data structures that refine raw data for use by business analysts, e.g. parse new data sources for preliminary analysis into a consumable format when requested by business analysts
  • Understand the processes of QA, design, and deployment used by BI and AppDev teams to ensure the resulting data meets the company’s quality standards
  • Provide data management support to business teams, including simple ad hoc data queries structured for use by less-technical business leaders and analysts
  • Maintain in-depth knowledge of best practices and technology for data storage and retrieval tools
  • Accountable for the successful management and completion of multiple concurrent projects that are on-time and with high quality
  • BS in Computer Science or related field, an analytical field (e.g. Statistics, Econometrics, Applied Mathematics), or a highly quantitative engineering (e.g. Chemical Engineering) field
  • 4 years of progressive experience in data engineering, data management, analytics, and data architecture
  • Advanced user of SQL and ETL tools (SSIS / Talend / Informatica / Data Services)
  • Proficiency in Microsoft Azure Cloud Data Services and Analytics Services, including Azure Data Lake, Azure Data Factory, and Azure SQL Database
  • Results-oriented self-starter who is confident in defending his/her critical thinking abilities
  • Proven track record of delivering successful projects on-time and with high-quality
  • Advanced knowledge of cloud analytics platforms best-practices
  • Customer service and consultative mindset
  • Capitalistic mindset supported by strong business acumen and work ethic
  • Demonstrated ability to communicate ideas and analysis results effectively both verbally and in writing to a non-technical audience
  • Cloud Amazon Web Services or Microsoft Azure certifications in related areas, such as Azure Solutions Architect Expert, or Azure Data Engineer Associate
  • PowerBI developer-level experience
If you are interested in hearing more about this role, apply now!

Get similar jobs like these by email

By submitting your details you agree to our T&C's