• Be part of a growing technology team in the middle of a digital transformation
• Join a fun place where people look forward to coming to work every day but also offer the flexibility to determine your own work-from-home schedule too!
  
  
  

Our Company

We are now the global leader in industry market research with a very loyal following of the world’s elite businesses we want to build relationships with at scale. How did we come to be a global leader? It’s all about our people…and we are looking to add even more talented people to our growing technology team.

IBISWorld is a place where we love coming to work every day, but also offers flexible working arrangements because we know work-life balance is important to make you successful. Do you want an environment where decisions are made together? Are you looking to play an integral role in the data and technology functions of a company?

At IBISWorld, our people are our most important asset. Our offices are filled with professionals who work hard for our clients, and also love to have fun. We promote a supportive and collaborative environment where management is invested in your development and growth. Be part of a technology and data team that can influence the way we think about and develop our products.

Job Overview

The Data Engineer will work within IBISWorld’s IT, Research and Product Development teams, responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and innovating to further build them out. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.

IBISWorld’s data team sits at the heart of product development, within IBISWorld’s product and IT teams, responsible for providing our 100,000+ customers with data and insights on over 10,000 industries globally.

This data-heavy role will also require working effectively with the broader IT development team across a range of projects and technologies, so strong communication and collaborative skills are must.

Key Duties

• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Snowflake and AWS ‘big data’ technologies.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Work with stakeholders including the Product, Data and IT teams to assist with data-related technical issues and support their data infrastructure needs.
• Create data tools for analysts and other Data Team members that assist them in building and optimizing our product into an innovative industry leader.
• Work with data and analytics experts to strive for greater functionality in our data systems.
  
  
  

As a successful candidate, you will have:

• BA/BS degree in in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. Graduate Degree a plus.
• 3-5+ years of experience in a Data Engineer role with direct experience with data ingestion, ETLs, event-driven architecture and using/implementing forecasting or imputation algorithms using large datasets
• Experience with relational SQL and NoSQL databases, including SQL Server and Snowflake.
• Experience with Infrastructure-As-Code tools, preferably Terraform
• Experience with AWS cloud services: Lambda, Step Functions, Glue, CloudTrail, CloudWatch, SNS, SQS, S3, etc.
• Experience with object-oriented/object function scripting languages: Python, Node.js, C++, etc. Python preferred.
• Experience with data warehousing using ELT integration processes
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management.
• A successful history of manipulating, processing and extracting value from large, disconnected datasets.
  
  
  

Other skills:

• Exceptional analytical and problem-solving skills; commercial mindset
• Exceptional organizational skills, with the ability to manage and prioritize various responsibilities and consistently meet deadlines. Flexibility to effectively deal with unexpected assignments, changes to workload or design revisions mid-project based on management priorities or client requests
• Excellent interpersonal, written and verbal communication skills, especially with stakeholders who often have limited technical knowledge
• Ability to work with others, as well as independently and autonomously with minimal supervision
  
  
  

Benefits

• Flexible working hours and remote working arrangements
• Professional development and training
• Employee benefits and rewards via free breakfast, fruit, and the Perkbox app
• Subsidized gym membership at the Grand Hyatt City Club
  
  
  

You will be rewarded with a competitive salary + super, work from home days as well as a great working environment.

If you think you are the ideal candidate for this role please apply by submitting your resume and a short cover letter. If you would like to know more about IBISWorld please visit our Careers Page (www.ibisworld.com/careers).

IBISWorld is an Equal Opportunity Employer. All applicants must be authorised for employment in Australia.