Data Engineer
2001-30000
Other
What are you going to do
The position will be based in Perth. For further information about this position please apply.
This role supports the development of a new portfolio management application, which involves contributing to both software and data engineering requirements.
Key Accountabilities:
Essential skills and knowledge
Requirements:
Benefits:
The position will be based in Perth. For further information about this position please apply.
This role supports the development of a new portfolio management application, which involves contributing to both software and data engineering requirements.
Key Accountabilities:
- Contribute to design and engineering of an end-to-end production ready project solutions
- Analyse and select platform and tools for different parts of Data science and analytics projects
- Assist with creation and deployment of pipelines, models and solution architecture designs
- Contribute to data governance and data related decisions (tools, sources, quality)
- Contribute to software development, platform, practices and tools
- Assist on collecting, designing, using standards for best data engineering practices
- Assist in scoping, pinpoint blockers and niches
Essential skills and knowledge
Requirements:
- Relevant tertiary qualification
- Experience with Azure cloud platforms, including SQL Database and App Services for data storage, processing, and web hosting
- Proficiency in Python programming and Javascript. Python Flask and Vuejs knowledge preferred.
- Experience in Data Engineering with Databricks Platform
- Knowledge and experience in designing and implementing ETL processes to extract, transform, and load data into cloud data storage systems
- Knowledge of CI/CD pipelines, version control systems (e.g., Git), and configuration management tools (e.g., Ansible, Chef, Puppet)
- Strong problem-solving skills to optimize performance and implement scalable cloud solutions
- Experience with querying and manipulating data in relational and NoSQL databases
- Proficiency in Git for version control and collaboration within Agile methodologies, using tools like Atlassian and Azure DevOps
Benefits:
- Salary sacrificing
- Employee Assistance Program (EAP)
- Corporate discounts
JOB SUMMARY