Job description
Melbourne based - 6 months contract with extensions likely!
Our Client is a leading Consulting firm looking for an AWS Data Engineer for one of their established Melbourne based projects.
Responsibilities include:
- Work on building real-time data pipelines and working with graph databases.
- Role involves the creation and management of various AWS resources, including deployment and configuration.
- It requires the knowledge of Aws CloudFormation for resources deployment, as well as general AWS knowledge of resources such as S3, secret manager, CloudWatch and lambda.
- The project involves an Extract, Transform Load job in AWS glue, which is written in python to gather data from bigQuery and store in an amazon RDS instance.
- Python coding experience will be required as well as some SQL database knowledge to setup, deploy tables as well as inserting and modifying records. Deployment of these resources through the form of shell scripts.
Must Have skills:
- Proficiency in working with Graph databases like Neptune or Neo4j.
- Day-to-day experience with AWS technologies such as Neptune, Sagemaker, and ECS Fargate.
- Experience in building and managing cloud-native data pipelines using Glue.
- Experience in BigQuery.
- Strong expertise in extracting, processing, storing, and querying petabyte-scale datasets.
- Proficiency in Python 3 or Java programming.
To be considered for the role click the 'apply' button or for more information about this and other opportunities please contact Ian Cardinal on 07 3472 6580 or email: [email protected] and quote the above job reference number.
