Job description
We are currently recruiting for an experienced Data Engineer to join a growing team, with a focus on delivering cutting-edge data solutions. The ideal candidate will have proven experience with Scala and Apache Spark, combined with strong expertise in ArangoDB and AQL. You will be responsible for designing, building, and maintaining robust data pipelines, managing ETL processes, and ensuring the seamless flow of data across platforms.
This is a fantastic opportunity for an experienced data professional who enjoys working with modern technologies and solving complex data challenges. You'll work closely with teams of engineers, data scientists, and analysts, ensuring high-quality data solutions that support business decisions and processes.
Key Responsibilities:
- Develop and maintain scalable and high-performance data pipelines using Scala and Apache Spark.
- Design, implement, and manage ETL processes to support data workflows and operations.
- Utilise ArangoDB and AQL for data modeling, query design, and optimisation of database performance.
- Collaborate with cross-functional teams to ensure data quality and consistency across all processes.
- Troubleshoot data-related issues and identify opportunities to improve data flow and system performance.
- Work independently to deliver solutions and also effectively collaborate with a team of data engineers and stakeholders.
- Provide technical insights, contribute to problem-solving, and continuously improve data engineering practices.
Key Skills & Experience:
- Proven experience as a Data Engineer with hands-on expertise in Scala and Apache Spark.
- Strong experience with ArangoDB and proficiency in AQL. Certification in ArangoDB is highly desirable.
- Extensive experience in developing and maintaining ETL processes and data pipelines.
- Excellent problem-solving abilities, with a keen eye for detail and data integrity.
- Strong communication and collaboration skills to work effectively in a team-based environment.
- Ability to work both independently and as part of a diverse team to meet project deadlines and business requirements.
To be considered for the role click the 'apply' button or for more information about this and other opportunities please contact Anita Cunningham on 07 33395626 or email: [email protected] and quote the above job reference number.
Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability. If you require an adjustment to the recruitment process, including the application form in an alternate format, please contact me on the above contact details.
