Job description
Job Overview:
We are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have strong expertise in Azure cloud services, data processing frameworks, and data visualization tools. You will be responsible for designing, building, and maintaining scalable data solutions, ensuring efficient data processing and analysis.
Key Responsibilities:
- Design, develop, and maintain data pipelines using Azure services.
- Utilize PySpark, SQL, and Python for data processing, transformation, and analysis.
- Implement and manage data warehousing solutions such as Databricks and Synapse.
- Leverage Hive for optimized data storage and processing.
- Develop and maintain data visualizations and reports using Power BI.
- Work with Azure Functions to create scalable and automated solutions.
- Utilize Java for data engineering tasks and workflow automation.
- Integrate AWS services for cloud-based data solutions.
- Collaborate with cross-functional teams to design scalable solution architectures and develop APIs.
- Ensure data quality, security, and compliance with best practices.
Key Requirements:
- Proven experience as a Data Engineer or in a similar role.
- Expertise in Azure services and cloud infrastructure.
- Proficiency in PySpark, SQL, and Python for data processing.
- Experience with Hive for data storage and processing.
- Strong knowledge of Power BI for data visualization.
- Hands-on experience with Databricks and Synapse for data warehousing.
- Familiarity with Azure Functions and their applications.
- Proficiency in Java for data engineering.
- Knowledge of AWS services and infrastructure is a plus.
- Strong understanding of solution design and API development.
- Excellent problem-solving skills, attention to detail, and collaboration abilities.
Preferred Qualifications:
- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
- Certifications in Azure, AWS, or Data Engineering are a plus.
If you are passionate about building scalable data solutions and working with cutting-edge cloud technologies, we encourage you to apply!
To be considered for the role click the 'apply' button or for more information about this and other opportunities please contact Pam Kaur on + 618 7422 0615 or email [email protected] and quote the above job reference number.
Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability. If you require an adjustment to the recruitment process, including the application form in an alternate format, please contact me on the above contact details.
