Data Engineer and ETL Developer (PROJ-4344)
Job Description
Remote is seeking a Data Engineer / Data Warehouse – ETL Developer to join the team in Home Affairs. The Data Engineer will be responsible for unlocking the value of data by managing, transforming and operationalising data for use by business areas. This includes the development and sustainment of data pipelines utilising Enterprise Data Platforms. They will also manage end-to-end data management processes, using appropriate tools and techniques that conform to agreed process standards and industry specific regulations. Working in a diverse team environment, this will involve sharing outcomes and experience with others to support development and growth.
This role sits within the Data Engineering team who support the Enterprise by providing data that is fit-for-purpose, complete, accurate, and consistent for end users. The team employs contemporary and innovative tools and techniques to automate the ingestion of data into Enterprise Data Platforms. Part of the role will be ensuring that all development is in line with standard engineering and technical approaches employed by the team, and that risks associated with deployment are adequately understood and documented. (RFQ-HA-19-2025)
Role Description
Key Responsibilities
- Design, implement, and maintain data engineering solutions in SQL and Python.
- Build tooling and techniques which are well tested, documented and provide consistency in data engineering approaches.
- Fuse data sources using various data pre-processing techniques such as transformation, integration, normalisation, and feature extraction to create useful data structures.
- Carry out data quality checking and remediation
- Develop technical documentation and track work in collaboration tools such as Confluence and JIRA.
Desirable Qualifications
- Tertiary qualification in a technology field.
Required Knowledge/Experience and tools
- 3+ years of relevant Data Engineering / Data Warehousing experience
- Ability to develop, deploy and maintain scalable data engineering solutions in SQL and Python
- Ability to create and maintain standardised tooling and techniques, ensuring consistent ETL and data warehousing approaches, accompanied by thorough testing and documentation
- Ability to combine data sources using various data pre- processing techniques such as transformation, integration, normalisation, and feature extraction to create useful data structures
- Conduct data quality assurance and perform remediation as needed
- Demonstrated ability to craft technical documentation and effectively collaborate using a variety of tools to ensure seamless tracking and communication.
Highly Desirable:
- Proficiency in platform engineering, including containerisation
- Skills in designing and building APIs to facilitate seamless integration
- Proficiency in technologies that control the flow of data
- Experience in a range of data storage platforms, including:
o Online Analytical Processing (OLAP)
o Relational databases (RDBMS)
o Document stores
- HR and Finance data experience with HR/Finance systems will be highly desirable