Data Flow Engineer (PROJ-4349)
Job Description
Remote is seeking a Data Flow Engineer to join the team in Home Affairs. The Data Flow Engineer will be responsible for building and managing secure transfers of data between different networks along with providing monitoring and alerting services. This includes the development and sustainment of data flows using a variety of technologies. They will also manage capability and processes, using appropriate tools and techniques that conform to agreed process standards and industry specific regulations. Working in a diverse team environment, this will involve sharing outcomes and experience with others to support development and growth.
This role sits within the Data Flows team who provide architecture,management and support of data flows. The team acts as a digital post office through automated routing of data to and/or from systems including the collection of data feeds from external sources to be ingested and distributed to systems. (RFQ-HA-18-2025)
Role Description
Key Responsibilities
- Engineer, implement, test, debug, and monitor data flows to ensure the continuous distribution of data from sources to destinations in an efficient and timely manner.
- Architecture, management and support of secure gateways and data flows.
- Automated routing of data to and/or from systems including the collection of data feeds from external sources to be ingested and distributed to systems.
- Developing relevant technical documentation.
- Working with business stakeholders, project managers, system architects, software developers and date engineers.
Desirable Qualifications
- Tertiary qualifications in a technology field.
Required Knowledge/Experience and tools
- 3+ years of relevant data flow or System Administrator experience.
- Programming experience (e.g. Python and SQL).
- Experienced in a range of monitoring and alerting platforms.
- Knowledgeable about automated deployments.
- Knowledgeable in designing and building integrations to facilitate interactions between systems, via API’s and Object Stores
- Ability to integrate with domain services such as Active Directory, Certificate Servers and security products
- Provide technical expertise to enable the configuration of system components and equipment for systems testing.
- Ability to design, perform and report results of tests for integration builds.
- Identify and document data flow and system integration components for recording in the configuration management system.
- Demonstrated ability to develop technical documentation and track work in collaboration tools such as Confluence and JIRA.
Highly Desirable:
- Linux-based system administration skills.
- Building and operating a continuous integration (CI) capability when required for employing version control of source code and related artefacts.
- Contributing to the selection of the configuration methods, tools and techniques.
- Knowledge in Cyber Security