Senior Data Engineer, Police & Public Protection Technology

Home Office Digital designs, builds and develops services for the rest of the department and for government. Every year our systems support up to 3 million visa applications, checks on 100 million border crossings, up to 8 million passport applications and deliver 140 million police checks on people, vehicles and property. Senior Data Engineers design and implement complex data flows to connect operational systems with analytics and BI systems. You’ll build and manage data flows, collaborating with the Data Science community and Product Owners to identify strategies and services to best support business needs. You’ll help set the direction for service technology and data architecture, while mentoring junior team members, promoting collaboration and encouraging an agile approach to work.

You’ll get to work with some of the largest and most varied datasets around, and benefit from a wealth of continuous professional development resources and career opportunities. You’ll play a key role in delivering joined-up, intelligent services that unlock the value from data and deliver better outcomes for the UK.

Where business needs allow, some roles may be suitable for a combination of office and home-based working. Where this is the case, employees will be expected to spend a minimum of 60% of their working time in the office. Applicants can raise any queries to the email address at the bottom of the advert.

Watch this short video to hear from members of Home Office Digital talking about the projects they work on and their experience of working here: Working for Home Office Digital.

Senior Data Engineers design and lead the implementation of complex data flows to connect operational systems, data for analytics and BI systems.

As a Senior Data Engineer, you will identify, build, modify and manage data flows between complex systems using the appropriate solution.

You will be working with the Data Science community, who set the scope of data engineering work through user research and data pipelines. Through sharing work with Product Owners, you will identify strategies for how the service is best able to support business needs.

You will work with fellow members of the Data Engineering community to set the direction of the service technology and data architecture. You will also mentor more junior members of the team - promoting challenge, collaborating and encouraging an agile approach to working.

Main Responsibilities

• Design, build and maintain robust, scalable data workflows, pipelines and ETL processes (including streaming, automation, data transformation, API integration, file handling and error handling) to ensure reliability, usability and integrity of critical datasets.
• Deliver end-to-end data solutions and products, covering analysis, requirements review, solution design, development, testing, deployment and ongoing optimisation for complex and large-scale data products.
• Collaborate with internal and external stakeholders to develop data solutions that meet business needs, are fit for downstream use, and clearly communicate insights derived from data profiling and source system analysis.
• Lead on database management activities, including mapping data to agreed data models, applying data profiling and modelling techniques, and ensuring effective use across multiple subject areas.
• Investigate and resolve data issues by analysing root causes, experimenting with solutions, driving innovation and delivering continuous improvement in data quality, performance and storage capacity.
• Develop, test and assure data products and pipelines across the full development lifecycle, including defining test conditions, analysing test outcomes, and providing guidance on data-related issues.
• Contribute to strategic improvements, including re-platforming data systems to the public cloud, refreshing tooling, and optimising code from prototype through to production-ready solutions.
• Ensure data solutions comply with data privacy and information security requirements, working closely with relevant specialists, while advocating best practice and supporting team delivery.

Proud member of the Disability Confident employer scheme

Disability Confident

About Disability Confident

A Disability Confident employer will generally offer an interview to any applicant that declares they have a disability and meets the minimum criteria for the job as defined by the employer. It is important to note that in certain recruitment situations such as high-volume, seasonal and high-peak times, the employer may wish to limit the overall numbers of interviews offered to both disabled people and non-disabled people. For more details please go to Disability Confident.