Assessment and Judging

Table of contents:

• What is Assessment and Judging?
• Assessment
• Judging
• Ofwat decision
• Past Judges
• Judge Nominations

What is assessment and judging?

Assessment and judging is the process of selecting which entries will move to the next stage of a challenge i.e. selecting the winners, the finalists etc.

The winning entries are chosen based on published selection criteria. The selection criteria comprise the eligibility and judging criteria:

• Eligibility criteria sets out who can enter the competition.
• Judging criteria are the criteria against which entries are assessed.

The delivery team employs a multi-step assessment and judging approach to ensure that all entries receive fair consideration. This includes:

• An eligibility review to check that entries meet the eligibility criteria.
• Shortlisting by suitably qualified assessors who review entries against the judging criteria to select the best entries for more detailed consideration.
• Where appropriate, review by expert assessors to provide additional inputs for the judges’ consideration. This could be in the form of testing, validation, or a more detailed technical review.
• Review of shortlisted entries by a panel of independent judges, who recommend which entries should proceed by consensus decision following qualitative review and discussion of multiple inputs, for example innovators’ written submissions, supporting documentation and diagrams, pitches or interviews, expert assessor summaries.
• Due diligence checks to reduce the risks of misuse of funds and reputational damage.

The judges’ decision-making is a qualitative process taking into consideration multiple inputs to decide which entries best meet the selection criteria. This qualitative decision-making approach allows for considered review of how well each entry meets the judging criteria, many of which are themselves qualitative, although there may be some quantitative criteria also.

Assessment

All eligible entries are assessed by assessors matched to entries based on their area of expertise.

Entries are scored on a 1-5 scale (5 being the highest), and then weighted. More details on entry questions, assessment criteria and weighting are set out in the relevant Entrant Handbook.

Whilst scoring will form part of this process, in making its decision on whether to put forward an entry to judges, Ofwat will also consider the opinions of the assessors and will seek to ensure a diverse portfolio of entries in terms of entry themes, types, entrants and geographic location.

Depending on the funding stream, and if relevant, entries might:

• be passed for further review to another regulatory body, such as the Drinking Water Inspectorate (DWI) or the Environment Agency (EA).
• be passed on to sector reviewers, made up of representatives from regional water companies in England and Wales
• be invited to a live Q&A with assessors during assessment, for example during Stage 1 of the Transform stream of the Water Breakthrough Challenge.
• have to go through a two-stage process, with entries only proceeding to Judging after they have successfully passed Stage 1.

These different options will be clearly outlined in the relevant Entrant Handbook.

In any case, a moderation meeting will be held to ensure that all opinions from the assessors are captured and a consistent view on the merits of each entry is provided.

Judging 

An independent panel of judges will review the shortlisted entries put forward through the assessment. Their combined expertise, from a wide range of sectors and disciplines, will help to inform Ofwat’s decision on which entries should receive funding.  

The judging panel will review the entries individually, scoring the entries using the same criteria as the assessors. The judging panel will then convene to discuss entries. 

During the Judging Days entrants might also be asked to attend a live Q&A session with the judging panel and/or present their pitch. 

At the end of the process, Judges will recommend to Ofwat which entries they agree best meet the assessment criteria and offer a diverse portfolio for funding. 

Ofwat Decision

Ofwat will make the final decision on which entries should receive funding. In making its decision, Ofwat will consider the views of assessors and judges on which entries best meet the assessment criteria and offer a diverse portfolio for funding.

Ofwat publishes this decision and its reasons for awarding funding.

Past decision documents:

• Innovation in Water Challenge decision document
• Water Breakthrough Challenge 1 decision document
• Water Breakthrough Challenge 2 decision document
• Water Breakthrough Challenge 3 decision document
• Water Discovery Challenge 1 decision document
• Water Breakthrough Challenge 4 decision document
• Water Breakthrough Challenge 5 decision document

Past Judges

So far, we have recruited over 47 Judges across eleven expert Judging Panels to assess entries and make recommendations as to which should receive funding. Judges are an integral part of the selection process, and their expertise is invaluable in recommending to Ofwat which innovations are most likely to deliver a long-term impact for the sector.

You can find information on our past Judging Panels here:

• Innovation in Water Challenge
• Water Breakthrough Challenge 1
• Water Breakthrough Challenge 2
• Water Breakthrough Challenge 3
• Water Discovery Challenge 1
• Water Breakthrough Challenge 4
• Water Breakthrough Challenge 5
• Water Breakthrough Challenge 6
• Water Efficiency Lab 1

Judge Nominations

We aim to form diverse panels whose members will bring a wide range of perspectives, with a good balance of water sector and non-water sector voices. We are also committed to ensuring a diverse and inclusive panel.

If you think you, or someone you know, would make a good Judge, you can nominate them using the link below. In the form, you will see the type of skillsets we are looking for.

Please click here for more information about judge nominations