1. Introduction
This guidance provides a summary of a generic systems-driven risk assessment approach. As with all fields, risks assessment is evolving, but some recent perspectives can be found in the NCSC guidance1.
2. Signposting
This is the second detailed generic guide in the stack of resources for security-informed safety assurance. Figure 1 below shows its location in the set of guides (highlighted in red).

Figure 1: Location of this guide in the set of resources
3. Guidance
3.1 Overview
The cyber-security risk assessment methodology2 set out in this document is a synthesis of the approaches used in conventional (non-malign) hazard analysis used in industry3 (where the systems are generally composed of multiple elements) and those used in information assurance4 (where consideration is given to malign actions instigated by threat sources). The methodology used in the standard information assurance approach has a defined series of steps which are set out Table 1 below.
| Step 1 – Establish system context and scope of assessment | Step 8 – Report |
| Step 2 – Configure risk assessment | |
| Step 3 – Analyse policy interactions | |
| Step 4 – Preliminary risk analysis | |
| Step 5 – Identify specific attack scenarios | |
| Step 6 – Focused risk analysis | |
| Step 7 – Finalise risk assessment |
Table 1: Steps of the cyber-security risk assessment process
However, there are some significant differences between this approach and the one contained in this document, as summarised below.
- The approach to threat assessment (Step 2) is different. Without access to intelligence data, it is not possible to assess the actual threat, but it is still useful to identify potential threat scenarios in order to ensure that the risk assessment is focused on the kinds of threats that are of concern.
- Similarly, when it comes to prioritising risk (Step 6), it is not possible judge the likelihood of an attack from a particular threat source without access to intelligence data, but the capabilities and level of access to the system that a threat agent would need in order to launch a successful attack can be assessed. Thus, the attack scenarios can be ranked according to required capabilities and potential impact rather than likelihood and impact. • In Step 4 an architecture-based approach is used (similar to a conventional hazard analysis5 or failure modes and effects analysis6) where cyber attacks on individual subsystems and the impact of loss of integrity and availability of the subsystem on the overall service are considered.
- In Step 6, the resilience of the system to such service failures has to be taken into account when assessing the consequential impact.
The steps are summarised in Table 2.
| Step | Brief description |
|---|---|
| Step 1 – Establish system context and scope of assessment | Describe the system to be assessed and its relationship with other systems and the environment. Identify the services provided by the system and the system assets. Agree the scope of and motivation for the assessment and identify the stakeholders and their communication needs. Identify the type of decisions being supported by the assessment. |
| Step 2 – Configure risk assessment | Identify any existing analyses, e.g. safety cases, or business continuity assessments that provide details of the system, the impact of failure and the mitigations that are in place. Define the threat sources and identify potential threat scenarios. Refine generic capability and impact levels for the systems being assessed. Identify risk criteria. Characterise the maturity of the systems or project, the key uncertainties, and overall. |
| Step 3 – Refine and focus system models | Refine and focus system models in the light of the threat scenarios to ensure that they are at the right level of detail for an effective risk analysis. |
| Step 4 – Preliminary risk analysis | Undertake architecture-based risk analysis, identifying potential hazards and consequences and relevant vulnerabilities and causes, together with any intrinsic mitigations and controls. Consider doubts and uncertainties, data and evidence needs. Identify intrinsic and engineered defence in depth and resilience. |
| Step 5 – Identify specific attack scenarios | Refine preliminary risk analysis to identify specific attack scenarios. Focus on large consequence events and differences with respect to the existing system. |
| Step 6 – Focused risk analysis | Prioritise attack scenarios according to the capabilities required and the potential consequences of the attack. As with the previous step, the focus is on large consequence events and differences with respect to the existing system. |
| Step 7 – Finalise risk assessment | Finalise risk assessment by reviewing implications and options arising from focused risk analysis. Review defence in depth and undertake sensitivity and uncertainty analysis. Consider whether the design threat assumptions are appropriate. Identify additional mitigations and controls. |
| Step 8 – Report results | Report the results of the risk assessment to stakeholders at the appropriate level of detail. |
Table 2: Cyber security assessment process summary
These steps are described in more detail in Section 3.5.
3.2 Impact Assessment
The impact of a successful attack on the transport system is assessed using the criticality scale shown in Table 3.
| Criticality Scale | Loss of service | Loss of life |
|---|---|---|
| Cat 5 (Catastrophic) |
Loss of or major disruption to transport system nationally (£10s of billions in economic impact) | Massive loss of life and/or casualties (1,000+ fatalities, 10,000s of casualties) |
| Cat 4 (Severe) | Loss of or major disruption to transport system regionally long-term (i.e. over a week) or nationally short-term (£billions in economic impact) | Severe loss of life and/or casualties (101-1,000 fatalities, 1,000s of casualties) |
| Cat 3 (Substantial) |
Loss of or major disruption to transport system regionally short-term or sub-regionally long-term (£100s millions in economic impact) | Substantial loss of life and/or casualties (51-100 fatalities, 100s of casualties) |
| Cat 2 (Significant) |
Loss of or major disruption to transport system sub-regionally short-term or localised long-term (£10s millions in economic impact) | Significant loss of life and/or casualties (10-50 fatalities, 10s of casualties) |
| Cat 1 (Moderate) | Short-term localised loss of transport system (£ millions in economic impact) | Moderate loss of life and/or casualties (<10 fatalities, <10 casualties) |
Table 3: Impact levels for service failures
3.3 Capability of Threat Sources
The risk assessment should attempt to estimate the capabilities that an attacker would need in order to achieve a high impact failure. Without access to intelligence data, it is not possible to assess the actual threat, but it is still useful to identify potential threat scenarios in order to ensure that the risk assessment is focused on the kinds of threats that are of concern.
Critical National Infrastructure (CNI) could be subject to attack from a number of different sources. These threat sources can be categorised as follows:
- nation states, where the attacks might be part of a cyber war;
- terrorists, as an alternative to or in combination with conventional terror attacks;
- activists, who want to create disruption (but probably not death) to create publicity for their cause;
- hackers, who may simply be curious to know what they can compromise or control, or value exposing system vulnerabilities in order to seek system improvements and recognition for this expertise;
- criminals, who wish to gain financially (e.g. via blackmail threats to avoid attacks, or halting vehicles for robbery);
- disaffected employees, who may want to cause chaos but probably not death;
- malware authors, whose software could infect critical systems.
Threat sources who might only be interested in stealing information have been excluded as the focus of this guidance is on the integrity and safety of system and loss of confidentiality is only a major concern for some very specific attacks (e.g. in a transport system, attacks on high value passengers or hazardous and high-value cargoes).
The range of capability levels of potential threat sources has been adapted from HMG Information Assurance Standards 1 and 2 (see Table 4).
| Capability Level | Description in IS1-2 | Modification for CNI systems |
|---|---|---|
| E |
Where the threat source is extremely capable and well-resourced, i.e. can:
Typically a well-resourced foreign intelligence service. |
Use tools specific to the domain including customisation of these for the attacks and to develop novel equipment and tools specific to the attack. Use publicly available and proprietary information on how system works and mitigations. Develop large testbeds and trials for the attack. Coordinate timing of several attacks. Influence expert insiders. |
| D |
When the threat source is capable and has significant resources, i.e. can:
Typically a moderately well-resourced foreign intelligence service or a well-organised terrorist or criminal group. |
Use tools specific to the domain including customisation of these for the attacks. Have access to equipment for trials and Use publicly available and proprietary information on how system works and mitigations. Influence knowledgeable insiders. Have expertise in security engineering. |
| C |
Where the threat source has modest capabilities and resources, i.e. can:
Typically smaller organised terrorist or criminal group, or competent individual hacker. |
Use tools specific to the domain but Use publicly available information on how system works and mitigations. Understanding of security engineering. Influence insiders (but at routine skill level). |
| B |
Where the threat source has very modest capabilities and resources, i.e. can:
Typically an average Internet user. |
An engineer with possible access to equipment but no specific training or authority in how to use, i.e. plug maintenance console into equipment. Some physical access to system. A typical enterprise IT user. |
| A |
Where the threat source has almost no capabilities or resources, i.e. can:
Typically a computer or Internet novice. |
Accidental participants, i.e. from compromised machines/devices. Could be co-opted into scaling denial of service-type attacks. |
Table 4: Capability levels of potential threat sources
Evaluation of the likely attack frequencies and capabilities of specific threat sources are outside the assessment scope and should be undertaken by the intelligence services.
3.4 Policy Interactions
A range of issues that concern the interaction of safety requirements and security policies that need to be addressed are set out in Table 5 below. Some of these can be resolved at an early stage in a project but others will set policies and constraints that shape the development of the case at the architecture and implementation levels.
| Policy issue | Activities |
|---|---|
| Scope of system, safety case and safety-related functionality. |
Assess whether system boundary is drawn sufficiently wide e.g. to include sources of attack, connected systems. Assess whether we need additional confidentiality claims, e.g. ‘System does not leak information that leads to unacceptable increase in risk of successful attack’ or ‘System protects confidentiality of assets that have direct information value’. Assess the role of the system/service in enabling other systems to be secure – good cyber citizenship. Consider an explicit claim about resilience to emphasise the need for adaptation and recovery in an uncertain world. This will require interactions with the other system owners and their policy setters. |
| Risk, responsibility and regulation. |
Add explicit threat models and scenarios to environment description. Define capability levels of attackers and design basis threats. Introduce policy on design basis threats, not just in operational environment but in development infrastructure, organisation and supply chain. Make risk and safety statement conditional on these assumptions, discuss with regulators and overall duty holders. Agree how to demonstrate that the risks are as low as reasonably practicable (ALARP) with respect to security-initiated events. This may be problematic. Recognise that a duty-holder cannot outsource risk to a cyber department or through SLAs (although specialist advice will be needed). The holder still has a responsibility to understand safety hazards and mitigations. Augment competency scheme. Augment handling of information policy. Map claims and evidence to the organisations responsible for them. |
| Dealing with events and incidents. |
Extend the safety case argument to include security-related events. Include a claim about handling these events in both preventative and reactive manner (e.g. incident response). Review with respect to different time bands. Ensure the approach and environmental assumptions are documented in the system design basis document. Review impact of architecture, design and deployment. Asset management and identification of vulnerable components/systems. |
| Obsolescence, lifetime and refurbishment. |
Obsolescence, lifetime and refurbishment policy in light of weakening security controls with age. Assess impact of obsolescence on architecture. |
| Defence in depth |
Address independence and diversity for the system configuration and related activities. Training policy needs to address security. Any constraints on L1 (design) and L2 (organisation) need to be identified. |
Table 5: Policy issues to be addressed
A range of design and implementation policies may to some extent be defined at a requirements stage (see Table 6) but will require detailing and implementing at later stages of the project.
| Design and implementation policies |
|---|
|
Policy on which sets of ‘critical controls’ should be considered or mandated. Policy on application of Kerckhoff’s principles and 20 controls. [8] Policy on applicable standards and guidance. Policy on interpreting defence in depth in architecture. Policy on robustness design and testing. Policy on supply chain assurance and impact on design and architecture. Policy on identifying security vulnerabilities in code. May impact use of third-party software and supply chain relationships and need for access to source code. Policy on built-in security. Policy that cryptographic aspects need to be assessed by national experts, e.g. NCSC. Information assurance policy that addresses trustworthy safety case evidence and any trade-offs between openness and confidentiality. |
Table 6: Design and implementation policies
3.5 Steps in more detail
3.5.1 Step 1 – Establish system context and scope of assessment
| Step 1 | Establish system context and scope of the assessment |
|---|---|
| Objectives | Describe the system to be assessed and its relationship with other systems and the environment. Identify the services provided by the system and system assets. Agree the scope of and motivation for the assessment and identify the stakeholders and their communication needs. Identify any existing analyses, e.g. safety cases. |
| Input |
Requires input from stakeholders, for example:
|
| Output |
|
| Approach |
Establish system and context:
Scope of assessment:
|
3.5.2 Step 2 – Configure risk assessment
Identify any existing analyses, e.g. safety cases, business continuity assessments that provide details of the system, the impact of failure and the mitigations that are in place. Characterise the maturity of the systems or project and the key uncertainties.
Define the threat sources and identify potential threat scenarios. Refine generic capability and impact levels for the systems being assessed. Identify risk criteria.
Refine and focus system models in the light of the threat scenarios and existing analyses to ensure that they are at the right level of detail for an effective security-informed risk analysis.
3.5.2.1 Identify any existing analyses
| Step 2.1 | Identify existing analyses |
|---|---|
| Objectives | Define the threat sources and identify potential threat scenarios. |
| Input | Existing analyses, e.g. safety cases, business continuity assessments that provide details of the system, the impact of failure and the mitigations that are in place. |
| Output | Summary of available information and bibliography. |
| Approach |
|
3.5.2.2 Identify potential threats
| Step 2.2 | Identify potential threats |
|---|---|
| Objectives | Ensure that the risk assessment is focused on the kinds of threats that are of concern. Define possible threat sources and identify potential threat scenarios. Refine generic capability and impact levels for the systems being assessed. Identify risk criteria. |
| Input |
Briefing from Government agencies to focus assessment. Use of:
|
| Output |
Statement on focus of risk assessment in terms of threat sources and capabilities. Depending on criticality of system and the threat level, this may include a list of threat scenarios, consisting of threat sources, target / objective and threat level |
| Approach |
|
3.5.2.3 Refine and focus system models
| Step 2.3 | Refne and focus system models |
|---|---|
| Objectives | Refine and focus system models in the light of the threat scenarios to ensure that they are at the right level of detail for an effective risk analysis. |
| Input |
|
| Output | Refined set of system models. Specific briefing note for architecture analysis advised in ‘Security-informed Hazop’. |
| Approach |
|
3.5.3 Step 3 – Analyse policy interactions
| Step 3 | Analyse policy interactions |
|---|---|
| Objectives | Undertake an analysis of policy issues considering interactions between safety requirements and security policies. Resolve any conflicts, show that the trade-offs are satisfactory and document the decisions made. |
| Input |
|
| Output | Report on analysis and trade-offs that are considered. Escalate to stakeholders as necessary. |
| Approach |
Address the policy issues as described in the Table 5 and consider:
|
3.5.4 Preliminary risk analysis
| Step 4 | Preliminary risk analysis |
|---|---|
| Objectives | Undertake architecture-based risk analysis, identifying consequences and relevant vulnerabilities and causes together with any intrinsic mitigations and controls. Consider doubts and uncertainties, data and evidence needs. Identify intrinsic and engineered defence in depth and resilience. |
| Input | System model |
| Output |
Preliminary risk analysis, identifying:
|
| Approach |
|
3.5.5 Step 5 – Identify specific attack
| Step 5 | Identify specifc attack scenarios |
|---|---|
| Objectives | Refine preliminary risk analysis to identify specific attack scenarios. Focus on large consequence events and differences with respect to existing system. |
| Input |
|
| Output |
List of attack scenarios, consisting of:
|
| Approach |
|
3.5.6 Step 6 – Focused risk analysis scenarios
| Step 6 | Focused risk analysis |
|---|---|
| Objectives | Prioritise attack scenarios according to the capabilities required and the potential consequences of the attack. As with Step 5, the focus is on large consequence events and differences with respect to existing system. |
| Input | Attack scenarios. |
| Output |
|
| Approach |
|
3.5.7 Step 7 – Finalise risk assessment
| Step 7 | Finalise risk assessment |
|---|---|
| Objectives | Finalise risk assessment by reviewing implications and options arising from focused risk analysis. Review defence in depth and undertake sensitivity and uncertainty analysis. Consider whether the design threat assumptions are appropriate. Identify additional mitigations and controls. |
| Input | Prioritised list of risks |
| Output | Final risk assessment. |
| Approach |
|
3.5.8 Step 8 – Report results
| Step 8 | Report results |
|---|---|
| Objectives | Report the results of the risk assessment to stakeholders at the appropriate level of detail for each stakeholder. |
| Input |
|
| Output | A series of reports, presentations, executive summaries. |
| Approach |
|
4. Acknowledgements
This guidance is based on material developed in earlier projects partially funded by the UK Control and Instrumentation Nuclear Industry Forum (CINIF) and guidance from previous NPSA projects and published research by Adelard.
Footnotes
1 NCSC. Introducing component-driven and system-driven risk assessments, Version 1.0, December 2017
2 Adelard. Cyber Security Risk Assessment Methodology Comparison, Adelard, 2014
3 HSE. Five steps to risk assessment, http://www.hse.gov.uk/risk/fivesteps.htm
4 CESG. Information Assurance Standard No 1 and 2 Supplement, Technical Risk Assessment and Risk Treatment, Issue 1.0, April 2012, https://en.wikipedia.org/wiki/HMG_Infosec_Standard_No.1
5 IEC61882:2002 Hazard and operability studies (HAZOP studies) - Application Guide, 2002
6 ESA. Failure Modes, Effects and Criticality Analysis (FMECA). D. European Space Agency. ECSS–Q–30–02A, 1991
7 CESG. HMG Information Assurance Standard No 1 and 2 Supplement, Technical Risk Assessment and Risk Treatment, Issue 1.0, April 2012, https://en.wikipedia.org/wiki/HMG_Infosec_Standard_No.1
8 Centre for Internet Security. Critical Security Controls for Effective Cyber Defense,. v7.1, 2019