HomeInsightsCentre for Data Ethics and Innovation publishes review into bias in algorithmic decision-making

Contact

+44 (0)20 7612 9612
info@wiggin.co.uk

The Government commissioned CDEI to review the risks of bias in algorithmic decision-making. The CDEI has now published its final report and includes a set of formal recommendations to the Government.

The CDEI focused on the use of algorithms in significant decisions about individuals. The review looks at the use of algorithmic decision-making in four sectors (policing, local government, financial services and recruitment) and makes recommendations that aim to help build the right systems so that algorithms improve, rather than worsen, decision-making. These sectors were selected because they all involve significant decisions about individuals, and because there is evidence of both the growing uptake of algorithms and historic bias in decision-making in these sectors.

The measures that the CDEI has proposed are designed to produce a step change in the behaviour of all organisations making life-changing decisions on the basis of data, with a focus on improving accountability and transparency. Key recommendations include:

  • Government should place a mandatory transparency obligation on all public sector organisations using algorithms that have an impact on significant decisions affecting individuals;
  • organisations should be actively using data to identify and mitigate bias; they should make sure that they understand the capabilities and limitations of algorithmic tools, and carefully consider how they will ensure fair treatment of individuals; and
  • Government should issue guidance that clarifies the application of the Equality Act to algorithmic decision-making. This should include guidance on the collection of data to measure bias, as well as the lawfulness of bias mitigation techniques (some of which risk introducing positive discrimination, which is illegal under the Equality Act).

The CDEI says that it will now help industry, regulators and government in taking forward the practical delivery work to address the issues it has identified and future challenges which may arise. To access the report, click here.

Expertise