Allow workers, their representatives and public interest groups to test how the algorithms work

To allow workers to more deeply understand the impact on those affected by algorithms, companies should make a version of their algorithm available for testing. 

A laptop displaying code

This could be done by providing API access to a sandboxed version of the system, making open source the key algorithms used on the platform or provide access to anonymised/synthetic data accurately reflecting the behaviour of the system. Companies should also consider sharing their source code and training datasets directly to further improve transparency and accountability.

While public access would be a gold standard, a more limited approach may be appropriate, in which only worker representative bodies or recognised academic or civil society organisations can access the testbeds, potentially via collective agreements or licensed access. The ability for workers to test how the algorithms work cannot be confined to a single instance and instead there should be an ability to repeatedly trial the system.  

Adequate documentation should be provided to make use of these resources. Different algorithms may require different processes: no specific auditing regime should be mandated as the focus should be on providing a pragmatic, flexible and effective way of allowing engagement with how the algorithms work in practice.

Case Scenario 1

A company offers a taxi drivers and passenger matching service. To allow drivers and their representative to understand how the matching algorithm functions, they provide a sandboxed version of the algorithm over an API. The sandboxed version allows authenticated users to simulate client requests and the location of drivers, and evaluate how these demands propagate to drivers, including how this information is presented to each driver individually.

The API allow users to import data for easy testing of complex scenarios and allows export of data to analyse how the algorithm reacts to different conditions. The company provide a feedback mechanism for API users to report bugs or issues.

To enable better auditing of the algorithm, the company provides access to the three latest version of the system so that users can compare results.

Individuals and organisations must apply to be authorised to access the API and must sign a contract before doing so.