Something missing? Suggest a change or addition

Mandatory Review

Problem

All entries need to be correct and adhere to policy.

Context

Some projects need to be able to make strong guarantees that all of the data being maintained has been through a quality review.

Solution

Introduce a mandatory review stage that requires contributors to inspect all entries before they are applied to the database.

Sometimes ensuring data quality is more important than the speed of data collection. Reviewing contributions before they are applied to the project database could be mandatory in situations where:

  • The data model is complicated and contributions have a high error rate
  • The type of data being collected is contentious or prone to interpretation
  • The project needs to be able to make strong guarantees to data users about the quality of the collected data, for example to ensure it is fit for purpose or to Minimise Harm

While introducing mandatory reviews can help to address quality issues in newly contributed or updated data, it may impact the quality of the project data in other ways. For example if reviews take time to process then the published data might become out of date. The additional friction in the contribution process might also limit how quickly the database will grow over time.

Mandatory reviews will require you to either involve the project team in reviewing or have a community of skilled contributors who are equipped to quickly process newly submitted data.

Mandatory review would normally be applied to the whole database for all users. But it could be applied in more limited ways, e.g. to only certain types of records or topics where quality is known to be an issue.



Related patterns

Moderation

There is a need to ensure that contributions are of good quality.

Clearly Defined Roles

In collaborative, community-driven projects there can be a lack of clarity around who is responsible for making decisions.

Something missing? Suggest a change or addition