Restrict labelers to a single annotation

Using Labelbox Annotate
1

I am setting up a video classification benchmark and would like to do a human trial beforehand. I set up everything in Labelbox and invited labelers, however, I realized that there is no way to restrict a labeler to classify only a single video. This is quite important for me because the labelers could get biased after reviewing multiple videos of the benchmark. Is there any workaround to limit each labeler to a single annotation?

2

Hey @serwanj ,

For your use case I would suggest to set a project per video (batch of 1 video) and allocate 1 user.

Batch ref doc : Batches
Project member allocation : Add members to a project

Many thanks,
PT

1 Like