Amazon Augmented AI enables quality control via metadata for customers using a private workforce
Amazon Augmented AI (Amazon A2I) is an AWS service that makes it easy to build the workflows required for human review of ML predictions (such as predictions from Amazon Rekognition, Amazon Textract, Amazon Translate or Amazon Comprehend). Amazon A2I provides you the option to work with human reviewers or “workers” inside your own organization through a private workforce, Amazon Mechanical Turk workforce of over 500,000 independent contractors, or vendor-managed workforces pre-screened by AWS for quality and security procedures. Starting today, for your private workforce, Amazon A2I provides additional metadata for each worker that reviews your data, enabling you to uniquely identify them and implement quality control for your workforce.
Source:: Amazon AWS