You can create/manage evaluations on SDK. But, you can do so on the workspace. Here is how to create and manage your evaluations.

1

Log in to Workspace

2

Create a New Evaluation

Go to the Evaluations page and click + New Evaluation.

3

Enter Basic Information

Fill in the basic information of a new evaluation, such as the title and a detailed description.

4

Select Language

Choose the language for your evaluation.

5

Choose Evaluation Type

Select the evaluation type.

6

Add Instructions

Choose an instruction type (Do, Warning, or Don’t) and provide clear guidance to help participants complete the evaluation effectively. You can also include detailed examples for clarity.

7

Customize Queries

Now, you can create queries for your evaluation. You can use pre-built templates or create your own queries. Click Add Query to start customization. Once added, you can further refine your custom queries:

8

Upload Files and Add tagss

Upload the necessary audio files for your evaluation. Type model name. This name may be your AI model’s name or any unique name. Once the evaluation is done, you will see mulitple statistical analysis of the evaluation targets per model name and tags. Assign tags to your files using the tagging interface. Tags help organize your files and enable detailed analysis by tag categories. After tagging, your files will be ready for use in the evaluation. If needed, you can add more files and tag them accordingly.

9

Review

Review all the details of your evaluation on the summary page. Ensure that all the information is correct before confirmation. If necessary, proceed to payment section to confirm your evaluation.

10

Request Complete and View Evaluation Results

Once you finish the final review, your evaluation request is confirmed. You can view the details of your completed evaluation from the Workspace or through email.

Once your evaluation completes, a report will be automatically generated and you will be notified via email.