​
Create Evaluations from Templates

For developers, the SDK provides a powerful way to create evaluations programmatically using a template.

1

Copy the Template ID from the Web

Navigate the “Templates” Tab on the Workspace, select the one you want to use, and copy the Template ID.

2

Initialize the SDK

Initialize with your own API key. For details, refer to Get API Key

python
client = podonos.init("<API_KEY>")
3

Create an evaluation using the template

Use the Template ID to create a new evaluation.

python
evaluator = client.create_evaluator_from_template(
    name="Evaluate the english voice", 
    desc="model_1_and_model_2", 
    num_eval=10, 
    template_id="HTGRqU"  # You need this
)
4

4. Add Files to the Evaluation

Add files with relevant metadata to the evaluator.

Depending on whether your template’s evaluation type is a single or double, you should use proper function between add_file and add_files
5

Finalize the evaluation generation

Close the evaluator to finalize the setup.

python
evaluator.close()
Tip: Using the SDK is ideal for integrating evaluations into automated workflows.

Was this page helpful?

Suggest edits
Web Template UsageNaturalness