File-based Evaluation
Start evaluations without a single line of code
You can create/manage evaluations on SDK. But, you can do so on the workspace. Here is how to create and manage your evaluations.
Log in to Workspace
Create a New Evaluation
Go to the Evaluations page and click + New evaluation.
Make your selection
Choose how you’d like to create your new evaluation.
Set up voting and assignment settings
Fill in the basic information of a new evaluation, such as the title and a detailed description.
Set up Instructions
Choose an instruction type (Do, Warning, or Don’t) and provide clear guidance to help participants complete the evaluation effectively.
You can also include detailed examples for clarity.
Set up Questions
Now, you can create questions for your evaluation. You can use pre-built templates or create your own questions. Click Add question to start customization.
Once added, you can further refine your custom questions:
Upload Files and Add tags
Upload the necessary audio files for your evaluation. Type model name. This name may be your AI model’s name or any unique name. Once the evaluation is done, you will see mulitple statistical analysis of the evaluation targets per model name and tags.
Assign tags to your files using the tagging interface. Tags help organize your files and enable detailed analysis by tag categories.
After tagging, your files will be ready for use in the evaluation.
If needed, you can add more files and tag them accordingly.
Review evaluation details
Review all the details of your evaluation on the summary page. Ensure that all the information is correct before confirmation.
If necessary, proceed to payment section to confirm your evaluation.
Request Complete and View Evaluation Results
Once you finish the final review, your evaluation request is confirmed.
You can view the details of your completed evaluation from the Workspace or through email.
Once your evaluation completes, a report will be automatically generated and you will be notified via email.