New features
Recently released features and updates
For full transparency, we share the list of recently released features and updates.
Automatic Loudness Normalization
All audio inputs are automatically normalized to -21 LUFS before presentation to human evaluators, ensuring consistent and accurate evaluation results regardless of original audio levels.
Public Report Setup
You can now customize your report titles and descriptions at any time. When publishing reports publicly, you have full control over audio playability settings, model names, and tags.
Additionally, you can generate custom short URLs instead of using lengthy default URLs.
Data Collection (Beta)
Multi-language voice data collection from diverse global contributors to improve model performance. This service is currently available to selected early customers who are seeing significant improvements in model accuracy and speed.
Markdown Descriptions
Add comprehensive descriptions for your models and comparisons using markdown formatting, similar to README.md files on GitHub or Hugging Face. This enables rich documentation with formatted text, links, and structured content.
Report Download
Download complete analysis data in JSON format with three different organizational structures to suit your specific needs and workflows.
Voice Cloning Evaluation
Comprehensive voice similarity measurement for voice cloning applications. Our system supports three-way similarity analysis comparing a reference voice with two target outputs, enabling precise evaluation of voice cloning quality.
Model-related questions
In three-way similarity analysis, you can now ask specific questions related to each individual model. Through model-related questions, you can conduct separate evaluations for each model within the triple audio evaluation framework, providing the same level of detailed assessment as single audio evaluations.
This feature enables comprehensive analysis by allowing evaluators to focus on specific aspects of each model’s performance while maintaining the comparative context of the three-way evaluation structure.
Collaborate with team
Enable teamwork by sharing evaluations, feedback, and reports. Foster collaboration and ensure everyone stays aligned on goals and outcomes
Web-based evaluation
You don’t need an SDK to create an evaluation any more.
Evaluation template support
You create the template once, use it multiple times. Once you create your own template, you can re-use them in the following evaluations.
New Billing & Payment
We have a new look in the Billing & Payments. You can set up the recurring payments and get additional discounts.
High Scalability
You can evaluate up to 10k queries with 10k files in a single session.
Workspace is revamped
Now, the workspace has a new look and a more organized menu.
Fully customize your own evaluations
So far, you can use the provided evaluation templates. Now, you can add your own messages and followup questions up to 8. Instead of asking a single question, you can ask multiple questions on different types.
Add audio examples
Evaluator may wonder what is excellent and what is bad. You can add audio examples, so your evaluation will be more consistent.
New format support
We now support FLAC type too in addition to wav and mp3.
New evaluation report
We revamped the whole report presentation. With the new concept of model_tag, you can group the evaulations into models and multiple tags and analyze more details.
Reasoning behind the rating
One of the core questions behind the report is that “why did the evaluator think so?”.
So we added this new feature to ask the evaluators to annotate the words/phrases and put reasons behind the evaluation ratings.
6x faster upload in SDK
We previously made the file upload 2x faster. Again, we have made 6x faster upload, total 12x faster than last month.
It can be faster depending on your internet speed.
SDK documentation updated
We have revamped the whole SDK documents with more detailed descriptions and examples.
Many more stability and bug fixes
We have fixed multiple performance and stability issues. Also fixed many bugs for more accurate evaluations.
Custom question and detailed description
You can customize the question and the detailed description - So you can ask your own question to the evaluators instead of ours.
2x faster file upload
Our backend service has become faster and the SDK uploads your files to evaluate in multiple upload sessions.
Add the API key to the environment variable
See this document for details.
In addition, we have tons of ideas around evaluation management, reliability, modality, speed improvement, and so on. If you have cool ideas, please feel free to let us know at hello@podonos.com.