​
Set up your development

You need Python 3.8 or newer. You can check your Python version: 
python --version

​
Install the SDK

pip install podonos

​
Get your API key

You can get your API key from the Workspace. You can see more details in Get API Key

​
Generate an evaluation with simple code

python
import podonos
from podonos import *

client = podonos.init(api_key="<YOUR_API_KEY>")
etor = client.create_evaluator(
    name='Naturalness of my new speech synthesis', type='NMOS', lan='en-us')
# Add a file.
etor.add_file(file=File(path="<YOUR_AUDIO_FILE_PATH>",
                        model_tag="my_model", tags=["syn1, epoch2"]))
etor.close()
That’s it! This code will enable you to evaluate the naturalness of US English in your audio files in 5 point MOS (Mean Opinion Score). Once you finished running the code, you will see a draft evaluation in your Workspace.
evaluation_draft
In each evaluation page, you can see the type, scale, language, and many more. Once you confirm everything is correct, you can kick off the evaluation by clicking Pay and request evaluation button at the bottom. Also, do not forget registering your payment method.
8-summary.png
Once the payment is complete, your evaluation request is confirmed. You can view the details of your evaluations from the Workspace or through email.
9-request-complete.png

9-1-result-review.png
After the evaluation finishes, you will have an access to the evaluation report. Of course, you can configure more details of the evaluation setup. In Naturalness, we will go through the details under the hood.

​
Troubleshooting

At any stage if you have any questions or suggestions, take a look at troubleshooting.