Using the Text-to-Speech API with Python

The Text-to-Speech API enables developers to generate human-like speech. The API converts text into audio formats such as WAV, MP3, or Ogg Opus. It also supports Speech Synthesis Markup Language (SSML) inputs to specify pauses, numbers, date and time formatting, and other pronunciation instructions.

In this tutorial, you will focus on using the Text-to-Speech API with Python.

What you'll learn

• How to use Cloud Shell
• How to enable the Text-to-Speech API
• How to authenticate API requests
• How to install the client library for Python
• How to list supported languages
• How to list available voices
• How to synthesize audio from text

What you'll need

• A Google Cloud Project
• A Browser, such as Chrome or Firefox
• Familiarity using Python 3

Survey

How will you use this tutorial?

Read it through only Read it and complete the exercises

How would you rate your experience with Python?

Novice Intermediate Proficient

How would you rate your experience with using Google Cloud services?

Novice Intermediate Proficient

Self-paced environment setup

1. Sign in to Cloud Console and create a new project or reuse an existing one. (If you don't already have a Gmail or G Suite account, you must create one.)

Note: You can easily access Cloud Console by memorizing its URL, which is console.cloud.google.com.

Remember the project ID, a unique name across all Google Cloud projects (the name above has already been taken and will not work for you, sorry!). It will be referred to later in this codelab as PROJECT_ID.

Note: If you're using a Gmail account, you can leave the default location set to No organization. If you're using a G Suite account, then choose a location that makes sense for your organization.

2. Next, you'll need to enable billing in Cloud Console in order to use Google Cloud resources.

Running through this codelab shouldn't cost much, if anything at all. Be sure to to follow any instructions in the "Cleaning up" section which advises you how to shut down resources so you don't incur billing beyond this tutorial. New users of Google Cloud are eligible for the $300USD Free Trial program.

Start Cloud Shell

While Google Cloud can be operated remotely from your laptop, in this tutorial you will be using Cloud Shell, a command line environment running in the Cloud.

Activate Cloud Shell

1. From the Cloud Console, click Activate Cloud Shell .

If you've never started Cloud Shell before, you'll be presented with an intermediate screen (below the fold) describing what it is. If that's the case, click Continue (and you won't ever see it again). Here's what that one-time screen looks like:

It should only take a few moments to provision and connect to Cloud Shell.

This virtual machine is loaded with all the development tools you'll need. It offers a persistent 5GB home directory and runs in Google Cloud, greatly enhancing network performance and authentication. Much, if not all, of your work in this codelab can be done with simply a browser or your Chromebook.

Once connected to Cloud Shell, you should see that you are already authenticated and that the project is already set to your project ID.

2. Run the following command in Cloud Shell to confirm that you are authenticated:

gcloud auth list

Command output

 Credentialed Accounts
ACTIVE  ACCOUNT
*       <my_account>@<my_domain.com>

To set the active account, run:
    $ gcloud config set account `ACCOUNT`

Note: The gcloud command-line tool is the powerful and unified command-line tool in Google Cloud. It comes preinstalled in Cloud Shell. You will notice its support for tab completion. For more information, see gcloud command-line tool overview.

gcloud config list project

Command output

[core]
project = <PROJECT_ID>

If it is not, you can set it with this command:

gcloud config set project <PROJECT_ID>

Command output

Updated property [core/project].

Before you can begin using the Text-to-Speech API, you must enable the API. Using Cloud Shell, you can enable the API with the following command:

gcloud services enable texttospeech.googleapis.com

Note: In case of error, go back to the previous step and check your setup.

In order to make requests to the Text-to-Speech API, you need to use a Service Account. A Service Account belongs to your project and it is used by the Python client library to make Text-to-Speech API requests. Like any other user account, a service account is represented by an email address. In this section, you will use the Cloud SDK to create a service account and then create credentials you will need to authenticate as the service account.

First, set a PROJECT_ID environment variable:

export PROJECT_ID=$(gcloud config get-value core/project)

Next, create a new service account to access the Text-to-Speech API by using:

gcloud iam service-accounts create my-tts-sa \
  --display-name "my tts service account"

Next, create credentials that your Python code will use to login as your new service account. Create and save these credentials as a ~/key.json JSON file by using the following command:

gcloud iam service-accounts keys create ~/key.json \
  --iam-account my-tts-sa@${PROJECT_ID}.iam.gserviceaccount.com

Finally, set the GOOGLE_APPLICATION_CREDENTIALS environment variable, which is used by the Speech-to-Text client library, covered in the next step, to find your credentials. The environment variable should be set to the full path of the credentials JSON file you created:

export GOOGLE_APPLICATION_CREDENTIALS=~/key.json

Note: You can read more about authenticating to a Google Cloud API.

Install the client library:

pip3 install --user --upgrade google-cloud-texttospeech

You should see something like this:

...
Installing collected packages: google-cloud-texttospeech
Successfully installed google-cloud-texttospeech-2.2.0

Now, you're ready to use the Text-to-Speech API!

Note: If you're setting up your own Python development environment, you can follow these guidelines.

In this tutorial, you'll use an interactive Python interpreter called IPython. Start a session by running ipython in Cloud Shell. This command runs the Python interpreter in an interactive session.

ipython

You should see something like this:

Python 3.7.3 (default, Jul 25 2020, 13:03:44)
Type 'copyright', 'credits' or 'license' for more information
IPython 7.18.1 -- An enhanced Interactive Python. Type '?' for help.

In [1]:

Note: If needed, you can quit your IPython session with the exit command.

In this section, you will get the list of all supported languages.

Copy the following code into your IPython session:

from google.cloud import texttospeech


def list_languages():
    client = texttospeech.TextToSpeechClient()
    voices = client.list_voices().voices
    languages = unique_languages_from_voices(voices)

    print(f" Languages: {len(languages)} ".center(60, "-"))
    for i, language in enumerate(sorted(languages)):
        print(f"{language:>10}", end="" if i % 5 < 4 else "\n")


def unique_languages_from_voices(voices):
    language_set = set()
    for voice in voices:
        for language_code in voice.language_codes:
            language_set.add(language_code)
    return language_set

Take a moment to study the code and see how it uses the list_voices client library method to build the list of supported languages.

Call the function:

list_languages()

You should get this (or a larger) list:

---------------------- Languages: 41 -----------------------
     ar-XA     bn-IN    cmn-CN    cmn-TW     cs-CZ
     da-DK     de-DE     el-GR     en-AU     en-GB
     en-IN     en-US     es-ES     fi-FI    fil-PH
     fr-CA     fr-FR     gu-IN     hi-IN     hu-HU
     id-ID     it-IT     ja-JP     kn-IN     ko-KR
     ml-IN     nb-NO     nl-NL     pl-PL     pt-BR
     pt-PT     ru-RU     sk-SK     sv-SE     ta-IN
     te-IN     th-TH     tr-TR     uk-UA     vi-VN
    yue-HK

The list shows 41 languages and variants such as:

• Chinese and Taiwanese Mandarin,
• Australian, British, Indian, and American English,
• French from Canada and France,
• Portuguese from Brazil and Portugal.

This list is not fixed and will grow as new voices are available.

Note: If you get a PermissionDenied error (403), verify the steps followed during the Authenticate API requests step.

• Check that the credentials environment variable is defined: echo $GOOGLE_APPLICATION_CREDENTIALS
• You should see the full path to your credentials file: /home/$USER/key.json
• Then, check that the credentials were created: cat $GOOGLE_APPLICATION_CREDENTIALS
• You should see something similar to: {"type": "service_account","project_id": "PROJECT_ID",...}

If anything is incorrect, revisit the Authenticate API requests step.

Summary

In this step, you were able to list supported languages.

In this section, you will get the list of voices available in different languages.

Copy the following code into your IPython session:

from google.cloud import texttospeech


def list_voices(language_code=None):
    client = texttospeech.TextToSpeechClient()
    response = client.list_voices(language_code=language_code)
    voices = sorted(response.voices, key=lambda voice: voice.name)

    print(f" Voices: {len(voices)} ".center(60, "-"))
    for voice in voices:
        languages = ", ".join(voice.language_codes)
        name = voice.name
        gender = texttospeech.SsmlVoiceGender(voice.ssml_gender).name
        rate = voice.natural_sample_rate_hertz
        print(f"{languages:<8} | {name:<24} | {gender:<8} | {rate:,} Hz")

Take a moment to study the code and see how it uses the client library method list_voices(language_code) to list voices available for a given language.

Now, get the list of available German voices:

list_voices("de")

You should see something like this:

------------------------ Voices: 10 ------------------------
de-DE    | de-DE-Standard-A         | FEMALE   | 24,000 Hz
de-DE    | de-DE-Standard-B         | MALE     | 24,000 Hz
de-DE    | de-DE-Standard-E         | MALE     | 24,000 Hz
de-DE    | de-DE-Standard-F         | FEMALE   | 24,000 Hz
de-DE    | de-DE-Wavenet-A          | FEMALE   | 24,000 Hz
de-DE    | de-DE-Wavenet-B          | MALE     | 24,000 Hz
de-DE    | de-DE-Wavenet-C          | FEMALE   | 24,000 Hz
de-DE    | de-DE-Wavenet-D          | MALE     | 24,000 Hz
de-DE    | de-DE-Wavenet-E          | MALE     | 24,000 Hz
de-DE    | de-DE-Wavenet-F          | FEMALE   | 24,000 Hz

Multiple female and male voices are available, as well as standard and WaveNet voices:

• Standard voices are generated by signal processing algorithms.
• WaveNet voices are higher quality voices synthesized by machine learning models and sounding more natural.

Now, get the list of available English voices:

list_voices("en")

You should get something like this:

------------------------ Voices: 44 ------------------------
en-AU    | en-AU-Standard-A         | FEMALE   | 24,000 Hz
...
en-AU    | en-AU-Wavenet-D          | MALE     | 24,000 Hz
en-GB    | en-GB-Standard-A         | FEMALE   | 24,000 Hz
...
en-GB    | en-GB-Wavenet-F          | FEMALE   | 24,000 Hz
en-IN    | en-IN-Standard-A         | FEMALE   | 24,000 Hz
...
en-IN    | en-IN-Wavenet-D          | FEMALE   | 24,000 Hz
en-US    | en-US-Standard-B         | MALE     | 24,000 Hz
...
en-US    | en-US-Wavenet-J          | MALE     | 24,000 Hz

In addition to a selection of multiple voices in different genders and qualities, multiple accents are available: Australian, British, Indian, and American English.

Take a moment to list the voices available for your preferred languages (or even all of them):

list_voices("fr")
list_voices("pt")
...
list_voices()

Summary

In this step, you were able to list available voices. You can also find the complete list of voices available on the Supported Voices page.

You can use the Text-to-Speech API to convert a string into audio data. You can configure the output of speech synthesis in a variety of ways, including selecting a unique voice or modulating the output in pitch, volumn, speaking rate, and sample rate.

Copy the following code into your IPython session:

from google.cloud import texttospeech


def text_to_wav(voice_name, text):
    language_code = "-".join(voice_name.split("-")[:2])
    text_input = texttospeech.SynthesisInput(text=text)
    voice_params = texttospeech.VoiceSelectionParams(
        language_code=language_code, name=voice_name
    )
    audio_config = texttospeech.AudioConfig(
        audio_encoding=texttospeech.AudioEncoding.LINEAR16
    )

    client = texttospeech.TextToSpeechClient()
    response = client.synthesize_speech(
        input=text_input, voice=voice_params, audio_config=audio_config
    )

    filename = f"{language_code}.wav"
    with open(filename, "wb") as out:
        out.write(response.audio_content)
        print(f'Audio content written to "{filename}"')

Take a moment to study the code and see how it uses the synthesize_speech client library method to generate the audio data and save it as a wav file.

Now, generate sentences in a few different accents:

text_to_wav("en-AU-Wavenet-A", "What is the temperature in Sydney?")
text_to_wav("en-GB-Wavenet-B", "What is the temperature in London?")
text_to_wav("en-IN-Wavenet-C", "What is the temperature in Delhi?")
text_to_wav("en-US-Wavenet-F", "What is the temperature in New York?")

You should see something like this:

Audio content written to "en-AU.wav"
Audio content written to "en-GB.wav"
Audio content written to "en-IN.wav"
Audio content written to "en-US.wav"

To download all generated files at once, you can use this Cloud Shell command from your Python environment:

import os

os.system("cloudshell download en-*.wav")

Validate and your browser will download the files:

Open the files and listen to the results.

Summary

In this step, you were able to use Text-to-Speech API to convert sentences into audio wav files. Read more about creating voice audio files.

You learned how to use the Text-to-Speech API using Python to generate human-like speech!

Clean up

To avoid incurring charges to your Google Cloud account for the resources used in this tutorial:

• In the Cloud Console, go to the Manage resources page.
• In the project list, select your project then click Delete.
• In the dialog, type the project ID and then click Shut down to delete the project.

Learn more

• Test the demo in your browser: https://cloud.google.com/ml-onramp/text-to-speech
• Text-to-Speech documentation: https://cloud.google.com/text-to-speech/docs
• Python on Google Cloud: https://cloud.google.com/python
• Cloud Client Libraries for Python: https://googlecloudplatform.github.io/google-cloud-python

License

This work is licensed under a Creative Commons Attribution 2.0 Generic License.