I’ve found an article describing how to install the OpenType font used to generate the Ubuntu title.

Basically, it’s as easy as running:

$ sudo apt-get install ttf-ubuntu-title