There are several methods people have used for temporary relief from a toothache.  Clove oil is supposed to work, but I have not tried it.

I have had to deal with a tooth split all the way through the base. Most of the time there is no real pain.  At times, it becomes quite soar.  I found that if I used "regular" Listerine and swished it around that tooth for a few minutes it helped greatly.  Others did not seem to do anything but regular yellow Listerine works good for me.