The server doesn't speak strings containing the & character correctly. I assume this is because it needs to be replaced by & in SSML. You should also replace < and > but they don't seem to cause as much of a problem as &, maybe Emacspeak is already replacing them.