Keep track of a failing dynamic server and don't use it while failing.