Don't flag valid third-party links as broken (#575)

Adds User-Agent header to requests and treats 401/403/429 auth wall responses as valid links rather than dead links.