FIX: Do not raise if title cannot be crawled (#16247)

If the crawled page returned an error, `FinalDestination#safe_get`
yielded `nil` for `uri` and `chunk` arguments. Another problem is that
`get` did not handle the case when `safe_get` failed and did not return
the `location` and `set_cookie` headers.
This commit is contained in:
Dan Ungureanu
2022-03-22 20:13:27 +02:00
committed by GitHub
parent 3f98af73ce
commit 8e9cbe9db4
3 changed files with 10 additions and 0 deletions

View File

@ -62,6 +62,8 @@ module RetrieveTitle
fd.get do |_response, chunk, uri|
unless Net::HTTPRedirection === _response
throw :done if uri.blank?
if current
current << chunk
else