when writing cache, remove elements from the user agents list. also return a message and content type when blocking a crawler.

This commit is contained in:
Neil Lalonde
2018-03-27 13:44:14 -04:00
parent a84bb81ab5
commit 4d12ff2e8a
3 changed files with 5 additions and 5 deletions

View File

@ -167,7 +167,7 @@ class Middleware::RequestTracker
if block_crawler(request)
log_request = false
result = [403, {}, []]
result = [403, { 'Content-Type' => 'text/plain' }, ['Crawler is not allowed']]
return result
end