Skip to content

identify as a bot as per livejournal bot policy

LiveJournal wants bots to identify themselves using the User-Agent string, so this adds a config option to control that, and configures it for our site. This can hopefully get our crawler unblocked.

See https://www.livejournal.com/bots/ for details on the LiveJournal bot policy.

Merge request reports

Loading