[Bish0pQ]

Nice work ..I have a suggestions :

you could add a sms API or email API ..that send you a message when ever the script find something.

Good luck

Thank you! When I have some time maybe I'll implement it, I was also thinking of creating some kind of HTML based webpanel to have a nice overview.

[Black Viking]

You can make a crawler to generate a sitemap. After than, you can search "*pdf" files on sitemap

[Bish0pQ]

You can make a crawler to generate a sitemap. After than, you can search "*pdf" files on sitemap

A crawler based on the sites source code won't get very far, since almost no alternative links are available in the source code (just external links to css/js files). Might be available on some sites though, I'll look into it, thank you!