XHanch Studio Log in | Register | Cart

Forum

Notifications
Clear all

How does the scrapper/crawler work?

1 Posts
1 Users
0 Likes
5,387 Views
XHanch
(@xhanch-alt)
Posts: 2105
Member Admin
Topic starter
 

Scrapper/crawler helps you to automate your manga website as it will keep fetching mangas and chapters from source sites.

On the admin page, there will be a Scrapper Catalog menu. You will get a list of available mangas on a selected source site. After that, you just need to select which mangas you want to scrap or you may simply select all to scrap all those mangas. At this step, WP Manga will only get all manga information and store it to your database, no chapters yet so far. Finally, let the crawler(which will be a CRON job) do its task to retrieve all manga chapters and keep your website automatically updated when new chapters are available from the source.

You can determine whether you want to store scrapped mangas on your server or not. If not, the script will only stores image URLs so the manga reader will load the images directly from its source site.

 
Posted : 07/03/2011 1:46 pm
Share:

× Close Menu