By: WP Crawler Team
Thank you for purchasing my plugin. If you have any questions that are beyond the scope of this help file, please feel free to email via my user page contact form here. Thanks so much!
Log into your WordPress blog admin area:
Once logged in, click "Plugins" on the left hand menu (If you don't have a "Plugins" option you will have to ask a blog administrator to do this and the following steps!):
Once, on the "Plugins" page click the "Add New" button in the top middle of the page:
On the next page "Install Plugins", click the "Upload Plugin" button in the top middle of the page:
On the next page you will be asked to "Choose File" - Click this button and here you must select the .zip you have downloaded from CodeCanyon, once you have selected that .zip file Click "Install Now":
The next page will be entitled "Installing Plugin from uploaded file (e.g. wp-crawler.zip) on this page click "Activate Plugin":
Click "WP Crawler" on the left hand menu:
Once on the "All Sources" page click the "Add New" button in the top middle of the page:
Type source's title into the Title field (We will using this later when running crawl)
Now you need to analyze the webpage that you need to crawl. Then insert value in the fields below to convert into WordPress content:
Each field you must input 2 values: "Selector" and "Attribute":
innertexton this field.
To help you understand the analyzing process and adding new source, in this part I will use the example by trying analyze & add "Stackoverflow" source.
Firstly, I will analyze listing page: http://stackoverflow.com/questions. I need to select elements that include link to the posts:
I'm using Google Chrome Browser, and right-click on the link and choose "Inspect Element" to find out unique selector of this element
In the image below, I realize that selector
#questions .question-summary h3 a will be unique.
You can re-check this selector is unique or not by right-clicking on browser, choose "View Page Source" and search
id="questions". If the result appears once, so, that element is unique.
After analyzing, I come back to WordPress Dashboard, in "Add New Source" and insert this selector in Listing Page > Selector:
Next, I will analyzing in the same way with other parts in child page. And insert into Single Item’s fields like the image below (If you can’t find the field’s selector, you can let it be blank):
Now click Publish this source and it will be ready to crawl on next step!
Sources can be Import/Export like Posts or Pages. You can using WordPress Import/Export under Tools to Import/Export Sources. We already provide a
sample-sources.xml file (located on plugin folder) to help you understand how it works.
Click "Run" inside the "WP Crawler" menu:
If you choose Single, you must input single item URL to "URL" field below.
Below is another example I need to crawl multiple item from stackoverflow:
Then when it’s “Well Done”, that mean your work is finished, click "Posts" on the left hand menu to see the result:
I've used the following resources, libraries as listed.
Once again, thank you so much for purchasing this plugin. As I said at the beginning, I'd be glad to help you if you have any questions relating to this plugin. No guarantees, but I'll do my best to assist. If you have a more general question relating to the plugin on CodeCanyon, you might consider visiting the forums and asking your question in the "Item Discussion" section.