Octoparse特徴比較

月額

3カ月額

Smart Mode

All you need to do is to paste in a URL and our program will do the rest for you.

Ad blocking

Using the Ad Blocking technique to extract data from Ad-heavy pages will optimize the loading time of the page and reduce the number of HTTP requests.

ウィザードモード

Wizard Mode is more suitable for beginners. You can grab data from simple web pages by just following the instructions step by step to configure your own task.

カスタマイズモード

Advanced Mode allows you to configure extraction task for extracting almost any complex web page.

テンプレートモード

Before you explore Octoparse, you can follow the prompts of training sessions to help you get started.

Concurrent tasks on local machine

You can choose Local Extraction option to run the extraction task on your computer.

Maximum number of tasks allowed

Maximum number of tasks you can set up to extraction data.

Editing existing task

You can edit the existing tasks, instead of creating a new one.

Copy task

You can copy an existing task.

Delete task

You can delete an extraction task and create a new one.

Export task

You can export the extraction task as an .otd file and share it out.

Import task

You can import the .otd file of extraction task into Octoparse.

View data

You can view your data after you back up your data or when you run the task in the cloud.

Create category

Create a category for you tasks and make it clear to see.

Export category

Export a category of your tasks and share them out.

Delete category

You can delete your tasks by category.

Maximum number of pages

Maximum number of pages Octoparse crawls for all of your tasks.

Extract Link

Extract Text

Extract image URL

Extract video

Extract data behind log in

Extract data from websites that require log in first.

Extract data from list/table pages

Extract data from list/table pages with more than one row of data like a search results page, category pages, etc.

Extract data from search result

Extract website with pagination

Extract website with any kind of pagination.

Extract website with infinite scrolling

Extract data from dropdown menus

Extract data loaded with AJAX

You don't need to know much about Ajax to extract data. All you need is just to figure out whether the site you want to scrape uses Ajax or not. Many websites use a lot of Ajax such as Google, Amazon and eBay. Usually the URL of the page will not have any change when updating part of the content. With Octoparse, you can easily extract data from web pages where data is loaded with Ajax.

Extract data loaded with JavaScript

Open a web page

Directly enter the URL in the address bar of the built-in browser and click "Go", then the "Open a webpage" action will be automatically created.

Or you can drag an "Open a webpage" action, drop it into Workflow Designer, enter the URL in the "Page URL" textbox and click "Save" to open the target website/webpage.

Click an item/Click to paginate

Click any web element on the web page in the built-in browser.

Extract data

Drag an "Extract Data" action and drop it into Workflow Designer to extract data on the webpage. (Note: When you extract data on the webpage, "Extract Data" action will be created.)

Switch dropdown

Loop Item

Drag a "Loop Item" action and drop it into Workflow Designer to execute a set of actions repeatedly. (e.g. If you drop a "Click Item" into "Loop Item" action, it will keep executing the "Click Item" action.) (Note: When you "create a list of item" to loop open webpages, "Loop Item" action will be automatically created.)

Enter Text

Drag an "Enter Text" action and drop it into Workflow Designer to enter text in the textbox on the webpage. (Note: When you input words in the textbox (Search bar/Login textbox) on the webpage by choosing the textbox and selecting "Enter text value”, "Enter Text" action will be created automatically.)

Switch Combo box

Branch judgment (If-else)

Drag an "Branch judgment" action and drop it into Workflow Designer to execute different actions based on different conditions. (Note: it will execute the action if a condition is true and execute another action if that condition is false.)

Cursor Over

Drag a "Cursor Over" action and drop it into Workflow Designer to hover the cursor over a specific element.

End Loop

Drag an "End Loop" action and drop it into Workflow Designer to stop the "Loop Item" running.

End Workflow

Drag an "End Workflow" action and drop it into Workflow Designer to stop the rule running.

Create a list of items

Extract inner HTML

Extract inner HTML, including the source code, text with format, image URL.

Extract outer HTML

Time out settings

Set up the maximum time to load the page.

Scroll down settings

Scroll down to the bottom of the page when finished loading. You can choose the scroll-down interval time and to scroll to the end of the page/ scroll down one screen. (Usually used for websites with infinite scrolling.)

Cache settings

Choose this option to clear cache before opening the web page.

Customize cookie

Choose this option to use specified cookie.

Retry

You can retry to load the website.

AJAX setting

Choose this option when the website/webpage is loaded with AJAX and set up AJAX timeout.

Page acceleration

Choose this option to optimize non-AJAX page.

Define data fields

You can rename the field and select options from the drop down list if the item is not found on the web page.

XPath setting

XPath tool

Regular Expression tool

Built-in browser

Store data to Cloud Platform

Store data to database (My SQL, SQL Server, Oracle)

API access

You can create your own API that will return data formatted as XML strings.

Download as CVS

Download as HTML

Download as TXT

Cloud Servers

Our cloud service will speed up data extraction speed - 4/10 times extraction speed than Local Extraction. Once you use Cloud Extraction, 4/10 cloud servers will be assigned to your extraction tasks.

API access

You can create your own API that will return data formatted as XML strings.

Cloud Extraction

Run the tasks you set up in the cloud servers we provide.

IP proxy

Octoparse enables you to scrape these websites by rotating anonymous HTTP proxy servers.

IP rotation

Scraping the web on a large scale simultaneously, based on distributed computing. After you upload your configuration project to the cloud, you can choose to perform the extraction concurrently by using cloud servers.

Schedule extraction

Schedule to extract data as frequently as you like.

Concurrent tasks on local machine

You can choose Local Extraction option to run the extraction task on your computer.

Incremental Extraction

After you've set up an extraction rule for a website, you may need the updated data again from that website beside the data extracted before. This brand new feature Incremental Extraction allows you to extract the updated data without having to configure another rule to do this.

Split the task in Cloud Extraction

Our cloud service will speed up data extraction speed - 4/10 times extraction speed than Local Extraction. Once you use Cloud Extraction, 4/10 cloud servers will be assigned to your extraction tasks.

Split the task in Cloud Extraction

Disable images loading

You can choose not to load images to speed up the extraction process.

Incremental Extraction

After you've set up an extraction rule for a website, you may need the updated data again from that website beside the data extracted before. This brand new feature Incremental Extraction allows you to extract the updated data without having to configure another rule to do this.

Display error messages during the extraction process

Support

Customer Support is prioritized for Standard and Professional Plan

Email

Skype

Forum

FB messenger

Tutorials

Documentation

FAQ