Q: How to schedule a crawler/scraping task in Octoparse every hour?

 

 

A:

After you complete configuring your task, select the option “Schedule Cloud Extraction Settings” to begin the scheduling process.

 

 In the “Schedule Cloud Extraction Settings” dialog box, you can select

  • Periods of Availability - The data extraction period by setting the Start date and End date.
  • Run Mode - Running your periodic tasks to collect data with varying intervals: Once, Weekly, Monthly, Real Time

 

You can choose the fourth type - Real Time, and enter 60 in the textbox.

 

Please check out this tutorial to collect data with different intervals: 

Scheduled Data Extraction - Octoparse Cloud Web Scraping Service

 

 

Note:

 

When the periods of Availability you set does not within the task's effective period, you will get a pop-up saying, "Schedule Cloud Extraction Failed - Cloud extraction failed for task is out of effective date, please renew the effective date for task."

In this case, you can extend the task's effective period first.

In the "Schedule Cloud Extraction Settings" window, you can change the Start time and End time in the periods of Availability to extend the effective period of the task, then click Save to save the setting and the task's effective period will be changed.

btn_sidebar_use.png
btn_sidebar_form.png
当社ウェブサイトは、利便性、品質維持・向上を目的に、Cookieを使用しております。詳しくはプロキシーをご確認ください。Cookieの利用に同意頂ける場合は、「同意する」ボタンを押してください。同意頂けない場合は、ブラウザを閉じて閲覧を中止してください。
同意する 閉じる