What is Wait Before Execution in Octoparse?
"Wait Before Execution" is a function that allows users to set up a waiting before Octoparse executes some action.
All the actions in Octoparse except "Go To The Web Page" have that option in Advanced Options.
When do I need to set up Wait Before Execution?
1. When Octoparse extracts data or executes the next action when a page opens slowly or does not load completely
In some cases, a page opens slowly but Octoparse executes extracting data as usual. In the result, it extracts no data and finishes the extraction or extracts duplicates before the next page comes out. Setting up waiting time before for an action helps the extraction process go well in such situation.
2. When Octoparse extracts data before the data shows on the page
3. When the website blocks IP that visits it too frequently
Setting up waiting time would slow down the extraction process so as to lower the risk of IP being blocked by a website, which is sensative to frequent visits.
Note: Please remember to click "Save" after any of setting.