Scheduling Recurring Crawls
Save time and keep your data fresh by automating your website audits with our flexible scheduling engine.
How Scheduling Works
The Schedule Engine
When you schedule a crawl, ViSitemap creates a "parent" schedule. This schedule automatically triggers new "child" crawls at your specified intervals without any manual intervention.
Background Processing
All scheduled crawls run in the background. Even if you aren't logged in, our system will start the crawl, process the data, and update your dashboard automatically.
Configuring Your Schedule
You can set up a schedule for any existing crawl project. Navigate to your crawl details and click on the "Schedule" tab.
Frequency
Choose how often you want the crawl to repeat:
Start Time & Window
Specify the exact time of day you want the crawl to start. You can also set a "Schedule End Date" if you only want the recurring crawl to run for a limited period.
Notifications
By default, you will receive an email summary every time a scheduled crawl completes, highlighting any major changes or new pages discovered.
Managing Active Schedules
You can pause or resume your schedules at any time from the dashboard. Pausing a schedule prevents future runs but does not affect crawls that are currently in progress.
View My Schedules