You don't need to know how to code. The application allows building crawlers using configurable steps that the crawler will perform.
Often page content is created by running javascript in the browser. crwl.io can load pages via a headless browser to get the contents after running javascript.
You can schedule your crawlers to automatically run as often as you need the data.
You can download the crawled data in machine-readable formats like JSON, XML or CSV, or access them via an API.
You can use a webhook to get notified when new crawling data is available.
The crwl.io application is based on the crwlr.software library. So you can see how it works and also contribute and help improving it.
The crwl.io app will be publicly available in a few months.
You can sign up to be notified when we launch.