A website may advertise its feed clearly, hide it in page markup, expose it at a common path, or provide several feeds for different sections. RSS Crawler checks multiple discovery routes and keeps the candidates in one reviewable workspace.
1. Prepare the website input
Paste website addresses or feed URLs separated by lines, commas, or spaces. Remove unrelated text and duplicate domains before starting a large scan.
2. Choose the scan depth
Use a quick scan for obvious endpoints, a standard scan for normal discovery, or a deeper scan when a site has a more complex structure. Deeper scans take longer and may produce more candidates to review.
3. Review the discovered feeds
Inspect feed title, format, latest activity, discovery method, and any problem state. Ignore feeds that are stale, irrelevant, duplicated, or tied to the wrong section of the site.
4. Verify content in the Reader
Preview recent items to confirm that a technically valid feed contains the content you expected. Save useful groups as packs when you expect to return to the same source set.
5. Export the clean list
Export included feeds as OPML, CSV, JSON, or copied URLs depending on the destination. Ignored feeds should stay out of the Reader and export set.
Common mistakes
- Running a deep crawl before trying a faster scan.
- Keeping every technically valid endpoint.
- Failing to preview recent items.
- Exporting duplicate section and site-wide feeds without deciding which one is needed.
Discover, inspect, organize, and export RSS and Atom feeds from websites on Windows.