Full Website Indexing with subpages (via Sitemap or Full Site Crawl)

I would like to have an automatic website indexing feature which scans the complete website including all subpages. For sites with numerous pages, manually entering every subpage is simply not a practical solution for building a complete knowledge base. I