There are two preview options located on the web toolbar.

Preview page exports and previews only the current page. So it's useful if you have a large site which takes some time to export as a whole. You can just quickly preview the page you are working on, without exporting the rest of the site.

Preview website exports all the pages of your site and then brings up the preview window. So all the pages and links in your site should be working.