{"id":9966,"date":"2018-08-28T06:00:18","date_gmt":"2018-08-28T10:00:18","guid":{"rendered":"https:\/\/blog.litespeedtech.com\/?p=9966"},"modified":"2018-08-28T06:00:18","modified_gmt":"2018-08-28T10:00:18","slug":"cache-crawler-for-prestashop-and-magento-2","status":"publish","type":"post","link":"https:\/\/lswp.store\/index.php\/2018\/08\/28\/cache-crawler-for-prestashop-and-magento-2\/","title":{"rendered":"Crawling Your PrestaShop or Magento 2 Store"},"content":{"rendered":"

\"Cache<\/a><\/p>\n

We recently released two new crawler scripts: one for Magento 2 stores using LiteMage<\/a>, and another for PrestaShop stores using LSCache<\/a>.<\/p>\n

The LSCache\/LiteMage crawler, travels its way through your sitemap file, refreshing pages that have expired in the cache. The purpose is to keep the cache as fresh as possible while minimizing visitor exposure to uncached content.<\/p>\n

Why Crawl Your Store?<\/h2>\n

Well, first let\u2019s look at how cache plugins store pages without a crawler. A user request kicks off the whole process. The cache is empty until users start sending requests. The first time a visitor requests a page, the request hits the backend. PHP code is invoked to generate the page, the page is served to the user, and then the page is stored in cache for next time.<\/p>\n

That\u2019s a fairly time-consuming process for the server.<\/p>\n

Now, let\u2019s look at what happens when a crawler builds the cache. When the crawler requests a page, the request hits the backend. PHP code is invoked to generate the page, but because of the special header that lets LSWS know that this is a crawler that initiated the request, the full page doesn\u2019t need to be served. It is simply stored in cache.<\/p>\n

Additionally, with the crawler refreshing expired pages at regular intervals, the chances that a user will encounter an uncached page is significantly diminished. This makes for a faster site.<\/p>\n

So, now that you\u2019re sold on the idea, let\u2019s look at how it\u2019s done.<\/p>\n

Please Note<\/strong>: The concepts behind the PrestaShop cache crawler script and the Magento 2 cache crawler script are the same, and so the instructions are very similar. Where they differ, we\u2019ll put PrestaShop on the left, and Magento 2 on the right.<\/p>\n

Before You Begin<\/h2>\n

There are a few things you need to do before you can begin to use the new script.<\/p>\n