How to enable Crawler?

Hi, longnha

You need to add this:

<IfModule LiteSpeed>
CacheEngine on crawler
</IfModule>

to your Apache config file. The location of that file varies depending on what control panel you use (or whether you use one at all). It’s not allowed in .htaccess. We’re working on documentation right now, but if you tell me what your control panel is, I can let you know where to add that bit of code.

Alternately, you can use the WebAdmin interface:
Navigate to LSWS Admin > Virtual Host > General > Apache Style Configurations, click Edit, and make sure it reads CacheEngine on crawler.

I apologize for any inconvenience!

Lisa @ LiteSpeed

• This reply was modified 7 years, 8 months ago by LiteSpeed Lisa.

There have nothing in “Virtual Host” tab so in Server > Server , I edited Apache Style Configurations and add: CacheEngine on crawler.

Unfortunately still not working.

I’m using WebHostManager, CENTOS 7.3.

Thanks.

Hello Lisa,

In my case, I’m using CPanel. Could you tell me how to set it?

Kind regards,

@longnha I’m not sure how to help with your WebAdmin issue, but one of us will get back to you on that as soon as we can!

@ricmkt,

At the server level?
You’ll need to edit your Apache config file, which is pre_main_global.conf and you can find that in

/usr/local/apache/conf/includes/ for EA3 or
/etc/apache2/conf.d/includes/ for EA4.

If you’re trying to do this on a virtual host level (either global, or an individual vhost), the answer is different, so let me know if that is the case.

Lisa

Hello Lisa.
Yes, it’s a virtual host.

Hi, @ricmkt

Change your working directory to:
/usr/local/apache/conf/userdata/std/2_2/<user>/<domain>/ for EA3 or /etc/apache2/conf.d/userdata/a/std/2_2/<user>/<domain>/ for EA4

If these directories do not exist, create them.

Add the code to the lscache_vhosts.conf file. This will enable the crawler for this Virtual Host only.

Apply these changes by running the following command:

/scripts/ensure_vhost_includes --user=$user

I hope this helps!
Lisa

Hi @longnha,

You need to add them as @lclarke mentioned directly in .conf file. The webadmin way doesn’t work so far.

I apologize, @longnha, for steering you wrong with the WebAdmin. I was unaware that we didn’t have the functionality at the moment.

If you need to know the location of your Apache config files, just let me know whether you use cPanel, Plesk, DirectAdmin, or none and whether you want to enable the crawler at the server level or at the virtual host level, and I can get that info for you.

Or, just wait for our wiki instructions to be ready. That will definitely be sometime today.

Thanks!
Lisa

I have access to cPanel, how can I enable the crawler at the server level?

Thanks.

You need to have the access to WHM panel or direct server SSH.

Yes, I previously mentioned that I have access to Web Host Manager (WHM).

Hi, @longnha

The wiki is ready. Here is a direct link to the cPanel instructions.

Thank you for your patience!
Lisa

I followed the instruction, added Crawler Snippet and gracefully restart the server, unfortunately still the same.

In the WP dashbard it still display: “The crawler feature is not enabled on the LiteSpeed server. ”

Thanks.

Can you create a new ticket in our system? so that you can safely give us ssh access to get a further check.

Usually, If you setup server correctly, when you use a php test file to run <?php echo $_SERVER['X-LSCACHE'];, you can see crawler included.

I can confirm I am having the same issue. Followed the instructions to the letter. EA-4. None of the directories were created so I had to make them all. Still showing as disabled.

I ended up doing the following directory path: /etc/apache2/conf.d/userdata/a/std/2_2/testuser/test.demosite.net

No dice… Rebooted httpd and still nothing.

What do you suggest?