Ringo

Pingomatic does hit most of those … when it’s working ….

Lol! is there anyone who doesn’t? Nickel maybe correct here, if you are using any mod_rewrite in your htaccess aside from what WP creates – you could be you’re own worst enemy! I do such rewrites to spam bots like “LinkWalker” and send them to .. well other sites and I have been known on occasion to er .. well rewrite some linkage in the process hehe.

I would also suggest reading up on some .htaccess – a very powerful tool for items just like you’ve mentioned. You can allow or disallow access by any number of methods and it’s far less “messy” then hacks, for that matter I’ve yet to see a vaild hack for WP (other then spamming) that is usefull in this area. I would simply suggest you have .htaccess either password protect a page or validate by IP. It’s very easy to do and only takes a minute or two to setup. I concure with “max”

SE’s really don’t read meta past a certain point. Thats not the type of “spam” that should worry you. You can’t SEO a blog like a normal site anyway.

I think there’s probably a lot more people that have it working then are posting “it’s not working” in this thread. I had no difficulty setting it up or using it. The ONLY thing that got in the way was my wp template layout ……
You should try it caipirina ….

Damn your fast ..!
So after reading the wiki, though it points to wp-posts – it’s still not likely that it’s wp-posts is it.

Thanks a bunch Matt….

paranoid fur sur dood…..
I have #1 rankings for several WP blogs .. and frankly .. I wont use another blog due to the WP secret sauce ….
You most likely changed your site density by “adding” WP to it.
If you posted in WP similar keywords or phrases that you would use in your site …. I would suspect that those pages that were lost were “over SEO’ed ” and that would be a good reason that Google or any SE would drop them.
SE’s view “archives” in a very interesting way…….
You can’t SEO a blog the same way you do a static site.

Love it…. Great job. I do have a question, probably because of my lack of understanding the functionality of the plugin. Bare with me. I have it working just fine however, Even though I don’t select it for all my posts it is showing for all my posts? Is there a way to “remove” it from posts where I do not want it to show?

Thanks

Again I apologize for the length of the posts however I wanted to give you all a pretty current example of all the good and bad spiders so you wouldn’t have to spend the time researching them.

For redirecting to other pages and sites, there are many ways to do this using htaccess. I’ll describe a few and let you read apaches manuals for the rest.

Starting with redirecting to new pages in a different directory. For this you will need to put the htaccess file in the same directory you want to be redirected. Make sure you do use this method in /.

RedirectMatch (.*)/oldfile.php
https://www.mysite.com/newdirectory/newfile.php

For multiple redirects, should appear on separate lines.

This changes the directory to where the “new” source files are located.

Maybe you’d like to redirect the entire directory?

RedirectMatch (.*)/
https://www.mysite.com/directory/index.php

Another way to do this and is cleaner:

RewriteEngine on
RewriteBase /~dir/
RewriteRule ^index\.php$ home.php

This adds a little backward compatibility and users wont even know the page has been changed.

or maybe the entire directory?

Redirect /sourcedir https://www.mysite.com/newdir

Your source directory should be the same path as it is right after your docroot.

Alot of times you’ll want to capture the query strings and they are NOT a part of the url. You’ll need to do something like this:

RewriteCond %{QUERY_STRING} ^cat=([0-9]+)
RewriteRule /index\.php$ https://www.yoursite.com/your page.html [R=301,L]

Of course this is sending the request to a 301 page but you can send it to wherever you like.
This will ‘copy’ the value of the cat= numeric parameter from the query string into the new URL. You will need to preface this code with Options all or Options +FollowSymLinks.

hmm ok enough …
Hope that helps

Firs let me apologize for the length of this post. Here is how I use .htaccess to redirect user agents to where I would like them to go. I allow all commonly known browsers to attend my precious blog and as for the Bad spiders and agents they get a suprise. I would not suggest you go to lemonparty.org under any circumstances – it’s a vulger site.

RewriteCond %{HTTP_USER_AGENT} ^Mozilla/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Lynx/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^MSIE/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Opera/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Icab/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Links/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Netscape/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Multizilla/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Avant\ /Browser/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Safari/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Konqueror/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Elinks/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^w3m/.*

RewriteRule ^.*$ https://www.mysite.com/

RewriteCond %{HTTP_USER_AGENT} ^BaiDuSpider/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Crescent/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^CherryPicker/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^CherryPickerSE/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^CherryPickerElite/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailCollector/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailWolf/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^ia_archive/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^ia_archiver/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mozilla.*NEWT [OR]
RewriteCond %{HTTP_USER_AGENT} ^[Ww]eb[Bb]andit/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebEMailExtrac.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^NICErsPRO/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Telesoft/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^MSFrontPage/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^TV33_Mercator/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^BlackWidow/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Bot\ mailto:[email protected] [OR]
RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^DISCo/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Download\ Demon/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^eCatch/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^EirGrabber/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Express\ WebPictures/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^FlashGet/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^GetRight/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^GrabNet/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Grafula/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^HMView/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^HTTrack/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Image\ Stripper/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Image\ Sucker/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^InterGET/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Internet\ Ninja/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^JetCar/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^JOC\ Web\ Spider/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^larbin/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^LeechFTP/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mass\ Downloader/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^MIDown\ tool/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mister\ PiX/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Navroad/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^NearSite/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetAnts/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetSpider/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Net\ Vampire/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetZIP/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Octopus/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Explorer/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Navigator/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^PageGrabber/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Papa\ Foto/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^pcBrowser/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^RealDownload/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^ReGet/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Siphon/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^SiteSnagger/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^SmartDownload/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^SuperBot/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Surfbot/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^tAkeOut/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^VoidEYE/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\ Image\ Collector [OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebAuto/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebCopier/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebFetch/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebReaper/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebSauger/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Website\ eXtractor/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebStripper/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebWhacker/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebZIP/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Wget [OR]
RewriteCond %{HTTP_USER_AGENT} ^Widow/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Xaldon\ WebSpider [OR]
RewriteCond %{HTTP_USER_AGENT} ^Zeus [OR]
RewriteCond %{HTTP_USER_AGENT} ^Microsoft\ URL [OR]
RewriteCond %{HTTP_USER_AGENT} ^LinkWalker/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^InternetSeeker.com [OR]
RewriteCond %{HTTP_USER_AGENT} ^S.T.A.L.K.E.R. [OR]
RewriteCond %{HTTP_USER_AGENT} ^Seeker.lookseek.com [OR]
RewriteCond %{HTTP_USER_AGENT} ^sitecheck.internetseer.com [OR]
RewriteCond %{HTTP_USER_AGENT} ^UdmSearch.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Ziggy\ –\ The\ Clown\ From\ Hell!!
RewriteCond %{HTTP_USER_AGENT} ^Down\ Deamon/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^Gulper\ Web\ Bot/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^OmniWeb/.* [OR]
RewriteCond %{HTTP_USER_AGENT} ^SearchExpress/.*

RewriteRule ^.*$ https://www.lemonparty.org/

<Limit GET HEAD POST>
order allow,deny
allow from all
</LIMIT>

I’ll have to start another post to explain how to redirect to other pages and accept query strings.

Here’s some other ways to be .htacess clever:
For example this will stop outside domains from linking to your site and display a jpg called nohotlink.jpg ….. what you put on that jpg is up to you ??

RewriteEngine On
RewriteCond %{HTTP_REFERER} !^https://(www\.)?yoursite\.com/ [NC
RewriteCond %{HTTP_REFERER} !^$
RewriteRule \.(jpe?g|gif|bmp|png)$ images/nohotlink.jpg [L]

More often then not I use this:
This only allows “hotlinking” if the referer is from a specific directory on your domain.

RewriteEngine On
RewriteCond %{HTTP_REFERER} !^https://(www\.)?yoursite\.com/dir/ [NC
RewriteCond %{HTTP_REFERER} !^$
RewriteRule \.(jpe?g|gif|bmp|png)$ images/nohotlink.jpg [L]

If your really only concerned with a particular doman that seems to be doing hotlinking you can use this approach:

RewriteEngine On
RewriteCond %{HTTP_REFERER} ^https://(www\.)?badsite\.net/ [NC,OR
RewriteCond %{HTTP_REFERER} ^https://(www\.)?badsite\.com/ [NC
RewriteRule \.(jpe?g|gif|bmp|png)$ images/nohotlink.jpg [L]

Of course you may not want to use the “one finger salute” jpg I use to notify leachers that they are not allowed, if that is the case you can just replace the very last line in all 3 examples with this and they will get a “403 Forbidden Access” page.

RewriteRule \.(jpe?g|gif|bmp|png)$ – [F]

Of course mod_rewrite has to be running on your server for this to work.

I don’t want to sound blantly obvious here or make a shameless plug. However, I’ve never had a problem with the more important parts of hosting at the link below and one of the best things I can say about them is WordPress is a part of their site install. You can just click on the install button at their hosting site and have WordPress up and running in seconds not minutes. All options of mod_rewrite are allowed there. Not bad for $6.00 a month.

https://www.wwm.net

On a side note. I’ve had similar problems with WP and .htaccess and I noticed that it was basically at one location (meaning: it was always the same hosting company) Double check with them HOW they have rewrite_mod installed and configured. At this particular hosting facility you actually had to turn on all the options just to use ONE of the features. So you might try putting this at the very top of your htaccess file: “options all”.

Hope that helps

It’s marked in your .htaccess file with the tag:
# Begin WordPress

and is concluded with the tag:
# End WordPress

This is where the WP “related rewrites and conditions” are located.

CSSED, Bluefish for PHP