Are you constantly bothered by Cuil dot com’s bandwidth leeching Twiceler robot web crawler? Did you deny Twiceler in your website’s robots.txt or htaccess yet continue to be pestered by it? That’s a bad robot!
You can easily stop Twiceler robot and send it back to whence it came with a few lines of PHP. How?
First, your web host must support PHP coding language. If you aren’t sure about that, ask your host.
Next, locate the file which outputs your webpage’s HTML.
Insert the following PHP code BEFORE any HTML or header output (including cookies):
<?php
if(eregi('twiceler', $_SERVER['HTTP_USER_AGENT']) || eregi('cuil.com', $_SERVER['HTTP_USER_AGENT']) || strpos($_SERVER['REMOTE_ADDR'], '67.218.116.')):
header("Location: http://www." . "cuil.com");
exit;
endif;
?>
Depending on how your file is coded and what coding language it is, you may not need the <?php ?>.
That code simply bounces the Twiceler robot back to it’s own website where it can sap all the bandwidth it wants!