<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Call Twiceler to crawl your site.</title>
	<atom:link href="http://www.thechetan.com/2008/07/call-twiceler-to-crawl-your-site/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.thechetan.com/2008/07/call-twiceler-to-crawl-your-site/</link>
	<description>Version alpha or beta ... still calculating.</description>
	<lastBuildDate>Wed, 10 Mar 2010 07:25:56 +0530</lastBuildDate>
	<generator>http://wordpress.org/?v=2.9.2</generator>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: angie</title>
		<link>http://www.thechetan.com/2008/07/call-twiceler-to-crawl-your-site/comment-page-1/#comment-16500</link>
		<dc:creator>angie</dc:creator>
		<pubDate>Tue, 16 Feb 2010 04:33:58 +0000</pubDate>
		<guid isPermaLink="false">http://www.thechetan.com/?p=242#comment-16500</guid>
		<description>My site, loners-club.com was crawled by them around 2 minutes ago. It was first time i saw it, it&#039;s pretty funny :D</description>
		<content:encoded><![CDATA[<p>My site, loners-club.com was crawled by them around 2 minutes ago. It was first time i saw it, it&#8217;s pretty funny <img src='http://www.thechetan.com/wp-includes/images/smilies/icon_biggrin.gif' alt=':D' class='wp-smiley' /> </p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Shane</title>
		<link>http://www.thechetan.com/2008/07/call-twiceler-to-crawl-your-site/comment-page-1/#comment-16010</link>
		<dc:creator>Shane</dc:creator>
		<pubDate>Tue, 17 Nov 2009 01:02:20 +0000</pubDate>
		<guid isPermaLink="false">http://www.thechetan.com/?p=242#comment-16010</guid>
		<description>Well I am not exactly fond of it.  I think it was a major contributing factor to getting my hosting account temporarily suspended.  

Quote “I don’t know what spawned it, but when Cuil attempts to index a site, it does so by completely hammering it with traffic,” the tipster wrote. “So much, that it completely brings the site down. We’re 24 hours into this “index” of the site, and I’ve had to restrict traffic to the site down to 2 packets per second, while discarding the rest, or otherwise it makes the site unusable.”

The Admin Zone forums are abuzz over Cuil’s overzealous method for indexing. Countless posters on the site have said that their websites have been brought down because of the Twiceler robot and one user said it “leeched enormous amounts of bandwidth — nearly 2GB this month until it was blocked. It visited nearly 70,000 times!”

Website owners are also saying that the way Cuil indexes sites isn’t scientific in any way and is actually quite “amateurish.” According to those who experienced the Twiceler onslaught, the bot seems to “randomly hit a site and continue to guess and generate pseudo-random URLs in an attempt to find pages that aren’t accessible by links. And by doing this, they completely bring a site down to where it’s not functional.”
Quoted from http://www.techcrunch.com/2008/09/01/is-cuil-killing-websites/</description>
		<content:encoded><![CDATA[<p>Well I am not exactly fond of it.  I think it was a major contributing factor to getting my hosting account temporarily suspended.  </p>
<p>Quote “I don’t know what spawned it, but when Cuil attempts to index a site, it does so by completely hammering it with traffic,” the tipster wrote. “So much, that it completely brings the site down. We’re 24 hours into this “index” of the site, and I’ve had to restrict traffic to the site down to 2 packets per second, while discarding the rest, or otherwise it makes the site unusable.”</p>
<p>The Admin Zone forums are abuzz over Cuil’s overzealous method for indexing. Countless posters on the site have said that their websites have been brought down because of the Twiceler robot and one user said it “leeched enormous amounts of bandwidth — nearly 2GB this month until it was blocked. It visited nearly 70,000 times!”</p>
<p>Website owners are also saying that the way Cuil indexes sites isn’t scientific in any way and is actually quite “amateurish.” According to those who experienced the Twiceler onslaught, the bot seems to “randomly hit a site and continue to guess and generate pseudo-random URLs in an attempt to find pages that aren’t accessible by links. And by doing this, they completely bring a site down to where it’s not functional.”<br />
Quoted from <a href="http://www.techcrunch.com/2008/09/01/is-cuil-killing-websites/" rel="nofollow">http://www.techcrunch.com/2008/09/01/is-cuil-killing-websites/</a></p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Anish K.S</title>
		<link>http://www.thechetan.com/2008/07/call-twiceler-to-crawl-your-site/comment-page-1/#comment-9446</link>
		<dc:creator>Anish K.S</dc:creator>
		<pubDate>Tue, 02 Jun 2009 04:41:15 +0000</pubDate>
		<guid isPermaLink="false">http://www.thechetan.com/?p=242#comment-9446</guid>
		<description>Nice, i am lucky to indexed in cuil :)</description>
		<content:encoded><![CDATA[<p>Nice, i am lucky to indexed in cuil <img src='http://www.thechetan.com/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' /> </p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Microsoft's new search engine : Bing !! &#124; TheChetan.com</title>
		<link>http://www.thechetan.com/2008/07/call-twiceler-to-crawl-your-site/comment-page-1/#comment-9439</link>
		<dc:creator>Microsoft's new search engine : Bing !! &#124; TheChetan.com</dc:creator>
		<pubDate>Tue, 02 Jun 2009 03:32:16 +0000</pubDate>
		<guid isPermaLink="false">http://www.thechetan.com/?p=242#comment-9439</guid>
		<description>[...] few months ago one search engine called cuil was launched by former Google employees but after getting huge popularity it was a fail. Cuil even fail to crawl TheChetan.com even after 5 [...]</description>
		<content:encoded><![CDATA[<div style="background-color: #f3f3f3; padding: 1em 1em 1em 2em; ">
<p>[...] few months ago one search engine called cuil was launched by former Google employees but after getting huge popularity it was a fail. Cuil even fail to crawl TheChetan.com even after 5 [...]</p>
</div>
]]></content:encoded>
	</item>
	<item>
		<title>By: Fred</title>
		<link>http://www.thechetan.com/2008/07/call-twiceler-to-crawl-your-site/comment-page-1/#comment-8618</link>
		<dc:creator>Fred</dc:creator>
		<pubDate>Thu, 14 May 2009 09:42:58 +0000</pubDate>
		<guid isPermaLink="false">http://www.thechetan.com/?p=242#comment-8618</guid>
		<description>cuil is crawnling with IP adress 216.129.119.41

My website is not indexed anywhere because it is in construction and it is already crawled ! I imagine they have ways to learn which sites to crawl for instance if you install weblogexpert, maybe this program sends your domain adress to them.</description>
		<content:encoded><![CDATA[<p>cuil is crawnling with IP adress 216.129.119.41</p>
<p>My website is not indexed anywhere because it is in construction and it is already crawled ! I imagine they have ways to learn which sites to crawl for instance if you install weblogexpert, maybe this program sends your domain adress to them.</p>
]]></content:encoded>
	</item>
</channel>
</rss>
