Skip to main content Opens Flood Gates But Only for Google, Yahoo! &

After denying search engines from indexing the millions of bookmarks stored on its servers for so long, has finally lifted the entry barrier but selectively.

 According to the robots.txt of, only spiders from Yahoo!, Google and Ask search engines are allowed to crawl and index the content of - all other bots are banned including msnbot of the Microsoft Live search engine.

come we are open
User-agent: *
Disallow: /
User-agent: Slurp [Yahoo]
Allow: /
User-agent: Googlebot
Allow: /
User-agent: Teoma []
Allow: / has also removed the meta robots (noarchive,nofollow,noindex) restriction from all their webpages that earlier prevented search engines from indexing or caching delicious web pages.

As a result, Google has 6 million pages from in their index now while this number was around a million sometime back when the ban was in place.

What does this mean for sites / URLs that are popular on - you could see a surge in search engine traffic but getting listed on won't add any link authority or google juice since all links on delicious are marked with nofollow, very similar to Wikipedia.