User-agent: * Disallow: / User-agent: googlebot Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*? Disallow: /*/ # In other words, Google should not look at GIFs, JPGs, dynamically created # pages, or anything that isn't upper-level, because Google allows # the use of wildcards. Everyone else is totally excluded, because they do # not support wildcards. Poor them.