#we will allow all bots every where except the cgi areas
User-agent: *
Disallow: /cgi/