User-agent: *
Disallow: *
Disallow: /bin/
Disallow: /config/
Disallow: /media/
Disallow: /umbraco/
Disallow: /umbraco_client/

User-agent: Twitterbot
Disallow: *
Allow: /media/