User-agent: * Disallow: /404/ Disallow: /assets/ Disallow: /Scripts/ Disallow: /recipe1.html Disallow: /recipe2.html Disallow: /recipe3.html Disallow: /recipe4.html Disallow: /recipe5.html Disallow: /recipe6.html