User-agent: Googlebot
Disallow:

User-agent: AdsBot-Google
Disallow:

User-agent: Googlebot-Image
Disallow:

User-agent: * 
Disallow: /cgi-bin 
Disallow: /assets 
Disallow: /alpha 
Disallow: /beta 
Disallow: /.well-known 

Sitemap: http://www.mechtest.com.au/sitemap.xml