User-Agent: * Allow: / Disallow: /api/ Disallow: /*/jobs/*/apply Host: http://localhost:3000 Sitemap: http://localhost:3000/sitemap.xml