User-agent: * Disallow: /cdn.platform Disallow: /api* Disallow: /onboarding/register Disallow: *?tokens* Disallow: /service* Disallow: /login.* Disallow: /register.*