Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not a correct displaying for Robots.txt #13214

Closed
Sharkozp opened this issue Jan 16, 2018 · 5 comments
Closed

Not a correct displaying for Robots.txt #13214

Sharkozp opened this issue Jan 16, 2018 · 5 comments
Labels
Fixed in 2.2.x The issue has been fixed in 2.2 release line Issue: Clear Description Gate 2 Passed. Manual verification of the issue description passed Issue: Confirmed Gate 3 Passed. Manual verification of the issue completed. Issue is confirmed Issue: Format is valid Gate 1 Passed. Automatic verification of issue format passed Issue: Ready for Work Gate 4. Acknowledged. Issue is added to backlog and ready for development Reproduced on 2.1.x The issue has been reproduced on latest 2.1 release Reproduced on 2.2.x The issue has been reproduced on latest 2.2 release Reproduced on 2.3.x The issue has been reproduced on latest 2.3 release

Comments

@Sharkozp
Copy link

Preconditions

  1. Magento 2.2.1

Steps to reproduce

  1. Add new Robots to Content -> Configuration (Design) -> Edit (Global) -> Search Engine Robots
  2. Add this lines:
User-agent: *
Disallow: /index.php/
Disallow: /*?
Disallow: /checkout/
Disallow: /app/
Disallow: /lib/
Disallow: /*.php$
Disallow: /pkginfo/
Disallow: /report/
Disallow: /var/
Disallow: /catalog/
Disallow: /customer/
Disallow: /sendfriend/
Disallow: /review/
Disallow: /*SID=
  1. Or reset to default
  2. Check http://{magento_url}/robots.txt

Expected result

  1. It must show the same that added to textfield
User-agent: *
Disallow: /index.php/
Disallow: /*?
Disallow: /checkout/
Disallow: /app/
Disallow: /lib/
Disallow: /*.php$
Disallow: /pkginfo/
Disallow: /report/
Disallow: /var/
Disallow: /catalog/
Disallow: /customer/
Disallow: /sendfriend/
Disallow: /review/
Disallow: /*SID=

Actual result

  1. It is showing all in one line:
    image
@magento-engcom-team magento-engcom-team added Issue: Format is valid Gate 1 Passed. Automatic verification of issue format passed Issue: Clear Description Gate 2 Passed. Manual verification of the issue description passed labels Jan 16, 2018
@magento-engcom-team
Copy link
Contributor

@Sharkozp, thank you for your report.
We've acknowledged the issue and added to our backlog.

@magento-engcom-team magento-engcom-team added Issue: Ready for Work Gate 4. Acknowledged. Issue is added to backlog and ready for development Issue: Confirmed Gate 3 Passed. Manual verification of the issue completed. Issue is confirmed Reproduced on 2.1.x The issue has been reproduced on latest 2.1 release Reproduced on 2.2.x The issue has been reproduced on latest 2.2 release Reproduced on 2.3.x The issue has been reproduced on latest 2.3 release labels Jan 16, 2018
@hostep
Copy link
Contributor

hostep commented Feb 6, 2018

Noticed this too today, I'm pretty sure this is because the content-type is set to text/html instead of the expected text/plain

@hostep
Copy link
Contributor

hostep commented Feb 7, 2018

Just noticed this is already fixed on the 2.2-develop branch by this PR: #12310

@johnny-longneck
Copy link

Can confirm this issue on live 2.2.2 site. It only appears when the store view code is added to the url.
For me it is:

www.domain.com/robots.txt <- Correct format, wrong sitemap link
www.domain.com/de/robots.txt <- Wrong format, correct sitemap link

@okorshenko okorshenko added the Fixed in 2.2.x The issue has been fixed in 2.2 release line label Mar 5, 2018
@okorshenko
Copy link
Contributor

Hi @Sharkozp the issue has been fixed in 2.2-develop and 2.1-develop branches
Will be available with 2.2.4 release

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Fixed in 2.2.x The issue has been fixed in 2.2 release line Issue: Clear Description Gate 2 Passed. Manual verification of the issue description passed Issue: Confirmed Gate 3 Passed. Manual verification of the issue completed. Issue is confirmed Issue: Format is valid Gate 1 Passed. Automatic verification of issue format passed Issue: Ready for Work Gate 4. Acknowledged. Issue is added to backlog and ready for development Reproduced on 2.1.x The issue has been reproduced on latest 2.1 release Reproduced on 2.2.x The issue has been reproduced on latest 2.2 release Reproduced on 2.3.x The issue has been reproduced on latest 2.3 release
Projects
None yet
Development

No branches or pull requests

5 participants