TECH NEWS
Your Drupal robots.txt Changes Aren't Showing Up: Here's Why
You've installed the robotstxt module, made your changes in the Drupal admin at /admin/config/search/robotstxt, cleared the cache, run cron — and the live robots.txt file is still showing old content. Before you go down a rabbit hole, here are the most common culprits. 1. Composer