Robots.txt for the NYT has a specific exclusion for an 1996 news article

Article URL: https://twitter.com/oliviasolon/status/1171200746240372737

Comments URL: https://news.ycombinator.com/item?id=26616973

Points: 46

# Comments: 6

from Hacker News: Front Page https://twitter.com/oliviasolon/status/1171200746240372737
via