03-26-2016, 07:47 AM
I'm having another bout of early morning insomnia, and was just looking around the forum...Noticed that under the "active users" section for right now, Bing, Baidu, and Google are listed. That may be by design, but if the site is being spidered by search engines daily and you want to lock that down so that archived posts aren't available for spidering in the future, it's a pretty simple robots.txt file change on the server - I'm sure Admin of Steel is familiar with it...Just wanted to raise the question in case the admins don't want search engines returning results from IOPList.com. If allowing 'bots to spider the site has already been considered and the admins are OK with it, then please disregard.