Missing robots.txt

[ksuarz]

A cursory Google search reveals that there's no robots.txt for rpm2python; do we have one we can build off of?

[renishmatta]

robots.txt is a small file with two lines (User-agent:* Disallow: /). It's on sauron (/var/www/cvs/robots.txt). I'm not sure what it's needed for, but we can move it to the required location to stop getting the error.

[jamchamb]

@REMATTA See http://www.robotstxt.org/robotstxt.html for an explanation of robots.txt

[s0lst1c3]

Hey Renish,

I think you'll enjoy reading this.

http://www.robotstxt.org

Take care,

John

Sent via the Samsung GALAXY S® 5, an AT&T 4G LTE smartphone

-------- Original message --------
From: Renish Matta notifications@github.com
Date:07/17/2014 4:37 PM (GMT-05:00)
To: oss/rpm2python rpm2python@noreply.github.com
Subject: Re: [rpm2python] Missing robots.txt (#11)

robots.txt is a small file with two lines (User-agent:* Disallow: /). It's on sauron (/var/www/cvs/robots.txt). I'm not sure what it's needed for, but we can move it to the required location to stop getting the error.

—
Reply to this email directly or view it on GitHub.