Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

If I remember correctly they changed their policy quite some time ago and started to ignore the robots.txt, but not 100% sure about it


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: