Is it allowed to make a site crawler for an search engine that searches everything, which my web crawler fetches every link and meta tags from every sites around the world so it gets the links in a page then continues so on and stops after it ends but i don’t know if its allowed, I’m pretty sure it isn’t, i will not continue making it if it isn’t allowed.
Please read
7 Likes
This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.