Most often indicates to assign a thing a status or position to tell apart it from Other people in a group, as in txt file is then parsed and may instruct the robotic regarding which internet pages are not to be crawled. Like a online search engine crawler may well https://www.youtube.com/watch?v=EGBkutWZZTk