Name | Description | Type | Package | Framework |
RobotsTxt | Class | net.yacy.crawler.robots | Yacy | |
RobotsTxt .CheckEntry | Class | net.yacy.crawler.robots | Yacy | |
RobotsTxt .DomSync | Class | net.yacy.crawler.robots | Yacy | |
RobotsTxtEntry | Class | net.yacy.crawler.robots | Yacy | |
RobotsTxtParser | Class | net.yacy.crawler.robots | Yacy | |