o
~h @ sX d dl mZ d dlmZ d dlmZ d dlmZ G dd dej Z
G dd dej Z d S )
)Site)models)
get_text_list) gettext_lazyc sN e Zd ZdZejeddeddZG dd dZdd Z fd
d Z
Z S ) Urlz
Defines a URL pattern for use with a robot exclusion rule. It's
case-sensitive and exact, e.g., "/admin" and "/admin/" are different URLs.
pattern a Case-sensitive. A missing trailing slash does also match to files which start with the name of the pattern, e.g., '/admin' matches /admin.html too. Some major search engines allow an asterisk (*) as a wildcard and a dollar sign ($) to match the end of the URL, e.g., '/*.jpg$'.
max_length help_textc @ s e Zd ZedZedZdS )zUrl.MetaurlN__name__
__module__ __qualname___ verbose_nameverbose_name_plural r r ?/var/www/html/env/lib/python3.10/site-packages/robots/models.pyMeta r c C
d| j S Nz%s)r selfr r r __str__
z Url.__str__c s. | j ds d| j | _ t j|i | d S )N/)r
startswithsupersave)r argskwargs __class__r r r! ! s zUrl.save) r r r __doc__r CharFieldr r r r r!
__classcell__r r r$ r r s
r c @ s e Zd ZdZejeddeddZeje ddededd Z
eje dd
ed
ed d Z eje ed d
Z
ejedddddeddZG dd dZdd Zdd Zede_dd Zed
e_dS ) Rulea7
Defines an abstract rule which is used to respond to crawling web robots,
using the robot exclusion standard, a.k.a. robots.txt. It allows or
disallows the robot identified by its user agent to access the given URLs.
The Site contrib app is used to enable multiple robots.txt per instance.
robotr zThis should be a user agent string like 'Googlebot'. Enter an asterisk (*) for all user agents. For a full list look at the database of Web Robots.r Tallowedz2The URLs which are allowed to be accessed by bots.)blank related_namer r
disallowedz6The URLs which are not allowed to be accessed by bots.sites)r z crawl delay a Between 0.1 and 99.0. This field is supported by some search engines and defines the delay between successive crawler accesses in seconds. If the crawler rate is a problem for your server, you can set the delay up to 5 or 10 or a comfortable value for your server, but it's suggested to start with small values (0.5-1), and increase as needed to an acceptable value for your server. Larger delay values add more delay between successive crawl accesses and decrease the maximum crawl rate to your web server.)r, null
max_digitsdecimal_placesr c @ s e Zd ZedZedZdS )z Rule.MetarulerulesNr
r r r r r f r r c C r r )r* r r r r r j r z Rule.__str__c C t t| j tdS Nand)r listr+ allr r r r r allowed_urlsm zRule.allowed_urlsc C r7 r8 )r r: r. r; r r r r r disallowed_urlsr r= zRule.disallowed_urlsN)r r r r& r r' r r* ManyToManyFieldr r+ r. r r/ DecimalField crawl_delayr r r< short_descriptionr> r r r r r) ' sP
r) N) django.contrib.sites.modelsr django.dbr django.utils.textr django.utils.translationr r Modelr r) r r r r s