⚝
One Hat Cyber Team
⚝
Your IP:
216.73.216.24
Server IP:
50.6.168.112
Server:
Linux server-617809.webnetzimbabwe.com 5.14.0-570.25.1.el9_6.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 9 04:57:09 EDT 2025 x86_64
Server Software:
Apache
PHP Version:
8.4.10
Buat File
|
Buat Folder
Eksekusi
Dir :
~
/
lib64
/
python3.9
/
email
/
__pycache__
/
View File Name :
_header_value_parser.cpython-39.opt-1.pyc
a DOgŢ @ s d Z ddlZddlZddlZddlmZ ddlmZ ddlm Z ddlm Z ddlm Z e dZee d B Ze d ZeeB Zee d Zee d Zee d B e d ZeeB Zee dB ZeeB Zee d ZddhZeeB Zdd Ze dej ej B Z G dd de Z!G dd de!Z"G dd de!Z#G dd d e!Z$G d d d e!Z%G d d d e"Z&G d!d" d"e!Z'G d#d$ d$e!Z(G d%d& d&e!Z)G d'd( d(e!Z*G d)d* d*e*Z+G d+d, d,e"Z,G d-d. d.e!Z-G d/d0 d0e!Z.G d1d2 d2e!Z/G d3d4 d4e!Z0G d5d6 d6e!Z1G d7d8 d8e!Z2G d9d: d:e!Z3G d;d< d<e!Z4G d=d> d>e!Z5G d?d@ d@e!Z6G dAdB dBe!Z7G dCdD dDe!Z8G dEdF dFe!Z9G dGdH dHe!Z:G dIdJ dJe!Z;G dKdL dLe!Z<G dMdN dNe$Z=G dOdP dPe!Z>G dQdR dRe!Z?G dSdT dTe!Z@G dUdV dVe!ZAG dWdX dXeAZBG dYdZ dZe!ZCG d[d\ d\e!ZDG d]d^ d^e!ZEG d_d` d`e!ZFG dadb dbe!ZGG dcdd ddeGZHG dedf dfeGZIG dgdh dhe!ZJG didj dje!ZKG dkdl dle!ZLG dmdn dneLZMG dodp dpeMZNG dqdr dre!ZOG dsdt dtePZQG dudv dveQZRG dwdx dxeQZSG dydz dzeRZTG d{d| d|e jUZVeSd d}ZWeSd~dZXeSddZYe dZd[ej\Z]e dZe^d[ej_Z`e djaZbe dZe^d[ej_Zce dZe^d[ej_Zde dZe^d[ej_Zedd Zfdd Zgdd Zhdd Zidd Zjdd Zkdd Zldd Zmdd Zndd Zodd Zpdd Zqdd Zrdd Zsdd Ztdd Zudd Zvdd Zwdd Zxdd Zydd Zzdd Z{dd Z|dd Z}dd Z~dd Zdd Zdd Zdd Zdd ZddÄ Zddń ZddDŽ ZddɄ Zdd˄ Zdd̈́ Zddτ Zddф Zddӄ ZddՄ Zddׄ Zddل Zddۄ Zdd݄ Zdd߄ Zdd Zdd Zdd Zdd Zdd Zdd Zdd Zdd Zdd Zdd Zdd Zdd Zdd ZdS )al Header value parser implementing various email-related RFC parsing rules. The parsing methods defined in this module implement various email related parsing rules. Principal among them is RFC 5322, which is the followon to RFC 2822 and primarily a clarification of the former. It also implements RFC 2047 encoded word decoding. RFC 5322 goes to considerable trouble to maintain backward compatibility with RFC 822 in the parse phase, while cleaning up the structure on the generation phase. This parser supports correct RFC 5322 generation by tagging white space as folding white space only when folding is allowed in the non-obsolete rule sets. Actually, the parser is even more generous when accepting input than RFC 5322 mandates, following the spirit of Postel's Law, which RFC 5322 encourages. Where possible deviations from the standard are annotated on the 'defects' attribute of tokens that deviate. The general structure of the parser follows RFC 5322, and uses its terminology where there is a direct correspondence. Where the implementation requires a somewhat different structure than that used by the formal grammar, new terms that mimic the closest existing terms are used. Thus, it really helps to have a copy of RFC 5322 handy when studying this code. Input to the parser is a string that has already been unfolded according to RFC 5322 rules. According to the RFC this unfolding is the very first step, and this parser leaves the unfolding step to a higher level message parser, which will have already detected the line breaks that need unfolding while determining the beginning and end of each header. The output of the parser is a TokenList object, which is a list subclass. A TokenList is a recursive data structure. The terminal nodes of the structure are Terminal objects, which are subclasses of str. These do not correspond directly to terminal objects in the formal grammar, but are instead more practical higher level combinations of true terminals. All TokenList and Terminal objects have a 'value' attribute, which produces the semantically meaningful value of that part of the parse subtree. The value of all whitespace tokens (no matter how many sub-tokens they may contain) is a single space, as per the RFC rules. This includes 'CFWS', which is herein included in the general class of whitespace tokens. There is one exception to the rule that whitespace tokens are collapsed into single spaces in values: in the value of a 'bare-quoted-string' (a quoted-string with no leading or trailing whitespace), any whitespace that appeared between the quotation marks is preserved in the returned value. Note that in all Terminal strings quoted pairs are turned into their unquoted values. All TokenList and Terminal objects also have a string value, which attempts to be a "canonical" representation of the RFC-compliant form of the substring that produced the parsed subtree, including minimal use of quoted pair quoting. Whitespace runs are not collapsed. Comment tokens also have a 'content' attribute providing the string found between the parens (including any nested comments) with whitespace preserved. All TokenList and Terminal objects have a 'defects' attribute which is a possibly empty list all of the defects found while creating the token. Defects may appear on any token in the tree, and a composite list of all defects in the subtree is available through the 'all_defects' attribute of any node. (For Terminal notes x.defects == x.all_defects.) Each object in a parse tree is called a 'token', and each has a 'token_type' attribute that gives the name from the RFC 5322 grammar that it represents. Not all RFC 5322 nodes are produced, and there is one non-RFC 5322 node that may be produced: 'ptext'. A 'ptext' is a string of printable ascii characters. It is returned in place of lists of (ctext/quoted-pair) and (qtext/quoted-pair). XXX: provide complete list of token types. N) hexdigits) itemgetter)_encoded_words)errors)utilsz (z ()<>@,:;.\"[].z."(z/?=z*'%% c C s dt | dddd d S )N"\\\z\")strreplacevalue r 2/usr/lib64/python3.9/email/_header_value_parser.py quote_stringb s r z =\? # literal =? [^?]* # charset \? # literal ? [qQbB] # literal 'q' or 'b', case insensitive \? # literal ? .*? # encoded word \?= # literal ?= c s e Zd ZdZdZdZ fddZdd Z fddZe d d Z e d d Z d d Z e dd Z e dd Zdd Zd ddZd ddZd ddZ ZS ) TokenListNTc s t j|i | g | _d S N)super__init__defects)selfargskw __class__r r r { s zTokenList.__init__c C s d dd | D S )N c s s | ]}t |V qd S r r .0xr r r <genexpr> z$TokenList.__str__.<locals>.<genexpr>joinr r r r __str__ s zTokenList.__str__c s d | jjt S Nz{}({})formatr __name__r __repr__r) r r r r/ s zTokenList.__repr__c C s d dd | D S )Nr c s s | ]}|j r|j V qd S r r r" r r r r% r& z"TokenList.value.<locals>.<genexpr>r' r) r r r r s zTokenList.valuec C s t dd | D | jS )Nc s s | ] }|j V qd S r ) all_defectsr" r r r r% r& z(TokenList.all_defects.<locals>.<genexpr>)sumr r) r r r r0 s zTokenList.all_defectsc C s | d S Nr )startswith_fwsr) r r r r3 s zTokenList.startswith_fwsc C s t dd | D S )zATrue if all top level tokens of this part may be RFC2047 encoded.c s s | ] }|j V qd S r ) as_ew_allowed)r# partr r r r% r& z*TokenList.as_ew_allowed.<locals>.<genexpr>)allr) r r r r4 s zTokenList.as_ew_allowedc C s g }| D ]}| |j q|S r )extendcomments)r r8 tokenr r r r8 s zTokenList.commentsc C s t | |dS )Npolicy)_refold_parse_treer r; r r r fold s zTokenList.foldr c C s t | j|d d S )Nindent)printppstrr r@ r r r pprint s zTokenList.pprintc C s d | j|dS )Nr r? )r( _pprC r r r rB s zTokenList.ppstrc c sz d || jj| jV | D ]4}t|ds:|d | V q||d E d H q| jrdd | j}nd}d ||V d S )Nz{}{}/{}(rE z* !! invalid element in token list: {!r}z z Defects: {}r z{}){})r- r r. token_typehasattrrE r )r r@ r9 extrar r r rE s z TokenList._pp)r )r )r )r. __module__ __qualname__rF syntactic_breakew_combine_allowedr r* r/ propertyr r0 r3 r4 r8 r> rD rB rE __classcell__r r r r r u s& r c @ s$ e Zd Zedd Zedd ZdS )WhiteSpaceTokenListc C s dS N r r) r r r r s zWhiteSpaceTokenList.valuec C s dd | D S )Nc S s g | ]}|j d kr|jqS )comment)rF contentr" r r r <listcomp> r& z0WhiteSpaceTokenList.comments.<locals>.<listcomp>r r) r r r r8 s z WhiteSpaceTokenList.commentsN)r. rI rJ rM r r8 r r r r rO s rO c @ s e Zd ZdZdS )UnstructuredTokenList unstructuredNr. rI rJ rF r r r r rU s rU c @ s e Zd ZdZdS )PhrasephraseNrW r r r r rX s rX c @ s e Zd ZdZdS )WordZwordNrW r r r r rZ s rZ c @ s e Zd ZdZdS )CFWSListcfwsNrW r r r r r[ s r[ c @ s e Zd ZdZdS )AtomatomNrW r r r r r] s r] c @ s e Zd ZdZdZdS )Tokenr9 FN)r. rI rJ rF Z encode_as_ewr r r r r_ s r_ c @ s e Zd ZdZdZdZdZdS ) EncodedWord encoded-wordN)r. rI rJ rF ctecharsetlangr r r r r` s r` c @ s4 e Zd ZdZedd Zedd Zedd ZdS ) QuotedString quoted-stringc C s" | D ]}|j dkr|j S qd S Nbare-quoted-stringrF r r r$ r r r rS s zQuotedString.contentc C s> g }| D ]*}|j dkr&|t| q||j qd|S )Nrh r )rF appendr r r( )r resr$ r r r quoted_value s zQuotedString.quoted_valuec C s" | D ]}|j dkr|j S qd S rg ri r r9 r r r stripped_value s zQuotedString.stripped_valueN)r. rI rJ rF rM rS rm ro r r r r re s re c @ s$ e Zd ZdZdd Zedd ZdS )BareQuotedStringrh c C s t ddd | D S )Nr c s s | ]}t |V qd S r r! r" r r r r% r& z+BareQuotedString.__str__.<locals>.<genexpr>)r r( r) r r r r* s zBareQuotedString.__str__c C s d dd | D S )Nr c s s | ]}t |V qd S r r! r" r r r r% r& z)BareQuotedString.value.<locals>.<genexpr>r' r) r r r r s zBareQuotedString.valueN)r. rI rJ rF r* rM r r r r r rp s rp c @ s8 e Zd ZdZdd Zdd Zedd Zedd Zd S ) CommentrR c s( d tdg fdd D dggg S )Nr r c s g | ]} |qS r )quoter" r) r r rT r& z#Comment.__str__.<locals>.<listcomp>))r( r1 r) r r) r r* s zComment.__str__c C s2 |j dkrt|S t|ddddddS )NrR r r r z\(rs z\))rF r r )r r r r r rr s z Comment.quotec C s d dd | D S )Nr c s s | ]}t |V qd S r r! r" r r r r% r& z"Comment.content.<locals>.<genexpr>r' r) r r r rS s zComment.contentc C s | j gS r )rS r) r r r r8 s zComment.commentsN) r. rI rJ rF r* rr rM rS r8 r r r r rq s rq c @ s4 e Zd ZdZedd Zedd Zedd ZdS ) AddressListz address-listc C s dd | D S )Nc S s g | ]}|j d kr|qS )addressrF r" r r r rT ) r& z)AddressList.addresses.<locals>.<listcomp>r r) r r r addresses' s zAddressList.addressesc C s t dd | D g S )Nc s s | ]}|j d kr|jV qdS ru NrF mailboxesr" r r r r% - s z(AddressList.mailboxes.<locals>.<genexpr>r1 r) r r r rz + s zAddressList.mailboxesc C s t dd | D g S )Nc s s | ]}|j d kr|jV qdS rx rF all_mailboxesr" r r r r% 2 s z,AddressList.all_mailboxes.<locals>.<genexpr>r{ r) r r r r} 0 s zAddressList.all_mailboxesN)r. rI rJ rF rM rw rz r} r r r r rt # s rt c @ s4 e Zd ZdZedd Zedd Zedd ZdS ) Addressru c C s | d j dkr| d jS d S )Nr grouprF display_namer) r r r r : s zAddress.display_namec C s4 | d j dkr| d gS | d j dkr*g S | d jS Nr mailboxinvalid-mailboxry r) r r r rz ? s zAddress.mailboxesc C s: | d j dkr| d gS | d j dkr0| d gS | d jS r r| r) r r r r} G s zAddress.all_mailboxesN)r. rI rJ rF rM r rz r} r r r r r~ 6 s r~ c @ s( e Zd ZdZedd Zedd ZdS ) MailboxList mailbox-listc C s dd | D S )Nc S s g | ]}|j d kr|qS )r rv r" r r r rT U r& z)MailboxList.mailboxes.<locals>.<listcomp>r r) r r r rz S s zMailboxList.mailboxesc C s dd | D S )Nc S s g | ]}|j d v r|qS ))r r rv r" r r r rT Y s z-MailboxList.all_mailboxes.<locals>.<listcomp>r r) r r r r} W s zMailboxList.all_mailboxesNr. rI rJ rF rM rz r} r r r r r O s r c @ s( e Zd ZdZedd Zedd ZdS ) GroupList group-listc C s | r| d j dkrg S | d jS Nr r ry r) r r r rz a s zGroupList.mailboxesc C s | r| d j dkrg S | d jS r r| r) r r r r} g s zGroupList.all_mailboxesNr r r r r r ] s r c @ s4 e Zd ZdZedd Zedd Zedd ZdS ) Groupr c C s | d j dkrg S | d jS N r ry r) r r r rz r s zGroup.mailboxesc C s | d j dkrg S | d jS r r| r) r r r r} x s zGroup.all_mailboxesc C s | d j S r2 )r r) r r r r ~ s zGroup.display_nameN)r. rI rJ rF rM rz r} r r r r r r n s r c @ sL e Zd ZdZedd Zedd Zedd Zedd Zed d Z d S ) NameAddr name-addrc C s t | dkrd S | d jS N r )lenr r) r r r r s zNameAddr.display_namec C s | d j S N local_partr) r r r r s zNameAddr.local_partc C s | d j S r domainr) r r r r s zNameAddr.domainc C s | d j S r )router) r r r r s zNameAddr.routec C s | d j S r addr_specr) r r r r s zNameAddr.addr_specN r. rI rJ rF rM r r r r r r r r r r s r c @ s@ e Zd ZdZedd Zedd Zedd Zedd Zd S ) AngleAddrz angle-addrc C s" | D ]}|j dkr|j S qd S N addr-spec)rF r rj r r r r s zAngleAddr.local_partc C s" | D ]}|j dkr|j S qd S r rF r rj r r r r s zAngleAddr.domainc C s" | D ]}|j dkr|j S qd S )N obs-route)rF domainsrj r r r r s zAngleAddr.routec C s< | D ]2}|j dkr|jr"|j S t|j|j S qdS )Nr z<>)rF r r r rj r r r r s zAngleAddr.addr_specN) r. rI rJ rF rM r r r r r r r r r s r c @ s e Zd ZdZedd ZdS )ObsRouter c C s dd | D S )Nc S s g | ]}|j d kr|jqS r r r" r r r rT r& z$ObsRoute.domains.<locals>.<listcomp>r r) r r r r s zObsRoute.domainsN)r. rI rJ rF rM r r r r r r s r c @ sL e Zd ZdZedd Zedd Zedd Zedd Zed d Z d S ) Mailboxr c C s | d j dkr| d jS d S Nr r r r) r r r r s zMailbox.display_namec C s | d j S r2 r r) r r r r s zMailbox.local_partc C s | d j S r2 r r) r r r r s zMailbox.domainc C s | d j dkr| d jS d S r )rF r r) r r r r s z Mailbox.routec C s | d j S r2 r r) r r r r s zMailbox.addr_specNr r r r r r s r c @ s, e Zd ZdZedd Ze Z Z ZZ dS )InvalidMailboxr c C s d S r r r) r r r r s zInvalidMailbox.display_nameNr r r r r r s r c s( e Zd ZdZdZe fddZ ZS )Domainr Fc s d t j S Nr r( r r splitr) r r r r s z Domain.domain)r. rI rJ rF r4 rM r rN r r r r r s r c @ s e Zd ZdZdS )DotAtomdot-atomNrW r r r r r s r c @ s e Zd ZdZdZdS ) DotAtomTextz dot-atom-textTNr. rI rJ rF r4 r r r r r s r c @ s e Zd ZdZdZdS ) NoFoldLiteralzno-fold-literalFNr r r r r r s r c @ sD e Zd ZdZdZedd Zedd Zedd Zed d Z d S ) AddrSpecr Fc C s | d j S r2 r r) r r r r s zAddrSpec.local_partc C s t | dk rd S | d jS )N r )r r r) r r r r s zAddrSpec.domainc C s< t | dk r| d jS | d j | d j | d j S )Nr r r r )r r rstriplstripr) r r r r s zAddrSpec.valuec C sL t | j}t|t|t kr*t| j}n| j}| jd urH|d | j S |S )N@)setr r DOT_ATOM_ENDSr r )r ZnamesetZlpr r r r s zAddrSpec.addr_specN) r. rI rJ rF r4 rM r r r r r r r r r s r c @ s e Zd ZdZdZdS ) ObsLocalPartzobs-local-partFNr r r r r r ( s r c s4 e Zd ZdZdZedd Ze fddZ ZS ) DisplayNamez display-nameFc C s t | }t|dkr|jS |d jdkr4|d n*|d d jdkr^t |d dd |d< |d jdkrv| n*|d d jdkrt |d d d |d< |jS )Nr r\ r r )r r r rF pop)r rl r r r r 3 s zDisplayName.display_namec s d}| j rd}n| D ]}|jdkrd}qt| dkr|rd }}| d jdks`| d d jdkrdd}| d jdks| d d jdkrd}|t| j | S t jS d S ) NFTrf r r r\ rQ r )r rF r r r r r )r rr r$ preZpostr r r r D s zDisplayName.value) r. rI rJ rF rL rM r r rN r r r r r . s r c @ s, e Zd ZdZdZedd Zedd ZdS ) LocalPartz local-partFc C s& | d j dkr| d jS | d jS d S )Nr rf )rF rm r r) r r r r ] s zLocalPart.valuec C s t g}t }d}| d t g D ]}|jdkr,q |r\|jdkr\|d jdkr\t|d d |d< t|t}|r|jdkr|d jdkr|t|dd n || |d }|}q t|dd }|jS )NFr r\ dotr r )DOTrF r isinstancerk r )r rl lastZ last_is_tltokZis_tlr r r r d s( zLocalPart.local_partN)r. rI rJ rF r4 rM r r r r r r r X s r c s4 e Zd ZdZdZe fddZedd Z ZS ) DomainLiteralzdomain-literalFc s d t j S r r r) r r r r s zDomainLiteral.domainc C s" | D ]}|j dkr|j S qd S )Nptextri rj r r r ip s zDomainLiteral.ip) r. rI rJ rF r4 rM r r rN r r r r r | s r c @ s e Zd ZdZdZdZdS ) MIMEVersionz mime-versionN)r. rI rJ rF majorminorr r r r r s r c @ s4 e Zd ZdZdZdZdZedd Zedd Z dS ) Parameter parameterFus-asciic C s | j r| d jS dS r ) sectionednumberr) r r r section_number s zParameter.section_numberc C sf | D ]\}|j dkr |j S |j dkr|D ]4}|j dkr*|D ] }|j dkr<|j S q<q*qdS )Nr rf rh r )rF ro rn r r r param_value s zParameter.param_valueN) r. rI rJ rF r extendedrc rM r r r r r r r s r c @ s e Zd ZdZdS )InvalidParameterinvalid-parameterNrW r r r r r s r c @ s e Zd ZdZedd ZdS ) Attribute attributec C s$ | D ]}|j dr|j S qd S )Nattrtext)rF endswithr rn r r r ro s zAttribute.stripped_valueNr. rI rJ rF rM ro r r r r r s r c @ s e Zd ZdZdZdS )SectionsectionN)r. rI rJ rF r r r r r r s r c @ s e Zd ZdZedd ZdS )Valuer c C s2 | d }|j dkr| d }|j dr,|jS | jS )Nr r\ r )rf r zextended-attribute)rF r ro r rn r r r ro s zValue.stripped_valueNr r r r r r s r c @ s( e Zd ZdZdZedd Zdd ZdS )MimeParametersmime-parametersFc c s i }| D ]T}|j dsq|d j dkr*q|d j }||vrHg ||< || |j|f q| D ]~\}}t|tdd}|d d }|j }|j st |dkr|d d dkr|d d j t d |d d }g }d}|D ]\} } | |kr(| j s| j t d qn| j t d |d7 }| j} | j rztj| } W n$ tyr tjj| d d } Y nT0 z| |d } W n$ ttfy | d d } Y n0 t| r| j t || qd |} || fV qfd S )Nr r r )keyr z.duplicate parameter name; duplicate(s) ignoredz+duplicate parameter name; duplicate ignoredz(inconsistent RFC2231 parameter numberingzlatin-1)encodingsurrogateescaper r )rF r r striprk r itemssortedr rc r r r r InvalidHeaderDefectr urllibparseunquote_to_bytesUnicodeEncodeErrorunquotedecode LookupErrorr _has_surrogatesUndecodableBytesDefectr( ) r paramsr9 namepartsZ first_paramrc Z value_partsir paramr r r r r s` zMimeParameters.paramsc C sT g }| j D ].\}}|r.|d|t| q || q d|}|rPd| S dS )N{}={}z; rQ r )r rk r- r r( )r r r r r r r r* s zMimeParameters.__str__N)r. rI rJ rF rK rM r r* r r r r r s Er c @ s e Zd ZdZedd ZdS )ParameterizedHeaderValueFc C s& t | D ]}|jdkr|j S qi S )Nr )reversedrF r rn r r r r / s z ParameterizedHeaderValue.paramsN)r. rI rJ rK rM r r r r r r ) s r c @ s e Zd ZdZdZdZdZdS ) ContentTypez content-typeFtextZplainN)r. rI rJ rF r4 maintypesubtyper r r r r 7 s r c @ s e Zd ZdZdZdZdS )ContentDispositionzcontent-dispositionFN)r. rI rJ rF r4 content_dispositionr r r r r > s r c @ s e Zd ZdZdZdZdS )ContentTransferEncodingzcontent-transfer-encodingFZ7bitN)r. rI rJ rF r4 rb r r r r r D s r c @ s e Zd ZdZdZdS ) HeaderLabelz header-labelFNr r r r r r J s r c @ s e Zd ZdZdZdd ZdS )MsgIDzmsg-idFc C s t | |j S r )r linesepr= r r r r> S s z MsgID.foldN)r. rI rJ rF r4 r> r r r r r O s r c @ s e Zd ZdZdS ) MessageIDz message-idNrW r r r r r X s r c @ s e Zd ZdZdS )InvalidMessageIDzinvalid-message-idNrW r r r r r \ s r c @ s e Zd ZdZdS )HeaderheaderNrW r r r r r ` s r c sr e Zd ZdZdZdZ fddZ fddZdd Ze dd Z d fd d Z d d Z e dd Z dd Z ZS )TerminalTc s t | |}||_g |_|S r )r __new__rF r )clsr rF r r r r r n s zTerminal.__new__c s d | jjt S r+ r, r) r r r r/ t s zTerminal.__repr__c C s t | jjd | j d S )N/)rA r r. rF r) r r r rD w s zTerminal.pprintc C s t | jS r )listr r) r r r r0 z s zTerminal.all_defectsr c s2 d || jj| jt | js"dn d | jgS )Nz {}{}/{}({}){}r z {})r- r r. rF r r/ r rC r r r rE ~ s z Terminal._ppc C s d S r r r) r r r pop_trailing_ws s zTerminal.pop_trailing_wsc C s g S r r r) r r r r8 s zTerminal.commentsc C s t | | jfS r )r rF r) r r r __getnewargs__ s zTerminal.__getnewargs__)r )r. rI rJ r4 rL rK r r/ rD rM r0 rE r r8 r rN r r r r r h s r c @ s e Zd Zedd Zdd ZdS )WhiteSpaceTerminalc C s dS rP r r) r r r r s zWhiteSpaceTerminal.valuec C s dS )NTr r) r r r r3 s z!WhiteSpaceTerminal.startswith_fwsNr. rI rJ rM r r3 r r r r r s r c @ s e Zd Zedd Zdd ZdS ) ValueTerminalc C s | S r r r) r r r r s zValueTerminal.valuec C s dS )NFr r) r r r r3 s z ValueTerminal.startswith_fwsNr r r r r r s r c @ s e Zd Zedd Zdd ZdS )EWWhiteSpaceTerminalc C s dS r r r) r r r r s zEWWhiteSpaceTerminal.valuec C s dS r r r) r r r r* s z EWWhiteSpaceTerminal.__str__N)r. rI rJ rM r r* r r r r r s r c @ s e Zd ZdZdS )_InvalidEwErrorz1Invalid encoded word found while parsing headers.N)r. rI rJ __doc__r r r r r s r r ,list-separatorr zroute-component-markerz([{}]+)r z[^{}]+z[\x00-\x20\x7F]c C s> t | }|r | jt| t| r:| jtd dS )z@If input token contains ASCII non-printables, register a defect.z*Non-ASCII characters found in header tokenN)_non_printable_finderr rk r ZNonPrintableDefectr r r )xtextZnon_printablesr r r _validate_xtext s r c C s t | d^}}g }d}d}tt|D ]L}|| dkrJ|rDd}d}nd}q&|rTd}n|| |v rd q|||| q&|d }d|d||d g| |fS )ak Scan printables/quoted-pairs until endchars and return unquoted ptext. This function turns a run of qcontent, ccontent-without-comments, or dtext-with-quoted-printables into a single string by unquoting any quoted printables. It returns the string, the remaining value, and a flag that is True iff there were any quoted printables decoded. r Fr Tr N) _wsp_splitterranger rk r( )r endcharsfragment remainderZvcharsescapehad_qpposr r r _get_ptext_to_endchars s$ r c C s. | }t| dt| t| d}||fS )zFWS = 1*WSP This isn't the RFC definition. We're using fws to represent tokens where folding can be done, but when we are parsing the *un*folding has already been done so we don't need to watch out for CRLF. Nfws)r r r )r Znewvaluer r r r get_fws s r c C s t }| ds td| | dd dd^}}|| dd krXtd| d|}t|dkr|d tv r|d tv r| d dk r|dd^}}|d | }t| dkr|j t d | |_ d|} z td| d \}}}} W n( ttfy( td |j Y n0 ||_||_|j | |r|d tv rpt|\} }| | qBt|d^} }t| d } t| | | d|}qB| r| d tvr|j t d || fS )zE encoded-word = "=?" charset "?" encoding "?" encoded-text "?=" =?z"expected encoded word but found {}r Nz?=r r r ?z whitespace inside encoded wordz!encoded word format invalid: '{}'vtextz.missing trailing whitespace after encoded-word)r` startswithr HeaderParseErrorr- r r( r r countr rk r rb _ewr ValueErrorKeyErrorr rc rd r7 WSPr r r r ) r Zewr r Zremstrrestr rc rd r r9 charsr r r r get_encoded_word sd r* c C sB t }| r>| d tv r0t| \}} || qd}| drzt| \}} W n( tyd d}Y n tjyv Y nr0 d}t |dkr|d j dkr|j t d d}|rt |dkr|d j d krt |d d|d< || qt| d^}}|rt|r| d^}}t|d }t| || d |} q|S ) aO unstructured = (*([FWS] vchar) *WSP) / obs-unstruct obs-unstruct = *((*LF *CR *(obs-utext) *LF *CR)) / FWS) obs-utext = %d0 / obs-NO-WS-CTL / LF / CR obs-NO-WS-CTL is control characters except WSP/CR/LF. So, basically, we have printable runs, plus control characters or nulls in the obsolete syntax, separated by whitespace. Since RFC 2047 uses the obsolete syntax in its specification, but requires whitespace on either side of the encoded words, I can see no reason to need to separate the non-printable-non-whitespace from the printable runs if they occur, so we parse this into xtext tokens separated by WSP tokens. Because an 'unstructured' value must by definition constitute the entire value, this 'get' routine does not return a remaining value, only the parsed TokenList. r Tr Fr r z&missing whitespace before encoded wordr ra r r )rU r' r rk r! r* r r r" r rF r r r r rfc2047_matchersearch partitionr r r( )r rV r9 valid_ewZhave_wsr r r r r r get_unstructuredA sH r0 c C s* t | d\}} }t|d}t| || fS )a ctext = <printable ascii except \ ( )> This is not the RFC ctext, since we are handling nested comments in comment and unquoting quoted-pairs here. We allow anything except the '()' characters, but if we find any ASCII other than the RFC defined printable ASCII, a NonPrintableDefect is added to the token's defects list. Since quoted pairs are converted to their unquoted values, what is returned is a 'ptext' token. In this case it is a WhiteSpaceTerminal, so it's value is ' '. z()r )r r r r r _r r r get_qp_ctext s r3 c C s* t | d\}} }t|d}t| || fS )ao qcontent = qtext / quoted-pair We allow anything except the DQUOTE character, but if we find any ASCII other than the RFC defined printable ASCII, a NonPrintableDefect is added to the token's defects list. Any quoted pairs are converted to their unquoted values, so what is returned is a 'ptext' token. In this case it is a ValueTerminal. r r )r r r r1 r r r get_qcontent s r4 c C sN t | }|s td| | }| t|d } t|d}t| || fS )zatext = <matches _atext_matcher> We allow any non-ATOM_ENDS in atext, but add an InvalidATextDefect to the token's defects list if we find non-atext characters. z expected atext but found '{}'Natext)_non_atom_end_matcherr r" r- r r r r )r mr5 r r r get_atext s r8 c C sp | d dkr t d| t }| dd } | rT| d dkrTt| \}} || | r@| d dkr@| d tv rt| \}} n| dd dkr(d}z&t| \}} |j t d d }W n t jy t| \}} Y n0 |r4t |dkr4|d j d kr4|d j dkr4t |d d |d < n t| \}} || qT| s`|j t d || fS || dd fS )zbare-quoted-string = DQUOTE *([FWS] qcontent) [FWS] DQUOTE A quoted-string without the leading or trailing white space. Its value is the text between the quote marks, with whitespace preserved and quoted pairs decoded. r r zexpected '"' but found '{}'r Nr r Fz!encoded word inside quoted stringTr r r+ ra z"end of header inside quoted string)r r" r- rp r4 rk r' r r* r r r rF r )r Zbare_quoted_stringr9 r/ r r r get_bare_quoted_string sJ r9 c C s | r | d dkr t d| t }| dd } | r| d dkr| d tv r\t| \}} n&| d dkrvt| \}} n t| \}} || q2| s|j t d || fS || dd fS )zcomment = "(" *([FWS] ccontent) [FWS] ")" ccontent = ctext / quoted-pair / comment We handle nested comments here, and quoted-pair in our qp-ctext routine. r r zexpected '(' but found '{}'r Nrs z end of header inside comment) r r" r- rq r' r get_commentr3 rk r r )r rR r9 r r r r: s& r: c C sP t }| rH| d tv rH| d tv r0t| \}} n t| \}} || q|| fS )z,CFWS = (1*([FWS] comment) [FWS]) / FWS r )r[ CFWS_LEADERr' r r: rk )r r\ r9 r r r get_cfws s r< c C sp t }| r,| d tv r,t| \}} || t| \}} || | rh| d tv rht| \}} || || fS )zquoted-string = [CFWS] <bare-quoted-string> [CFWS] 'bare-quoted-string' is an intermediate class defined by this parser and not by the RFC grammar. It is the quoted string without any attached CFWS. r )re r; r< rk r9 )r Z quoted_stringr9 r r r get_quoted_string s r= c C s t }| r,| d tv r,t| \}} || | rL| d tv rLtd| | drzt | \}} W q tjy t | \}} Y q0 n t | \}} || | r| d tv rt| \}} || || fS )zPatom = [CFWS] 1*atext [CFWS] An atom could be an rfc2047 encoded word. r z expected atom but found '{}'r ) r] r; r< rk ATOM_ENDSr r" r- r! r* r8 )r r^ r9 r r r get_atom s& r? c C s t }| r| d tv r&td| | rt| d tvrtt| \}} || | r&| d dkr&|t | dd } q&|d tu rtdd| || fS )z( dot-text = 1*atext *("." 1*atext) r z8expected atom at a start of dot-atom-text but found '{}'r r Nr z4expected atom at end of dot-atom-text but found '{}')r r> r r" r- r8 rk r )r Z dot_atom_textr9 r r r get_dot_atom_text2 s r@ c C s t }| d tv r(t| \}} || | drfzt| \}} W qr tjyb t| \}} Y qr0 n t| \}} || | r| d tv rt| \}} || || fS )z dot-atom = [CFWS] dot-atom-text [CFWS] Any place we can have a dot atom, we could instead have an rfc2047 encoded word. r r ) r r; r< rk r! r* r r" r@ )r Zdot_atomr9 r r r get_dot_atomE s rA c C s | d t v rt| \}} nd}| s,td| d dkrFt| \}} n*| d tv rdtd| n t| \}} |dur|g|dd< || fS )a word = atom / quoted-string Either atom or quoted-string may start with CFWS. We have to peel off this CFWS first to determine which type of word to parse. Afterward we splice the leading CFWS, if any, into the parsed sub-token. If neither an atom or a quoted-string is found before the next special, a HeaderParseError is raised. The token returned is either an Atom or a QuotedString, as appropriate. This means the 'word' level of the formal grammar is not represented in the parse tree; this is because having that extra layer when manipulating the parse tree is more confusing than it is helpful. r Nz5Expected 'atom' or 'quoted-string' but found nothing.r z1Expected 'atom' or 'quoted-string' but found '{}')r; r< r r" r= SPECIALSr- r? )r leaderr9 r r r get_word^ s" rD c C s t }zt| \}} || W n& tjyF |jtd Y n0 | r| d tvr| d dkr|t |jt d | dd } qHzt| \}} W nB tjy | d t v rt | \}} |jt d n Y n0 || qH|| fS )a phrase = 1*word / obs-phrase obs-phrase = word *(word / "." / CFWS) This means a phrase can be a sequence of words, periods, and CFWS in any order as long as it starts with at least one word. If anything other than words is detected, an ObsoleteHeaderDefect is added to the token's defect list. We also accept a phrase that starts with CFWS followed by a dot; this is registered as an InvalidHeaderDefect, since it is not supported by even the obsolete grammar. z phrase does not start with wordr r zperiod in 'phrase'r Nzcomment found without atom) rX rD rk r r" r r PHRASE_ENDSr ObsoleteHeaderDefectr; r< )r rY r9 r r r get_phrase s4 rG c C sp t }d}| d tv r"t| \}} | s6td| zt| \}} W nZ tjy zt| \}} W n4 tjy | d dkr| d tv r t }Y n0 Y n0 |dur|g|dd< | | | r0| d dks| d tvr0t t || \}} |j dkr|j td n|j td ||d< z|jd W n& tyf |j td Y n0 || fS ) z= local-part = dot-atom / quoted-string / obs-local-part Nr z"expected local-part but found '{}'r invalid-obs-local-partz<local-part is not dot-atom, quoted-string, or obs-local-partz,local-part is not a dot-atom (contains CFWS)asciiz)local-part contains non-ASCII characters))r r; r< r r" r- rA rD rE r rk get_obs_local_partr rF r r rF r encoder ZNonASCIILocalPartDefect)r r rC r9 obs_local_partr r r get_local_part sJ rM c C s t }d}| r&| d dks*| d tvr&| d dkrj|rL|jtd |t d}| dd } q nD| d dkr|t| d d | dd } |jtd d}q |r|d jd kr|jtd zt | \}} d}W n2 tj y | d t vr t | \}} Y n0 || q |d jd ksV|d jdkrh|d jd krh|jtd |d jd ks|d jdkr|d jd kr|jtd |jrd|_|| fS )z' obs-local-part = word *("." word) Fr r r zinvalid repeated '.'Tr Nmisplaced-specialz/'\' character outside of quoted-string/ccontentr r zmissing '.' between wordsr\ z!Invalid leading '.' in local partr+ z"Invalid trailing '.' in local partrH ) r rE r rk r r r r rF rD r" r; r< )r rL Zlast_non_ws_was_dotr9 r r r rJ sj rJ c C s@ t | d\}} }t|d}|r0|jtd t| || fS )a dtext = <printable ascii except \ [ ]> / obs-dtext obs-dtext = obs-NO-WS-CTL / quoted-pair We allow anything except the excluded characters, but if we find any ASCII other than the RFC defined printable ASCII, a NonPrintableDefect is added to the token's defects list. Quoted pairs are converted to their unquoted values, so what is returned is a ptext token, in this case a ValueTerminal. If there were quoted-printables, an ObsoleteHeaderDefect is added to the returned token's defect list. z[]r z(quoted printable found in domain-literal)r r r rk r rF r )r r r r r r get_dtext s rO c C s, | rdS | td | tdd dS )NFz"end of input inside domain-literal]domain-literal-endT)rk r r r )r domain_literalr r r _check_for_early_dl_end s rS c C sj t }| d tv r(t| \}} || | s6td| d dkrRtd| | dd } t| |rp|| fS |tdd | d t v rt | \}} || t | \}} || t| |r|| fS | d t v rt | \}} || t| |r|| fS | d dkr td | |tdd | dd } | rb| d tv rbt| \}} || || fS ) zB domain-literal = [CFWS] "[" *([FWS] dtext) [FWS] "]" [CFWS] r zexpected domain-literal[z6expected '[' at start of domain-literal but found '{}'r Nzdomain-literal-startrP z4expected ']' at end of domain-literal but found '{}'rQ ) r r; r< rk r r" r- rS r r' r rO )r rR r9 r r r get_domain_literal sH rU c C sp t }d}| d tv r"t| \}} | s6td| | d dkrvt| \}} |durd|g|dd< || || fS zt| \}} W n tjy t | \}} Y n0 | r| d dkrtd|dur|g|dd< || | rh| d dkrh|j t d |d j d kr(|d |dd< | rh| d dkrh|t t | d d \}} || q(|| fS ) z] domain = dot-atom / domain-literal / obs-domain obs-domain = atom *("." atom)) Nr z expected domain but found '{}'rT r zInvalid Domainr z(domain is not a dot-atom (contains CFWS)r r )r r; r< r r" r- rU rk rA r? r rF rF r )r r rC r9 r r r get_domain? sD rV c C s| t }t| \}} || | r,| d dkrF|jtd || fS |tdd t| dd \}} || || fS )z( addr-spec = local-part "@" domain r r z#addr-spec local part with no domainaddress-at-symbolr N)r rM rk r r r r rV )r r r9 r r r get_addr_spece s rX c C s t }| rj| d dks"| d tv rj| d tv rFt| \}} || q| d dkr|t | dd } q| rz| d dkrtd| |t t | dd \}} || | r>| d dkr>|t | dd } | sq>| d tv rt| \}} || | d dkr|t t | dd \}} || q| sNtd| d dkrltd | |t dd || dd fS ) z obs-route = obs-domain-list ":" obs-domain-list = *(CFWS / ",") "@" domain *("," [CFWS] ["@" domain]) Returns an obs-route token with the appropriate sub-tokens (that is, there is no obs-domain-list in the parse tree). r r r Nr z(expected obs-route domain but found '{}'z%end of header while parsing obs-route:z4expected ':' marking end of obs-route but found '{}'zend-of-obs-route-marker) r r; r< rk ListSeparatorr r" r- RouteComponentMarkerrV r )r Z obs_router9 r r r get_obs_routeu sF r\ c C s t }| d tv r(t| \}} || | r8| d dkrHtd| |tdd | dd } | d dkr|tdd |jt d | dd } || fS zt | \}} W nv tjy, z"t | \}} |jt d W n& tjy td | Y n0 || t | \}} Y n0 || | rZ| d dkrZ| dd } n|jt d |tdd | r| d tv rt| \}} || || fS ) z angle-addr = [CFWS] "<" addr-spec ">" [CFWS] / obs-angle-addr obs-angle-addr = [CFWS] "<" obs-route addr-spec ">" [CFWS] r <z"expected angle-addr but found '{}'zangle-addr-startr N>zangle-addr-endz null addr-spec in angle-addrz*obsolete route specification in angle-addrz.expected addr-spec or obs-route but found '{}'z"missing trailing '>' on angle-addr) r r; r< rk r r" r- r r r rX r\ rF )r Z angle_addrr9 r r r get_angle_addr sT r_ c C s< t }t| \}} ||dd |jdd |_|| fS )z display-name = phrase Because this is simply a name-rule, we don't return a display-name token containing a phrase, but rather a display-name token with the content of the phrase. N)r rG r7 r )r r r9 r r r get_display_name s r` c C s t }d}| d tv r6t| \}} | s6td|| d dkr| d tv r^td| t| \}} | s~td||dur|g|d dd< d}|| t | \}} |dur|g|dd< || || fS )z, name-addr = [display-name] angle-addr Nr z!expected name-addr but found '{}'r] ) r r; r< r r" r- rE r` rk r_ )r Z name_addrrC r9 r r r get_name_addr s6 ra c C s t }zt| \}} W nJ tjy` zt| \}} W n$ tjyZ td| Y n0 Y n0 tdd |jD r|d|_| | || fS )z& mailbox = name-addr / addr-spec z expected mailbox but found '{}'c s s | ]}t |tjV qd S r )r r r r" r r r r% s z get_mailbox.<locals>.<genexpr>r ) r ra r r" rX r- anyr0 rF rk )r r r9 r r r get_mailbox s rc c C sd t }| r\| d |vr\| d tv rD|t| d d | dd } qt| \}} || q|| fS )z Read everything up to one of the chars in endchars. This is outside the formal grammar. The InvalidMailbox TokenList that is returned acts like a Mailbox, but the data attributes are None. r rN r N)r rE rk r rG )r r Zinvalid_mailboxr9 r r r get_invalid_mailbox s rd c C s t }| r| d dkrz t| \}} || W n tjy: d}| d tv rt| \}} | rt| d dv r|| |jtd n@t | d\}} |dur|g|dd< || |jt d nb| d dkr|jtd nBt | d\}} |dur|g|dd< || |jt d Y n0 | r| d dvr|d }d |_ t | d\}} | | |jt d | r| d dkr|t | d d } q|| fS ) aJ mailbox-list = (mailbox *("," mailbox)) / obs-mbox-list obs-mbox-list = *([CFWS] ",") mailbox *("," [mailbox / CFWS]) For this routine we go outside the formal grammar in order to improve error handling. We recognize the end of the mailbox list only at the end of the value or at a ';' (the group terminator). This is so that we can turn invalid mailboxes into InvalidMailbox tokens and continue parsing any remaining valid mailboxes. We also allow all mailbox entries to be null, and this condition is handled appropriately at a higher level. r ;Nz,;z empty element in mailbox-listz invalid mailbox in mailbox-listr r r r )r rc rk r r" r; r< r rF rd r rF r7 rZ )r Z mailbox_listr9 rC r r r r get_mailbox_list sX rf c C s t }| s$|jtd || fS d}| r| d tv rt| \}} | sl|jtd || || fS | d dkr|| || fS t| \}} t|j dkr|dur|| | | |jt d || fS |dur|g|dd< || || fS )zg group-list = mailbox-list / CFWS / obs-group-list obs-group-list = 1*([CFWS] ",") [CFWS] z end of header before group-listNr zend of header in group-listre z group-list with empty entries) r r rk r r r; r< rf r r} r7 rF )r Z group_listrC r9 r r r get_group_listY s> rg c C s t }t| \}} | r"| d dkr2td| || |tdd | dd } | r| d dkr|tdd || dd fS t| \}} || | s|jt d n | d dkrtd | |tdd | dd } | r| d t v rt | \}} || || fS ) z7 group = display-name ":" [group-list] ";" [CFWS] r rY z8expected ':' at end of group display name but found '{}'z group-display-name-terminatorr Nre zgroup-terminatorzend of header in groupz)expected ';' at end of group but found {}) r r` r r" r- rk r rg r r r; r< )r r r9 r r r get_group~ s8 rh c C st t }zt| \}} W nJ tjy` zt| \}} W n$ tjyZ td| Y n0 Y n0 || || fS )a address = mailbox / group Note that counter-intuitively, an address can be either a single address or a list of addresses (a group). This is why the returned Address object has a 'mailboxes' attribute which treats a single address as a list of length one. When you need to differentiate between to two cases, extract the single element, which is either a mailbox or a group token. z expected address but found '{}')r~ rh r r" rc r- rk )r ru r9 r r r get_address s ri c C s t }| rz t| \}} || W n$ tjyL } zd}| d tv rt| \}} | rj| d dkr|| |jtd nFt | d\}} |dur|g|dd< |t |g |jt d nh| d dkr|jtd nHt | d\}} |dur|g|dd< |t |g |jt d W Y d}~n d}~0 0 | r| d dkr|d d }d|_ t | d\}} | | |jt d | r|tdd | d d } q|| fS ) a address_list = (address *("," address)) / obs-addr-list obs-addr-list = *([CFWS] ",") address *("," [address / CFWS]) We depart from the formal grammar here by continuing to parse until the end of the input, assuming the input to be entirely composed of an address-list. This is always true in email parsing, and allows us to skip invalid addresses to parse additional valid ones. Nr r z"address-list entry with no contentz invalid address in address-listz empty element in address-listr r r r )rt ri rk r r" r; r< r rF rd r~ r rF r7 r )r Z address_listr9 errrC r r r r get_address_list sX rk c C s t }| std| | d dkr6td| |tdd | dd } t| \}} || | rx| d dkrtd | |tdd || dd fS ) z& no-fold-literal = "[" *dtext "]" z'expected no-fold-literal but found '{}'r rT z;expected '[' at the start of no-fold-literal but found '{}'zno-fold-literal-startr NrP z9expected ']' at the end of no-fold-literal but found '{}'zno-fold-literal-end)r r r" r- rk r rO )r Zno_fold_literalr9 r r r get_no_fold_literal s. rl c C s t }| r,| d tv r,t| \}} || | r<| d dkrLtd| |tdd | dd } zt| \}} W n\ tjy z"t | \}} |j t d W n$ tjy td| Y n0 Y n0 || | r| d d kr<|j t d | r4| d d kr4|td d | dd } || fS |td d | dd } zt| \}} W n tjy zt | \}} W nr tjy } zVz"t| \}} |j t d W n& tjy td| Y n0 W Y d}~n d}~0 0 Y n0 || | r0| d d kr0| dd } n|j t d |td d | r|| d tv r|t| \}} || || fS )zmsg-id = [CFWS] "<" id-left '@' id-right ">" [CFWS] id-left = dot-atom-text / obs-id-left id-right = dot-atom-text / no-fold-literal / obs-id-right no-fold-literal = "[" *dtext "]" r r] z expected msg-id but found '{}'z msg-id-startr Nzobsolete id-left in msg-idz4expected dot-atom-text or obs-id-left but found '{}'r zmsg-id with no id-rightr^ z msg-id-endrW zobsolete id-right in msg-idzFexpected dot-atom-text, no-fold-literal or obs-id-right but found '{}'z missing trailing '>' on msg-id)r r; r< rk r r" r- r r@ rJ r rF r rl rV )r Zmsg_idr9 er r r get_msg_id s~ & rn c C s t }zt| \}} || W nN tjyn } z4t| }t|}|jtd | W Y d}~n&d}~0 0 | r|jtd | |S )z2message-id = "Message-ID:" msg-id CRLF zInvalid msg-id: {!r}NzUnexpected {!r}) r rn rk r r" r0 r r r r- )r Z message_idr9 exr r r parse_message_idK s rp c C s t }| s |jtd |S | d tv rXt| \}} || | sX|jtd d}| r| d dkr| d tvr|| d 7 }| dd } q\| s|jtd | |t |d nt ||_ |t |d | r| d tv rt| \}} || | r | d dkrT|j dur:|jtd | rP|t | d |S |t dd | dd } | r| d tv rt| \}} || | s|j dur|jtd |S d}| r| d tvr|| d 7 }| dd } q| s*|jtd | |t |d nt ||_ |t |d | rn| d tv rnt| \}} || | r|jtd |t | d |S )zE mime-version = [CFWS] 1*digit [CFWS] "." [CFWS] 1*digit [CFWS] z%Missing MIME version number (eg: 1.0)r z0Expected MIME version number but found only CFWSr r r Nz1Expected MIME major version number but found {!r}r digitsz0Incomplete MIME version; found only major numberzversion-separatorz1Expected MIME minor version number but found {!r}z'Excess non-CFWS text after MIME version)r r rk r HeaderMissingRequiredValuer; r< isdigitr r- r intr r )r Z mime_versionr9 rq r r r parse_mime_versiong s ru c C sd t }| r\| d dkr\| d tv rD|t| d d | dd } qt| \}} || q|| fS )z Read everything up to the next ';'. This is outside the formal grammar. The InvalidParameter TokenList that is returned acts like a Parameter, but the data attributes are None. r re rN r N)r rE rk r rG )r Zinvalid_parameterr9 r r r get_invalid_parameter s rv c C sN t | }|s td| | }| t|d } t|d}t| || fS )a8 ttext = <matches _ttext_matcher> We allow any non-TOKEN_ENDS in ttext, but add defects to the token's defects list if we find non-ttext characters. We also register defects for *any* non-printables even though the RFC doesn't exclude all of them, because we follow the spirit of RFC 5322. z expected ttext but found '{}'Nttext)_non_token_end_matcherr r" r- r r r r )r r7 rw r r r get_ttext s ry c C s t }| r,| d tv r,t| \}} || | rL| d tv rLtd| t| \}} || | r| d tv rt| \}} || || fS )ztoken = [CFWS] 1*ttext [CFWS] The RFC equivalent of ttext is any US-ASCII chars except space, ctls, or tspecials. We also exclude tabs even though the RFC doesn't. The RFC implies the CFWS but is not explicit about it in the BNF. r expected token but found '{}') r_ r; r< rk TOKEN_ENDSr r" r- ry )r Zmtokenr9 r r r get_token s r| c C sN t | }|s td| | }| t|d } t|d}t| || fS )aQ attrtext = 1*(any non-ATTRIBUTE_ENDS character) We allow any non-ATTRIBUTE_ENDS in attrtext, but add defects to the token's defects list if we find non-attrtext characters. We also register defects for *any* non-printables even though the RFC doesn't exclude all of them, because we follow the spirit of RFC 5322. z expected attrtext but found {!r}Nr )_non_attribute_end_matcherr r" r- r r r r r r7 r r r r get_attrtext s r c C s t }| r,| d tv r,t| \}} || | rL| d tv rLtd| t| \}} || | r| d tv rt| \}} || || fS )aH [CFWS] 1*attrtext [CFWS] This version of the BNF makes the CFWS explicit, and as usual we use a value terminal for the actual run of characters. The RFC equivalent of attrtext is the token characters, with the subtraction of '*', "'", and '%'. We include tab in the excluded set just as we do for token. r rz ) r r; r< rk ATTRIBUTE_ENDSr r" r- r r r r9 r r r get_attribute s r c C sN t | }|s td| | }| t|d } t|d}t| || fS )zattrtext = 1*(any non-ATTRIBUTE_ENDS character plus '%') This is a special parsing routine so that we get a value that includes % escapes as a single string (which we decode as a single string later). z)expected extended attrtext but found {!r}Nextended-attrtext)#_non_extended_attribute_end_matcherr r" r- r r r r r~ r r r get_extended_attrtext s r c C s t }| r,| d tv r,t| \}} || | rL| d tv rLtd| t| \}} || | r| d tv rt| \}} || || fS )z [CFWS] 1*extended_attrtext [CFWS] This is like the non-extended version except we allow % characters, so that we can pick up an encoded value as a single string. r rz ) r r; r< rk EXTENDED_ATTRIBUTE_ENDSr r" r- r r r r r get_extended_attribute# s r c C s t }| r| d dkr&td| |tdd | dd } | rR| d sbtd| d}| r| d r|| d 7 }| dd } qf|d d kr|d kr|jtd t ||_ |t|d || fS ) a6 '*' digits The formal BNF is more complicated because leading 0s are not allowed. We check for that and add a defect. We also assume no CFWS is allowed between the '*' and the digits, though the RFC is not crystal clear on that. The caller should already have dealt with leading CFWS. r *z Expected section but found {}zsection-markerr Nz$Expected section number but found {}r 0z'section number has an invalid leading 0rq ) r r r" r- rk r rs r ZInvalidHeaderErrorrt r )r r rq r r r get_section9 s, r c C s t }| stdd}| d tv r0t| \}} | sDtd|| d dkr^t| \}} n t| \}} |dur|g|dd< || || fS )z quoted-string / attribute z&Expected value but found end of stringNr z Expected value but found only {}r ) r r r" r; r< r- r= r rk )r vrC r9 r r r get_valueW s" r c C s t }t| \}} || | r,| d dkrL|jtd| || fS | d dkrz t| \}} d|_|| W n tj y Y n0 | st d| d dkr|t dd | dd } d|_ | d d krt d |t d d | dd } d }| r*| d t v r*t | \}} || d }|}|j rD| rD| d d krDt| \}}|j}d}|jdkr|r|d dkrd}n$t|\}} | r| d dkrd}n(zt|\}} W n Y n 0 | sd}|r.|jtd || |D ](} | jdkrg | d d < | } q(q|} nd }|jtd | r^| d dkr^d }n t| \}} |j r~|jdkr| r| d dkr|| |d ur|} || fS |jtd | s|jtd || |d u r|| fS n|d ur>|D ]} | jdkr q"q| jdk || | j|_| d dkr\t d| |t dd | dd } | r| d dkrt| \}} || |j|_| r| d dkrt d| |t dd | dd } |d urbt } | r\| d tv r t| \}} n2| d d krBt d d}| dd } n t| \}} | | q| }n t| \}} || |d ur|} || fS )aY attribute [section] ["*"] [CFWS] "=" value The CFWS is implied by the RFC but not made explicit in the BNF. This simplified form of the BNF from the RFC is made to conform with the RFC BNF through some extra checks. We do it this way because it makes both error recovery and working with the resulting parse tree easier. r re z)Parameter contains name ({}) but no valuer TzIncomplete parameterzextended-parameter-markerr N=z Parameter not followed by '='parameter-separatorr F'z5Quoted string value for extended parameter is invalidrh zZParameter marked as extended but appears to have a quoted string value that is non-encodedzcApparent initial-extended-value but attribute was not marked as extended or was not initial sectionz(Missing required charset/lang delimitersr r z=Expected RFC2231 char/lang encoding delimiter, but found {!r}zRFC2231-delimiterz;Expected RFC2231 char/lang encoding delimiter, but found {}ZDQUOTE) r r rk r r r r- r r r" r r r; r< r= ro r r r rF r r rc rd r r' r r4 ) r r r9 rC r ZappendtoZqstringZ inner_valueZ semi_validr( tr r r r get_parameterm s r c C sp t }| rlzt| \}} || W n tjy } zd}| d tv rTt| \}} | sr|| |W Y d}~S | d dkr|dur|| |jtd n@t | \}} |r|g|dd< || |jtd | W Y d}~n d}~0 0 | rJ| d dkrJ|d }d|_ t | \}} | | |jtd | | r|t dd | d d } q|S ) a! parameter *( ";" parameter ) That BNF is meant to indicate this routine should only be called after finding and handling the leading ';'. There is no corresponding rule in the formal RFC grammar, but it is more convenient for us for the set of parameters to be treated as its own TokenList. This is 'parse' routine because it consumes the remaining value, but it would never be called to parse a full header. Instead it is called to parse everything after the non-parameter value of a specific MIME header. Nr re z parameter entry with no contentzinvalid parameter {!r}r r z)parameter with invalid trailing text {!r}r r )r r rk r r" r; r< r r rv r- rF r7 r )r Zmime_parametersr9 rj rC r r r r parse_mime_parameters sJ r c C s |rV|d dkrV|d t v r>| t|d d |dd }q t|\}}| | q |s^dS | tdd | t|dd dS )zBDo our best to find the parameters in an invalid MIME header r re rN r Nr )rE rk r rG r )Z tokenlistr r9 r r r _find_mime_parameters/ s r c C s t }d}| s$|jtd |S zt| \}} W n: tjyn |jtd| t || | Y S 0 || | r| d dkr|jtd | rt || |S |j |_ |tdd | dd } zt| \}} W n< tjy& |jtd | t || | Y S 0 || |j |_| sL|S | d d kr|jtd | |` |`t || |S |td d |t| dd |S )z maintype "/" subtype *( ";" parameter ) The maintype and substype are tokens. Theoretically they could be checked against the official IANA list + x-token, but we don't do that. Fz"Missing content type specificationz(Expected content maintype but found {!r}r r zInvalid content typezcontent-type-separatorr Nz'Expected content subtype but found {!r}re z<Only parameters are valid after content type, but found {!r}r )r r rk r rr r| r" r r- r r r lowerr r r r )r ZctypeZrecoverr9 r r r parse_content_type_header? sd r c C s t }| s |jtd |S zt| \}} W n: tjyj |jtd| t || | Y S 0 || |j |_ | s|S | d dkr|jtd| t || |S |tdd |t| dd |S ) z* disposition-type *( ";" parameter ) zMissing content dispositionz+Expected content disposition but found {!r}r re zCOnly parameters are valid after content disposition, but found {!r}r r N)r r rk r rr r| r" r r- r r r r r r r )r Z disp_headerr9 r r r parse_content_disposition_headerx s: r c C s t }| s |jtd |S zt| \}} W n, tjy\ |jtd| Y n 0 || |j |_ | s|S | r|jtd | d t v r|t| d d | dd } qt| \}} || q|S )z mechanism z!Missing content transfer encodingz1Expected content transfer encoding but found {!r}z*Extra text after content transfer encodingr rN r N)r r rk r rr r| r" r r- r r r rb rE r rG )r Z cte_headerr9 r r r &parse_content_transfer_encoding_header s4 r c C sD d}| r@| d r@| d d t v r@| d d }| d d d | d< |S )Nr r )r' )linesZwspr r r _steal_trailing_WSP_if_exists s r c C s |j p tj}|jrdnd}dg}d}d}d}tdd}t| } | r| d} | |u r`|d8 }q>t| } |s| jd krt | }n t | }z| | |} W n4 t y td d | jD rd } nd} d }Y n0 | jdkrt| ||| q>|r|s| js|d}d}| jr|| j|ddt|j } |j| vr|t| |t|d krjt|}|| |d | 7 < q>t| dst| | } nt| |||| j| }d}q>t| |t|d kr|d | 7 < q>| jr"t| d |kr"t|}|s| r"||| d}q>t| dsZt| }| jsP|d7 }|| || } q>| jrz|sz| d| d }q>t|}|s| r||| q>|d | 7 < q>|j ||j S )zLReturn string of contents of parse_tree folded according to RFC rules. utf-8r r Nr Fwrap_as_ew_blockedr r c s s | ]}t |tjV qd S r )r r r r" r r r r% s z%_refold_parse_tree.<locals>.<genexpr> unknown-8bitTr r: r rK ) Zmax_line_lengthsysmaxsizeutf8r r r r rF SPECIALSNL isdisjointNLSETrK r rb r0 _fold_mime_parametersr4 rK r> r r r rk rG _fold_as_ewrL r3 insertr( )Z parse_treer; maxlenr r last_ewr Z want_encodingZend_ew_not_allowedr r5 tstrrc Z encoded_partnewlineZnewpartsr r r r< s r< c C s |dur<|r<t t|d |d | } |d d| |d< | d tv r| d }| dd } t|d |krz|t| |d |7 < d}| d tv r| d }| dd } |du rt|d n|}|dkrdn|} t| d } | d |krtd | r|t|d } | | } | dkr,|d q| d| } tj | | d }t|| }|dkr| dd } tj | | d }t|| }qR|d |7 < | t| d } | r|d t|d }q|d |7 < |r|S dS ) a Fold string to_encode into lines as encoded word, combining if allowed. Return the new value for last_ew, or None if ew_combine_allowed is False. If there is already an encoded word in the last line of lines (indicated by a non-None value for last_ew) and ew_combine_allowed is true, decode the existing ew, combine it with to_encode, and re-encode. Otherwise, encode to_encode. In either case, split to_encode as necessary so that the encoded segments fit within maxlen. Nr r r r r r z3max_line_length is too small to fit an encoded wordrQ )rc ) r r0 r' r rk r r r" r$ rK )Z to_encoder r r rL rc Z leading_wspZ trailing_wspZ new_last_ewZ encode_as chrome_lenZremaining_spaceZ text_spaceZto_encode_wordZ encoded_wordZexcessr r r r 7 sT r c C s | j D ]\}}|d ds2|d d7 < |}d}z|| d}W n. tyz d}t|rrd}d}nd}Y n0 |rtjj |d |d } d ||| } nd |t |} t |d t | d |k r|d d | |d< qn"t | d |kr| d| qd} |d } |rt |t t| d t | } || d krJd}|| d }}|d| }tjj |d |d } t | |krq|d 8 }qZ| d || | | d } | d 7 } ||d }|r|d d7 < qqdS )a> Fold TokenList 'part' into the 'lines' list as mime parameters. Using the decoded list of parameters and values, format them according to the RFC rules, including using RFC2231 encoding if the value cannot be expressed in 'encoding' and/or the parameter+value is too long to fit within 'maxlen'. r re strictFTr r r r )safer z {}*={}''{}r r rQ r r z''r N Nz {}*{}*={}{})r r r rK r r r r r rr r- r r rk r )r5 r r r r r rc Z error_handlerZencoding_requiredZ encoded_valuer r Z extra_chromer Z splitpointZmaxcharspartialr r r r x s` r )r rer r stringr operatorr Zemailr r$ r r r r' r; rB r> r rE Z TSPECIALSr{ Z ASPECIALSr r r r r compileVERBOSE MULTILINEr, r r rO rU rX rZ r[ r] r_ r` re rp rq rt r~ r r r r r r r r r r r r r r r r r r r r r r r r r r r r r r r r r r r r r r r" r r rZ r[ r- r( r r r matchr6 findallr rx r} r r r r r* r0 r3 r4 r8 r9 r: r< r= r? r@ rA rD rG rM rJ rO rS rU rV rX r\ r_ r` ra rc rd rf rg rh ri rk rl rn rp ru rv ry r| r r r r r r r r r r r r r r< r r r r r r <module> s2 E C " !*$ V + 1C+ "&'/'&). 9% 7E D 49 /kA