Google
Edit File: cookielib.pyc
� ٜSec @ s� d Z d d d d d d d d d g Z d d l Z d d l Z d d l Z d d l Z d d l Z y d d l Z Wn e k r� d d l Z n Xd d l Z d d l m Z e Z e a d � Z e e j � Z d Z d � Z d Z d � Z d d d d d d d g Z d d d d d d d d d! d" d# d$ g Z g Z x! e D] Z e j e j � � qCWe d% � Z e d& � Z! i e d' 6e d( 6e d) 6e d* 6Z" e j# d+ � Z$ d, � Z% d- � Z& e j# d. � Z' e j# d/ e j( � Z) e j# d0 e j* � Z+ d1 � Z, e j# d2 e j* � Z- d3 � Z. d4 � Z/ e j# d5 � Z0 e j# d6 � Z1 e j# d7 � Z2 e j# d8 � Z3 d9 � Z4 e j# d: � Z5 d; � Z6 d< � Z7 d= � Z8 e j# d> � Z9 d? � Z: d@ � Z; dA � Z< dB � Z= e j# dC � Z> dD � Z? dE � Z@ dF � ZA dG � ZB dH ZC e j# dI � ZD dJ � ZE dK � ZF dL � ZG dM � ZH d f dN � � YZI d f dO � � YZJ d eJ f dP � � YZK dQ � ZL dR � ZM dS f dT � � YZN d f dU � � YZO d eP f dV � � YZQ d eO f dW � � YZR d dX lS mT ZT mU ZU d dY lV mW ZW d S(Z s� HTTP cookie handling for web clients. This module has (now fairly distant) origins in Gisle Aas' Perl module HTTP::Cookies, from the libwww-perl library. Docstrings, comments and debug strings in this code refer to the attributes of the HTTP cookie system as cookie-attributes, to distinguish them clearly from Python attributes. Class diagram (note that BSDDBCookieJar and the MSIE* classes are not distributed with the Python standard library, but are available from http://wwwsearch.sf.net/): CookieJar____ / \ \ FileCookieJar \ \ / | \ \ \ MozillaCookieJar | LWPCookieJar \ \ | | \ | ---MSIEBase | \ | / | | \ | / MSIEDBCookieJar BSDDBCookieJar |/ MSIECookieJar t Cookiet CookieJart CookiePolicyt DefaultCookiePolicyt FileCookieJart LWPCookieJart lwp_cookie_strt LoadErrort MozillaCookieJari����N( t timegmc G s; t s d St s. d d l } | j d � a n t j | � S( Ni����t cookielib( t debugt loggert loggingt getLogger( t argsR ( ( s! /usr/lib64/python2.7/cookielib.pyt _debug+ s sQ a filename was not supplied (nor was the CookieJar instance initialised with one)c C sg d d l } d d l } d d l } | j � } | j d | � | j � } | j d | d d �d S( Ni����s cookielib bug! %st stackleveli ( t warningst tracebackt StringIOt print_exct Nonet getvaluet warn( R R R t ft msg( ( s! /usr/lib64/python2.7/cookielib.pyt _warn_unhandled_exception9 s $ i� c C s� | d \ } } } } } } | t k r� d | k o? d k n r� d | k o[ d k n r� d | k ow d k n r� d | k o� d k n r� d | k o� d k n r� t | � Sd Sd S( Ni i i i i i i; i= ( t EPOCH_YEARR R ( t ttt yeart montht mdayt hourt mint sec( ( s! /usr/lib64/python2.7/cookielib.pyt _timegmH s DT t Mont Tuet Wedt Thut Frit Satt Sunt Jant Febt Mart Aprt Mayt Junt Jult Augt Sept Octt Novt Decc C sZ | d k r t j � } n t j | � d \ } } } } } } d | | | | | | f S( sH Return a string representing time in seconds since epoch, t. If the function is called without an argument, it will use the current time. The format of the returned string is like "YYYY-MM-DD hh:mm:ssZ", representing Universal Time (UTC, aka GMT). An example of this format is: 1994-11-24 08:49:37Z i s %04d-%02d-%02d %02d:%02d:%02dZN( R t timet gmtime( t tR t monR R! R" R# ( ( s! /usr/lib64/python2.7/cookielib.pyt time2isozV s %c C sl | d k r t j � } n t j | � d \ } } } } } } } d t | | t | d | | | | f S( s� Return a string representing time in seconds since epoch, t. If the function is called without an argument, it will use the current time. The format of the returned string is like this: Wed, DD-Mon-YYYY HH:MM:SS GMT i s" %s %02d-%s-%04d %02d:%02d:%02d GMTi N( R R8 R9 t DAYSt MONTHS( R: R R; R R! R" R# t wday( ( s! /usr/lib64/python2.7/cookielib.pyt time2netscapeg s (t GMTt UTCt UTt Zs ^([-+])?(\d\d?):?(\d\d)?$c C s� d } | t k r d } n t j | � } | r� d t | j d � � } | j d � rx | d t | j d � � } n | j d � d k r� | } q� n | S( Ni i i i i< i t -( R t UTC_ZONESt TIMEZONE_REt searcht intt group( t tzt offsett m( ( s! /usr/lib64/python2.7/cookielib.pyt offset_from_tz_string{ s c C s� y t j | j � � d } Wn_ t k r~ y t | � } Wn t k rQ d SXd | k oi d k n rw | } q d Sn X| d k r� d } n | d k r� d } n | d k r� d } n t | � } t | � } t | � } t | � } t | � } | d k r�t j t j � � d } | d } | } | | | } | | } t | � d k r�| d k rr| d } q| d } q�n t | | | | | | | f � } | d k r�| d k r�d } n | j � } t | � } | d k r�d S| | } n | S( Ni i i i� id i2 RB ( t MONTHS_LOWERt indext lowert ValueErrorRI R R8 t localtimet absR$ t upperRN ( t dayR; t yrt hrR" R# RK t imont cur_yrRM t tmpR: RL ( ( s! /usr/lib64/python2.7/cookielib.pyt _str2time� sR ! sV ^[SMTWF][a-z][a-z], (\d\d) ([JFMASOND][a-z][a-z]) (\d\d\d\d) (\d\d):(\d\d):(\d\d) GMT$s+ ^(?:Sun|Mon|Tue|Wed|Thu|Fri|Sat)[a-z]*,?\s*s� ^ (\d\d?) # day (?:\s+|[-\/]) (\w+) # month (?:\s+|[-\/]) (\d+) # year (?: (?:\s+|:) # separator before clock (\d\d?):(\d\d) # hour:min (?::(\d\d))? # optional seconds )? # optional clock \s* ([-+]?\d{2,4}|(?![APap][Mm]\b)[A-Za-z]+)? # timezone \s* (?:\(\w+\))? # ASCII representation of timezone in parens. \s*$c C s4 t j | � } | r� | j � } t j | d j � � d } t | d � | t | d � t | d � t | d � t | d � f } t | � S| j � } t j d | d � } d g d \ } } } } } } } t j | � } | d k r| j � \ } } } } } } } n d St | | | | | | | � S( s� Returns time in seconds since epoch of time represented by a string. Return value is an integer. None is returned if the format of str is unrecognized, the time is outside the representable range, or the timezone string is not recognized. If the string contains no timezone, UTC is assumed. The timezone in the string may be numerical (like "-0800" or "+0100") or a string timezone (like "UTC", "GMT", "BST" or "EST"). Currently, only the timezone strings equivalent to UTC (zero offset) are known to the function. The function loosely parses the following formats: Wed, 09 Feb 1994 22:23:32 GMT -- HTTP format Tuesday, 08-Feb-94 14:15:29 GMT -- old rfc850 HTTP format Tuesday, 08-Feb-1994 14:15:29 GMT -- broken rfc850 HTTP format 09 Feb 1994 22:23:32 GMT -- HTTP format (no weekday) 08-Feb-94 14:15:29 GMT -- rfc850 format (no weekday) 08-Feb-1994 14:15:29 GMT -- broken rfc850 format (no weekday) The parser ignores leading and trailing whitespace. The time may be absent. If the year is given with only 2 digits, the function will select the century that makes the year closest to the current date. i i i i i i t i N( t STRICT_DATE_RERH t groupsRO RP RQ RI t floatR$ t lstript WEEKDAY_REt subR t LOOSE_HTTP_DATE_RER\ ( t textRM t gR; R RV RW RX R" R# RK ( ( s! /usr/lib64/python2.7/cookielib.pyt http2time� s - " $s� ^ (\d{4}) # year [-\/]? (\d\d?) # numerical month [-\/]? (\d\d?) # day (?: (?:\s+|[-:Tt]) # separator before clock (\d\d?):?(\d\d) # hour:min (?::?(\d\d(?:\.\d*)?))? # optional seconds (and fractional) )? # optional clock \s* ([-+]?\d\d?:?(:?\d\d)? |Z|z)? # timezone (Z is "zero meridian", i.e. GMT) \s*$c C s� | j � } d g d \ } } } } } } } t j | � } | d k rp | j � \ } } } } } } } } n d St | | | | | | | � S( sv As for http2time, but parses the ISO 8601 formats: 1994-02-03 14:15:29 -0100 -- ISO 8601 format 1994-02-03 14:15:29 -- zone is optional 1994-02-03 -- only date 1994-02-03T14:15:29 -- Use T as separator 19940203T141529Z -- ISO 8601 compact format 19940203 -- only date i N( Ra R t ISO_DATE_RERH R_ R\ ( Re RV R; RW RX R" R# RK RM t _( ( s! /usr/lib64/python2.7/cookielib.pyt iso2time s " 'c C s+ | j d � \ } } | j | | j | S( s) Return unmatched part of re.Match object.i ( t spant string( t matcht startt end( ( s! /usr/lib64/python2.7/cookielib.pyt unmatched= s s ^\s*([^=\s;,]+)s& ^\s*=\s*\"([^\"\\]*(?:\\.[^\"\\]*)*)\"s ^\s*=\s*([^\s;,]*)s \\(.)c C s� t | t � s t � g } x�| D]�} | } g } xd| r�t j | � } | rt | � } | j d � } t j | � } | r� t | � } | j d � } t j d | � } nE t j | � } | r� t | � } | j d � } | j � } n d } | j | | f � q8 | j � j d � rR| j � d } | rI| j | � n g } q8 t j d d | � \ } } | d k s�t d | | | f � � | } q8 W| r# | j | � q# q# W| S( sm Parse header values into a list of lists containing key,value pairs. The function knows how to deal with ",", ";" and "=" as well as quoted values after "=". A list of space separated tokens are parsed as if they were separated by ";". If the header_values passed as argument contains multiple values, then they are treated as if they were a single value separated by comma ",". This means that this function is useful for parsing header fields that follow this syntax (BNF as from the HTTP/1.1 specification, but we relax the requirement for tokens). headers = #header header = (token | parameter) *( [";"] (token | parameter)) token = 1*<any CHAR except CTLs or separators> separators = "(" | ")" | "<" | ">" | "@" | "," | ";" | ":" | "\" | <"> | "/" | "[" | "]" | "?" | "=" | "{" | "}" | SP | HT quoted-string = ( <"> *(qdtext | quoted-pair ) <"> ) qdtext = <any TEXT except <">> quoted-pair = "\" CHAR parameter = attribute "=" value attribute = token value = token | quoted-string Each header is represented by a list of key/value pairs. The value for a simple token (not part of a parameter) is None. Syntactically incorrect headers will not necessarily be parsed as you would want. This is easier to describe with some examples: >>> split_header_words(['foo="bar"; port="80,81"; discard, bar=baz']) [[('foo', 'bar'), ('port', '80,81'), ('discard', None)], [('bar', 'baz')]] >>> split_header_words(['text/html; charset="iso-8859-1"']) [[('text/html', None), ('charset', 'iso-8859-1')]] >>> split_header_words([r'Basic realm="\"foo\bar\""']) [[('Basic', None), ('realm', '"foobar"')]] i s \1t ,s ^[=\s;]*R] i s& split_header_words bug: '%s', '%s', %sN( t isinstancet basestringt AssertionErrort HEADER_TOKEN_RERH Rp RJ t HEADER_QUOTED_VALUE_REt HEADER_ESCAPE_RERc t HEADER_VALUE_REt rstripR t appendRa t startswitht ret subn( t header_valuest resultRe t orig_textt pairsRM t namet valuet non_junkt nr_junk_chars( ( s! /usr/lib64/python2.7/cookielib.pyt split_header_wordsF sF - s ([\"\\])c C s� g } x� | D]� } g } xq | D]i \ } } | d k r| t j d | � si t j d | � } d | } n d | | f } n | j | � q W| r | j d j | � � q q Wd j | � S( s� Do the inverse (almost) of the conversion done by split_header_words. Takes a list of lists of (key, value) pairs and produces a single header value. Attribute values are quoted if needed. >>> join_header_words([[("text/plain", None), ("charset", "iso-8859/1")]]) 'text/plain; charset="iso-8859/1"' >>> join_header_words([[("text/plain", None)], [("charset", "iso-8859/1")]]) 'text/plain, charset="iso-8859/1"' s ^\w+$s \\\1s "%s"s %s=%ss ; s , N( R R| RH t HEADER_JOIN_ESCAPE_RERc Rz t join( t listst headersR� t attrt kt v( ( s! /usr/lib64/python2.7/cookielib.pyt join_header_words� s c C s< | j d � r | d } n | j d � r8 | d } n | S( Nt "i i����( R{ t endswith( Re ( ( s! /usr/lib64/python2.7/cookielib.pyt _strip_quotes� s c C sh d } g } xU| D]M} g } t } x t t j d | � � D]� \ } } | j � } | d k rh q> n d | k r� | d } } n' t j d | d � \ } } | j � } | d k r | j � } | | k r� | } n | d k r� t | � } t } n | d k r t t | � � } q n | j | | f � q> W| r | sP| j d � n | j | � q q W| S( s5 Ad-hoc parser for Netscape protocol cookie-attributes. The old Netscape cookie format for Set-Cookie can for instance contain an unquoted "," in the expires field, so we have to use this ad-hoc parser instead of split_header_words. XXX This may not make the best possible effort to parse all the crap that Netscape Cookie headers contain. Ronald Tschalar's HTTPClient parser is probably better, so could do worse than following that if this ever gives any trouble. Currently, this is also used for parsing RFC 2109 cookies. t expirest domaint patht securet versiont ports max-ages ;\s*R] t =s \s*=\s*i i t 0( s expiress domains paths secures versions ports max-ageN( s versionR� ( t Falset enumerateR| t splitRy R Ra RQ R� t TrueRg Rz ( t ns_headerst known_attrsR t ns_headerR� t version_sett iit paramR� R� t lc( ( s! /usr/lib64/python2.7/cookielib.pyt parse_ns_headers� s: % s \.\d+$c C sK t j | � r t S| d k r# t S| d d k sC | d d k rG t St S( s* Return True if text is a host domain name.R] i t .i����( t IPV4_RERH R� R� ( Re ( ( s! /usr/lib64/python2.7/cookielib.pyt is_HDN� s c C s� | j � } | j � } | | k r( t St | � s8 t S| j | � } | d k s_ | d k rc t S| j d � sv t St | d � s� t St S( s� Return True if domain A domain-matches domain B, according to RFC 2965. A and B may be host domain names or IP addresses. RFC 2965, section 1: Host names can be specified either as an IP address or a HDN string. Sometimes we compare one host name with another. (Such comparisons SHALL be case-insensitive.) Host A's name domain-matches host B's if * their host name strings string-compare equal; or * A is a HDN string and has the form NB, where N is a non-empty name string, B has the form .B', and B' is a HDN string. (So, x.y.com domain-matches .Y.com but not Y.com.) Note that domain-match is not a commutative operation: a.b.c.com domain-matches .c.com, but not the reverse. i����i R� i ( RQ R� R� R� t rfindR{ ( t At Bt i( ( s! /usr/lib64/python2.7/cookielib.pyt domain_match s c C s t j | � r t St S( sd Return True if text is a sort-of-like a host domain name. For accepting/blocking domains. ( R� RH R� R� ( Re ( ( s! /usr/lib64/python2.7/cookielib.pyt liberal_is_HDN' s c C s� | j � } | j � } t | � o- t | � sD | | k r@ t St S| j d � } | rl | j | � rl t S| r� | | k r� t St S( s\ For blocking/accepting domains. A and B may be host domain names or IP addresses. R� ( RQ R� R� R� R{ R� ( R� R� t initial_dot( ( s! /usr/lib64/python2.7/cookielib.pyt user_domain_match1 s s :\d+$c C s_ | j � } t j | � d } | d k r@ | j d d � } n t j d | d � } | j � S( s� Return request-host, as defined by RFC 2965. Variation from RFC: returned value is lowercased, for convenient comparison. i R] t Host( t get_full_urlt urlparset get_headert cut_port_reRc RQ ( t requestt urlt host( ( s! /usr/lib64/python2.7/cookielib.pyt request_hostF s c C sL t | � } } | j d � d k rB t j | � rB | d } n | | f S( sz Return a tuple (request-host, effective request-host name). As defined by RFC 2965, except both are lowercased. R� i����s .local( R� t findR� RH ( R� t erhnt req_host( ( s! /usr/lib64/python2.7/cookielib.pyt eff_request_hostV s % c C sJ | j � } t j | � } t | j � } | j d � sF d | } n | S( s6 Path component of request-URI, as defined by RFC 2965.t /( R� R� t urlsplitt escape_pathR� R{ ( R� R� t partsR� ( ( s! /usr/lib64/python2.7/cookielib.pyt request_patha s c C sr | j � } | j d � } | d k rh | | d } y t | � Wqn t k rd t d | � d SXn t } | S( Nt :i i s nonnumeric port: '%s'( t get_hostR� RI RR R R t DEFAULT_HTTP_PORT( R� R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt request_portk s s %/;:@&=+$,!~*'()s %([0-9a-fA-F][0-9a-fA-F])c C s d | j d � j � S( Ns %%%si ( RJ RU ( Rm ( ( s! /usr/lib64/python2.7/cookielib.pyt uppercase_escaped_char} s c C sI t | t � r! | j d � } n t j | t � } t j t | � } | S( sE Escape any invalid characters in HTTP URL, and uppercase all escapes.s utf-8( Rr t unicodet encodet urllibt quotet HTTP_PATH_SAFEt ESCAPED_CHAR_RERc R� ( R� ( ( s! /usr/lib64/python2.7/cookielib.pyR� s c C sk | j d � } | d k rg | | d } | j d � } t | � rg | d k s\ | d k rg d | Sn | S( sB Return reach of host h, as defined by RFC 2965, section 1. The reach R of a host name H is defined as follows: * If - H is the host domain name of a host; and, - H has the form A.B; and - A has no embedded (that is, interior) dots; and - B has at least one embedded dot, or B is the string "local". then the reach of H is .B. * Otherwise, the reach of H is H. >>> reach("www.acme.com") '.acme.com' >>> reach("acme.com") 'acme.com' >>> reach("acme.local") '.local' R� i i t local( R� R� ( t hR� t b( ( s! /usr/lib64/python2.7/cookielib.pyt reach� s $ c C s3 t | � } t | t | j � � � s+ t St Sd S( s� RFC 2965, section 3.3.6: An unverifiable transaction is to a third-party host if its request- host U does not domain-match the reach R of the request-host O in the origin transaction. N( R� R� R� t get_origin_req_hostR� R� ( R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt is_third_party� s c B sV e Z d Z e d � Z d � Z d d � Z d � Z d d � Z d � Z d � Z RS( s� HTTP Cookie. This class represents both Netscape and RFC 2965 cookies. This is deliberately a very simple class. It just holds attributes. It's possible to construct Cookie instances that don't comply with the cookie standards. CookieJar.make_cookies is the factory function for Cookie objects -- it deals with cookie parsing, supplying defaults, and normalising to the representation used in this class. CookiePolicy is responsible for checking them to see whether they should be accepted from and returned to the server. Note that the port may be present in the headers, but unspecified ("Port" rather than"Port=80", for example); if this is the case, port is None. c C s | d k r t | � } n | d k r6 t | � } n | d k r] | t k r] t d � � n | | _ | | _ | | _ | | _ | | _ | j � | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ t j | � | _ d S( Ns- if port is None, port_specified must be false( R RI R� RR R� R� R� R� t port_specifiedRQ R� t domain_specifiedt domain_initial_dotR� t path_specifiedR� R� t discardt commentt comment_urlt rfc2109t copyt _rest( t selfR� R� R� R� R� R� R� R� R� R� R� R� R� R� R� t restR� ( ( s! /usr/lib64/python2.7/cookielib.pyt __init__� s. c C s | | j k S( N( R� ( R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt has_nonstandard_attr� s c C s | j j | | � S( N( R� t get( R� R� t default( ( s! /usr/lib64/python2.7/cookielib.pyt get_nonstandard_attr s c C s | | j | <d S( N( R� ( R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt set_nonstandard_attr s c C sA | d k r t j � } n | j d k r= | j | k r= t St S( N( R R8 R� R� R� ( R� t now( ( s! /usr/lib64/python2.7/cookielib.pyt is_expired s c C sx | j d k r d } n d | j } | j | | j } | j d k ra d | j | j f } n | j } d | | f S( NR] R� s %s=%ss <Cookie %s for %s>( R� R R� R� R� R� ( R� t pt limitt namevalue( ( s! /usr/lib64/python2.7/cookielib.pyt __str__ s c C s� g } x: d D]2 } t | | � } | j d | t | � f � q W| j d t | j � � | j d t | j � � d d j | � S( NR� R� R� R� R� R� R� R� R� R� R� R� R� R� R� s %s=%ss rest=%ss rfc2109=%ss Cookie(%s)s , ( s versions names values ports port_specifieds domains domain_specifieds domain_initial_dots paths path_specifieds secures expiress discards comments comment_url( t getattrRz t reprR� R� R� ( R� R R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt __repr__ s !N( t __name__t __module__t __doc__R� R� R� R R� R� R� R� R� ( ( ( s! /usr/lib64/python2.7/cookielib.pyR � s c B s2 e Z d Z d � Z d � Z d � Z d � Z RS( s Defines which cookies get accepted from and returned to server. May also modify cookies, though this is probably a bad idea. The subclass DefaultCookiePolicy defines the standard rules for Netscape and RFC 2965 cookies -- override that if you want a customised policy. c C s t � � d S( s� Return true if (and only if) cookie should be accepted from server. Currently, pre-expired cookies never get this far -- the CookieJar class deletes such cookies itself. N( t NotImplementedError( R� t cookieR� ( ( s! /usr/lib64/python2.7/cookielib.pyt set_ok. s c C s t � � d S( sA Return true if (and only if) cookie should be returned to server.N( R� ( R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt return_ok7 s c C s t S( sM Return false if cookies should not be returned, given cookie domain. ( R� ( R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt domain_return_ok; s c C s t S( sK Return false if cookies should not be returned, given cookie path. ( R� ( R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt path_return_ok@ s ( R� R� R� R� R� R� R� ( ( ( s! /usr/lib64/python2.7/cookielib.pyR % s c B s# e Z d Z d Z d Z d Z d Z e e BZ d d e e d e e e e e e e d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z! RS( sB Implements the standard rules for accepting and returning cookies.i i i i c C s� | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ | d k rx t | � | _ n d | _ | d k r� t | � } n | | _ d S( sA Constructor arguments should be passed as keyword arguments only.N( ( t netscapet rfc2965t rfc2109_as_netscapet hide_cookie2t strict_domaint strict_rfc2965_unverifiablet strict_ns_unverifiablet strict_ns_domaint strict_ns_set_initial_dollart strict_ns_set_pathR t tuplet _blocked_domainst _allowed_domains( R� t blocked_domainst allowed_domainsR� R� R� R� R� R� R� R� R R ( ( s! /usr/lib64/python2.7/cookielib.pyR� P s c C s | j S( s4 Return the sequence of blocked domains (as a tuple).( R ( R� ( ( s! /usr/lib64/python2.7/cookielib.pyR q s c C s t | � | _ d S( s$ Set the sequence of blocked domains.N( R R ( R� R ( ( s! /usr/lib64/python2.7/cookielib.pyt set_blocked_domainst s c C s+ x$ | j D] } t | | � r t Sq Wt S( N( R R� R� R� ( R� R� t blocked_domain( ( s! /usr/lib64/python2.7/cookielib.pyt is_blockedx s c C s | j S( s= Return None, or the sequence of allowed domains (as a tuple).( R ( R� ( ( s! /usr/lib64/python2.7/cookielib.pyR ~ s c C s( | d k r t | � } n | | _ d S( s- Set the sequence of allowed domains, or None.N( R R R ( R� R ( ( s! /usr/lib64/python2.7/cookielib.pyt set_allowed_domains� s c C s> | j d k r t Sx$ | j D] } t | | � r t Sq Wt S( N( R R R� R� R� ( R� R� t allowed_domain( ( s! /usr/lib64/python2.7/cookielib.pyt is_not_allowed� s c C sl t d | j | j � | j d k s+ t � x: d D]2 } d | } t | | � } | | | � s2 t Sq2 Wt S( s� If you override .set_ok(), be sure to call this method. If it returns false, so should your subclass (assuming your subclass wants to be more strict about which cookies to accept). s - checking cookie %s=%sR� t verifiabilityR� R� R� R� t set_ok_N( s versionR s names paths domains port( R R� R� R Rt R� R� R� ( R� R� R� t nt fn_namet fn( ( s! /usr/lib64/python2.7/cookielib.pyR� � s c C s{ | j d k r) t d | j | j � t S| j d k rP | j rP t d � t S| j d k rw | j rw t d � t St S( Ns0 Set-Cookie2 without version attribute (%s=%s)i s$ RFC 2965 cookies are switched offs$ Netscape cookies are switched off( R� R R R� R� R� R� R� R� ( R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt set_ok_version� s c C sk | j � rg t | � rg | j d k r> | j r> t d � t S| j d k rg | j rg t d � t Sn t S( Ni s> third-party RFC 2965 cookie during unverifiable transactions> third-party Netscape cookie during unverifiable transaction( t is_unverifiableR� R� R� R R� R� R� ( R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt set_ok_verifiability� s c C sB | j d k r> | j r> | j j d � r> t d | j � t St S( Ni t $s' illegal name (starts with '$'): '%s'( R� R R� R{ R R� R� ( R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt set_ok_name� s c C sm | j ri t | � } | j d k s< | j d k ri | j ri | j | j � ri t d | j | � t Sn t S( Ni s7 path attribute %s is not a prefix of request path %s( R� R� R� R R{ R� R R� R� ( R� R� R� t req_path( ( s! /usr/lib64/python2.7/cookielib.pyt set_ok_path� s c C s� | j | j � r& t d | j � t S| j | j � rL t d | j � t S| j r�t | � \ } } | j } | j r| j d � d k r| j d � } | j d d | � } | d k r| | d } | | d | !} | j � d" k rt | � d k rt d | � t Sqn | j d � r4| d } n | } | j d � d k } | rs| d k rst d | � t S| j d k r�| j | � r�| j d � r�d | j | � r�t d | | � t Sn | j d k s�| j | j @rt | | � st d | | � t Sn | j d k s1| j | j @r�| t | � } | j d � d k r~t j | � r~t d! | | � t Sq�n t S(# Ns" domain %s is in user block-lists& domain %s is not in user allow-listR� i i i t cot act comt edut orgt nett govt milRI t aerot bizt catt coopt infot jobst mobit museumR� t prot travelt eus& country-code second level domain %ss .locals/ non-local domain %s contains no embedded dotsO effective request-host %s (even with added initial dot) does not end with %ss5 effective request-host %s does not domain-match %ss. host prefix %s for domain %s contains a dot( s coR R R R R R R s intR! R" s catR$ s infoR& R' R( s nameR) R* R+ ( R R� R R� R R� R� R� t countR� RQ t lenR{ R� R� R� R� t DomainRFC2965MatchR� t DomainStrictNoDotsR� RH R� ( R� R� R� R� R� R� R� t jt tldt sldt undotted_domaint embedded_dotst host_prefix( ( s! /usr/lib64/python2.7/cookielib.pyt set_ok_domain� sf c C s� | j r� t | � } | d k r* d } n t | � } xt | j j d � D]F } y t | � Wn t k r~ t d | � t SX| | k rI PqI qI Wt d | | j � t Sn t S( Nt 80Rq s bad port %s (not numeric)s$ request port (%s) not found in %s( R� R� R t strR� R� RI RR R R� R� ( R� R� R� t req_portR� ( ( s! /usr/lib64/python2.7/cookielib.pyt set_ok_port s" c C sW t d | j | j � x: d D]2 } d | } t | | � } | | | � s t Sq Wt S( s� If you override .return_ok(), be sure to call this method. If it returns false, so should your subclass (assuming your subclass wants to be more strict about which cookies to return). s - checking cookie %s=%sR� R R� R� R� R� t return_ok_( s versions verifiabilitys secures expiress ports domain( R R� R� R� R� R� ( R� R� R� R R R ( ( s! /usr/lib64/python2.7/cookielib.pyR� ! s c C sR | j d k r' | j r' t d � t S| j d k rN | j rN t d � t St S( Ni s$ RFC 2965 cookies are switched offs$ Netscape cookies are switched off( R� R� R R� R� R� ( R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt return_ok_version3 s c C sk | j � rg t | � rg | j d k r> | j r> t d � t S| j d k rg | j rg t d � t Sn t S( Ni s> third-party RFC 2965 cookie during unverifiable transactions> third-party Netscape cookie during unverifiable transaction( R R� R� R� R R� R� R� ( R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt return_ok_verifiability< s c C s- | j r) | j � d k r) t d � t St S( Nt httpss( secure cookie with non-secure request( R� t get_typeR R� R� ( R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt return_ok_secureH s c C s$ | j | j � r t d � t St S( Ns cookie expired( R� t _nowR R� R� ( R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt return_ok_expiresN s c C su | j rq t | � } | d k r* d } n xD | j j d � D] } | | k r= Pq= q= Wt d | | j � t Sn t S( NR7 Rq s0 request port %s does not match cookie port %s( R� R� R R� R R� R� ( R� R� R� R9 R� ( ( s! /usr/lib64/python2.7/cookielib.pyt return_ok_portT s c C s� t | � \ } } | j } | r> | j d � r> d | } n | } | j d k r� | j | j @r� | j r� | | k r� t d � t S| j d k r� t | | � r� t d | | � t S| j d k r� d | j | � r� t d | | � t St S( NR� i sQ cookie with unspecified domain does not string-compare equal to request domainsQ effective request-host name %s does not domain-match RFC 2965 cookie domain %ss; request-host %s does not match Netscape cookie domain %s( R� R� R{ R� R� t DomainStrictNonDomainR� R R� R� R� R� ( R� R� R� R� R� R� t dotdomain( ( s! /usr/lib64/python2.7/cookielib.pyt return_ok_domainb s& # c C s� t | � \ } } | j d � s. d | } n | j d � sJ d | } n | rm | j d � rm d | } n | } | j | � p� | j | � s� t S| j | � r� t d | � t S| j | � r� t d | � t St S( NR� s" domain %s is in user block-lists& domain %s is not in user allow-list( R� R{ R� R� R R R R� ( R� R� R� R� R� RE ( ( s! /usr/lib64/python2.7/cookielib.pyR� } s" c C s@ t d | � t | � } | j | � s< t d | | � t St S( Ns - checking cookie path=%ss %s does not path-match %s( R R� R{ R� R� ( R� R� R� R ( ( s! /usr/lib64/python2.7/cookielib.pyR� � s N(" R� R� R� R/ RD R. t DomainLiberalt DomainStrictR R� R� R� R R R R R R R� R R R R R6 R: R� R< R= R@ RB RC RF R� R� ( ( ( s! /usr/lib64/python2.7/cookielib.pyR F sL ; c C s& | j � } | j � t | j | � S( N( t keyst sortt mapR� ( t adictRI ( ( s! /usr/lib64/python2.7/cookielib.pyt vals_sorted_by_key� s c c sv t | � } xc | D][ } t } y | j Wn t k r= n# Xt } x t | � D] } | VqQ W| s | Vq q Wd S( sB Iterates over nested mapping, depth-first, in sorted order by key.N( RM R� t itemst AttributeErrorR� t deepvalues( t mappingt valuest objt subobj( ( s! /usr/lib64/python2.7/cookielib.pyRP � s t Absentc B s e Z RS( ( R� R� ( ( ( s! /usr/lib64/python2.7/cookielib.pyRU � s c B s( e Z d Z e j d � Z e j d � Z e j d � Z e j d � Z e j d � Z d Z d d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d d d d � Z d � Z d � Z d � Z d � Z d � Z d � Z RS( s� Collection of HTTP cookies. You may not need to know about this class: try urllib2.build_opener(HTTPCookieProcessor).open(url). s \Ws ([\"\\])s \.?[^.]*s [^.]*s ^\.+s ^\#LWP-Cookies-(\d+\.\d+)c C s= | d k r t � } n | | _ t j � | _ i | _ d S( N( R R t _policyt _threadingt RLockt _cookies_lockt _cookies( R� t policy( ( s! /usr/lib64/python2.7/cookielib.pyR� � s c C s | | _ d S( N( RV ( R� R[ ( ( s! /usr/lib64/python2.7/cookielib.pyt set_policy� s c C s� g } | j j | | � s g St d | � | j | } x� | j � D]~ } | j j | | � sg qF n | | } xP | j � D]B } | j j | | � s� t d � q~ n t d � | j | � q~ WqF W| S( Ns! Checking %s for cookies to returns not returning cookies it's a match( RV R� R RZ RI R� RR R� Rz ( R� R� R� t cookiest cookies_by_pathR� t cookies_by_nameR� ( ( s! /usr/lib64/python2.7/cookielib.pyt _cookies_for_domain� s c C s= g } x0 | j j � D] } | j | j | | � � q W| S( s2 Return a list of cookies to be returned to server.( RZ RI t extendR` ( R� R� R] R� ( ( s! /usr/lib64/python2.7/cookielib.pyt _cookies_for_request� s c C s� | j d d � d t � t } g } x�| D]�} | j } | sj t } | d k rj | j d | � qj n | j d k r� | j j | j � r� | d k r� | j j d | j � } n | j } | j d k r� | j | j � n | j d | j | f � | d k r, | j r&| j d | j � n | j j d � r{| j } | j rg| j d � rg| d } n | j d | � n | j d k r�d } | j r�| d | j } n | j | � q�q, q, W| S( s� Return a list of cookie-attributes to be returned to server. like ['foo="bar"; $Path="/"', ...] The $Version attribute is also added when appropriate (currently only once per request). t keyc S s t | j � S( N( R- R� ( t arg( ( s! /usr/lib64/python2.7/cookielib.pyt <lambda>� s t reversei s $Version=%ss \\\1s %s=%ss $Path="%s"R� i s $Domain="%s"s $Ports ="%s"N( RJ R� R� R� Rz R� R t non_word_reRH t quote_reRc R� R� R� R� R{ R� R� R� ( R� R] R� t attrsR� R� R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt _cookie_attrs� s> ! c C s t d � | j j � z� t t j � � | j _ | _ | j | � } | j | � } | r� | j d � s� | j d d j | � � q� n | j j r� | j j r� | j d � r� x4 | D]) } | j d k r� | j d d � Pq� q� Wn Wd | j j � X| j � d S( s� Add correct Cookie: header to request (urllib2.Request object). The Cookie2 header is also added unless policy.hide_cookie2 is true. t add_cookie_headerR s ; t Cookie2i s $Version="1"N( R RY t acquireRI R8 RV RA Rb Rj t has_headert add_unredirected_headerR� R� R� R� t releaset clear_expired_cookies( R� R� R] Ri R� ( ( s! /usr/lib64/python2.7/cookielib.pyRk ) s$ c C s g } d } d } x| D]�} | d \ } } t } t } i } i } x�| d D]�\ } } | j � } | | k s� | | k r� | } n | | k r� | d k r� t } n | | k r� qR n | d k r� | d k r� t d � t } Pn | j � } n | d k r0| rqR n | d k r0t d � qR q0n | d k r�t } y t | � } Wn" t k rvt d � t } Pn Xd } | j | } n | | k s�| | k r�| d k r�| d k r�t d | � t } Pn | | | <qR | | | <qR W| r�q n | j | | | | f � q W| S( s Return list of tuples containing normalised cookie information. attrs_set is the list of lists of key,value pairs extracted from the Set-Cookie or Set-Cookie2 headers. Tuples are name, value, standard, rest, where name and value are the cookie name and value, standard is a dictionary containing the standard cookie-attributes (discard, secure, version, expires or max-age, domain, path and port) and rest is a dictionary containing the rest of the cookie-attributes. R� R� R� R� s max-ageR� R� R� R� t commenturli i s% missing value for domain attributesM missing or invalid value for expires attribute: treating as session cookies? missing or invalid (non-numeric) value for max-age attributes! missing value for %s attribute( s discards secure( s versions expiress max-ages domains paths ports commentRr N( s ports commentRr ( R� RQ R R� R RI RR RA Rz ( R� t attrs_sett cookie_tuplest boolean_attrst value_attrst cookie_attrsR� R� t max_age_sett bad_cookiet standardR� R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt _normalized_cookie_tuplesJ sl c C s� | \ } } } } | j d t � } | j d t � } | j d t � } | j d t � } | j d d � } | d k r� y t | � } Wq� t k r� d SXn | j d t � } | j d t � } | j d d � } | j d d � } | t k r| d k rt } t | � } nr t } t | � } | j d � } | d k rl| d k r[| | } ql| | d } n t | � d k r�d } n | t k } t } | r�t | j d � � } n | t k r�t | � \ } } | } n | j d � s�d | } n t } | t k rE| d k r't | � } qKt } t j d d | � } n d } | t k rfd } t } nQ | | j k r�y | j | | | � Wn t k r�n Xt d | | | � d St | | | | | | | | | | | | | | | | � S( NR� R� R� R� R� R� R� R� Rr R] R� i����i i R� s \s+s2 Expiring cookie, domain='%s', path='%s', name='%s'( R� RU R RI RR R� R� R� R� R� R- t boolR{ R� R� R| Rc RA t cleart KeyErrorR R ( R� t tupR� R� R� Rz R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt _cookie_from_cookie_tuple� s� c C sR | j | � } g } x6 | D]. } | j | | � } | r | j | � q q W| S( N( R{ R� Rz ( R� Rs R� Rt R] R R� ( ( s! /usr/lib64/python2.7/cookielib.pyt _cookies_from_attrs_set s c C ss t | j d d � } | d k r1 | j j } n x; | D]3 } | j d k r8 t | _ | rk d | _ qk q8 q8 Wd S( NR� i i ( R� RV R R� R� R� R� ( R� R] t rfc2109_as_nsR� ( ( s! /usr/lib64/python2.7/cookielib.pyt _process_rfc2109_cookies s c C s� | j � } | j d � } | j d � } | j j } | j j } | rP | sz | r^ | sz | rl | sz | r~ | r~ g Sy | j t | � | � } Wn t k r� t � g } n X| r�| r�y | j t | � | � } Wn t k rt � g } n X| j | � | rhi } x* | D]" } d | | j | j | j f <q$W| d � } t | | � } n | r�| j | � q�n | S( sA Return sequence of Cookie objects extracted from response object.s Set-Cookie2s Set-Cookiec S s" | j | j | j f } | | k S( N( R� R� R� ( t ns_cookiet lookupRc ( ( s! /usr/lib64/python2.7/cookielib.pyt no_matching_rfc2965H s N( R% t getheadersRV R� R� R� R� t ExceptionR R� R� R R� R� R� t filterRa ( R� t responseR� R� t rfc2965_hdrst ns_hdrsR� R� R] t ns_cookiesR� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt make_cookies sB c C sj | j j � zH t t j � � | j _ | _ | j j | | � rT | j | � n Wd | j j � Xd S( s- Set a cookie if policy says it's OK to do so.N( RY Rm RI R8 RV RA R� t set_cookieRp ( R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt set_cookie_if_okR s c C s� | j } | j j � zi | j | k r8 i | | j <n | | j } | j | k rd i | | j <n | | j } | | | j <Wd | j j � Xd S( s? Set a cookie, without checking whether or not it should be set.N( RZ RY Rm R� R� R� Rp ( R� R� t ct c2t c3( ( s! /usr/lib64/python2.7/cookielib.pyR� _ s c C s� t d | j � � | j j � zr t t j � � | j _ | _ xL | j | | � D]8 } | j j | | � rU t d | � | j | � qU qU WWd | j j � Xd S( sA Extract cookies from response, where allowable given the request.s extract_cookies: %ss setting cookie: %sN( R R% RY Rm RI R8 RV RA R� R� R� Rp ( R� R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt extract_cookiesl s c C s� | d k rH | d k s$ | d k r3 t d � � n | j | | | =nZ | d k r� | d k ro t d � � n | j | | =n" | d k r� | j | =n i | _ d S( s� Clear some cookies. Invoking this method without arguments will clear all cookies. If given a single argument, only cookies belonging to that domain will be removed. If given two arguments, cookies belonging to the specified path within that domain are removed. If given three arguments, then the cookie with the specified name, path and domain is removed. Raises KeyError if no matching cookie exists. s8 domain and path must be given to remove a cookie by names. domain must be given to remove cookies by pathN( R RR RZ ( R� R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyR} z s c C s_ | j j � z= x6 | D]. } | j r | j | j | j | j � q q WWd | j j � Xd S( s� Discard all session cookies. Note that the .save() method won't save session cookies anyway, unless you ask otherwise by passing a true ignore_discard argument. N( RY Rm R� R} R� R� R� Rp ( R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt clear_session_cookies� s 'c C sq | j j � zO t j � } x< | D]4 } | j | � r# | j | j | j | j � q# q# WWd | j j � Xd S( s� Discard all expired cookies. You probably don't need to call this method: expired cookies are never sent back to the server (provided you're using DefaultCookiePolicy), this method is called by CookieJar itself every so often, and the .save() method won't save expired cookies anyway (unless you ask otherwise by passing a true ignore_expires argument). N( RY Rm R8 R� R} R� R� R� Rp ( R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyRq � s 'c C s t | j � S( N( RP RZ ( R� ( ( s! /usr/lib64/python2.7/cookielib.pyt __iter__� s c C s% d } x | D] } | d } q W| S( s# Return number of contained cookies.i i ( ( R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyt __len__� s c C sD g } x! | D] } | j t | � � q Wd | j d j | � f S( Ns <%s[%s]>s , ( Rz R� t __class__R� ( R� t rR� ( ( s! /usr/lib64/python2.7/cookielib.pyR� � s c C sD g } x! | D] } | j t | � � q Wd | j d j | � f S( Ns <%s[%s]>s , ( Rz R8 R� R� ( R� R� R� ( ( s! /usr/lib64/python2.7/cookielib.pyR� � s N(! R� R� R� R| t compileRg Rh t strict_domain_ret domain_ret dots_ret magic_reR R� R\ R` Rb Rj Rk R{ R� R� R� R� R� R� R� R} R� Rq R� R� R� R� ( ( ( s! /usr/lib64/python2.7/cookielib.pyR � s8 ; ! a \ 6 c B s e Z RS( ( R� R� ( ( ( s! /usr/lib64/python2.7/cookielib.pyR � s c B sV e Z d Z d e d d � Z d e e d � Z d e e d � Z d e e d � Z RS( s6 CookieJar that can be loaded from and saved to a file.c C s] t j | | � | d k rA y | d WqA t d � � qA Xn | | _ t | � | _ d S( s} Cookies are NOT loaded from the named file until either the .load() or .revert() method is called. R] s filename must be string-likeN( R R� R RR t filenameR| t delayload( R� R� R� R[ ( ( s! /usr/lib64/python2.7/cookielib.pyR� � s c C s t � � d S( s Save cookies to a file.N( R� ( R� R� t ignore_discardt ignore_expires( ( s! /usr/lib64/python2.7/cookielib.pyt save� s c C sn | d k r6 | j d k r' | j } q6 t t � � n t | � } z | j | | | | � Wd | j � Xd S( s Load cookies from a file.N( R R� RR t MISSING_FILENAME_TEXTt opent _really_loadt close( R� R� R� R� R ( ( s! /usr/lib64/python2.7/cookielib.pyt load� s c C s� | d k r6 | j d k r' | j } q6 t t � � n | j j � z\ t j | j � } i | _ y | j | | | � Wn# t t f k r� | | _ � n XWd | j j � Xd S( s� Clear all cookies and reload cookies from a saved file. Raises LoadError (or IOError) if reversion is not successful; the object's state will not be altered if this happens. N( R R� RR R� RY Rm R� t deepcopyRZ R� R t IOErrorRp ( R� R� R� R� t old_state( ( s! /usr/lib64/python2.7/cookielib.pyt revert� s N( R� R� R� R R� R� R� R� R� ( ( ( s! /usr/lib64/python2.7/cookielib.pyR � s ( R R ( R (X R� t __all__R| R� R� R8 R� t threadingRW t ImportErrort dummy_threadingt httplibt calendarR R� R R R R R8 t HTTP_PORTR� R� R R R$ R= R> RO R Rz RQ R< R@ RF R� RG RN R\ R^ t IRb t XRd Rg Rh Rj Rp Ru Rv Rx Rw R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R� R R R RM RP RU R R� R R t _LWPCookieJarR R t _MozillaCookieJarR ( ( ( s! /usr/lib64/python2.7/cookielib.pyt <module> s� < " 5 8 ! U 4 ' # b!� [ � � <