| Current Path : /usr/local/lib/python2.5/ |
FreeBSD hs32.drive.ne.jp 9.1-RELEASE FreeBSD 9.1-RELEASE #1: Wed Jan 14 12:18:08 JST 2015 root@hs32.drive.ne.jp:/sys/amd64/compile/hs32 amd64 |
| Current File : //usr/local/lib/python2.5/urllib.pyc |
hRc # @ sv d Z d d k Z d d k Z d d k Z d d k Z d d k Z d d k l Z d d d d d d d
d d d
d d d d d d d d d d d d d d d d d d d g Z d! Z
d" Z e i d# j o d d$ k
l Z l Z ng e i d% j o d d$ k l Z l Z n= e i d& j o d d$ k l Z l Z n d' Z d( Z e a e e d) Z e e e d* Z d+ Z d, e f d- YZ h Z d f d. YZ d e f d/ YZ e a d0 Z e a d1 Z e a d2 Z! e a" d3 Z# d4 f d5 YZ$ d6 f d7 YZ% d8 e% f d9 YZ& d: e% f d; YZ' d< e% f d= YZ( y e) Wn e* j
o d> Z+ n Xd? Z+ d@ Z, dA Z- e a. dB Z/ e a0 dC Z1 e a2 dD Z3 e a4 dE Z5 e a6 dF Z7 e a8 d dG Z9 e a: dH Z; e a< dI Z= dJ Z> e a? dK Z@ dL ZA eB dM eC dN D ZD eD iE dO eC dN D dP ZF dQ ZG dR ZH h ZI dS dT ZJ dU dV ZK dW dX ZL dY ZM e iN dZ j o d[ ZO d\ ZP d] ZQ n? e i d% j o d^ ZR d_ ZQ d` ZP n eM ZQ da ZP db ZS dc ZT g dd ZU de ZV eW df j o eV n d S(g s Open an arbitrary URL.
See the following document for more info on URLs:
"Names and Addresses, URIs, URLs, URNs, URCs", at
http://www.w3.org/pub/WWW/Addressing/Overview.html
See also the HTTP spec (from which the error codes are derived):
"HTTP - Hypertext Transfer Protocol", at
http://www.w3.org/pub/WWW/Protocols/
Related standards and specs:
- RFC1808: the "relative URL" spec. (authoritative status)
- RFC1738 - the "URL standard". (authoritative status)
- RFC1630 - the "URI spec". (informational status)
The object returned by URLopener().open(file) will differ per
protocol. All you know is that is has methods read(), readline(),
readlines(), fileno(), close() and info(). The read*(), fileno()
and close() methods work like those of open files.
The info() method returns a mimetools.Message object which can be
used to query various info about the object, if available.
(mimetools.Message objects are queried with the getheader() method.)
iN( t urljoint urlopent URLopenert FancyURLopenert urlretrievet
urlcleanupt quotet
quote_plust unquotet unquote_plust urlencodet url2pathnamet pathname2urlt splittagt localhostt thishostt ftperrorst basejoint unwrapt splittypet splithostt splitusert splitpasswdt splitportt
splitnportt
splitqueryt splitattrt
splitvaluet splitgophertypet
getproxiess 1.17i
t mac( R R t ntt riscosc C s
t | S( s OS-specific conversion from a relative URL of the 'file' scheme
to a file system path; not recommended for general use.( R ( t pathname( ( s" /usr/local/lib/python2.5/urllib.pyR 4 s c C s
t | S( s OS-specific conversion from a file system path to a relative URL
of the 'file' scheme; not recommended for general use.( R ( R! ( ( s" /usr/local/lib/python2.5/urllib.pyR 9 s c C sr | d j o t d | } n! t p t } | a n t } | d j o | i | Sn | i | | Sd S( s. urlopen(url [, data]) -> open file-like objectt proxiesN( t NoneR t
_urlopenert open( t urlt dataR" t opener( ( s" /usr/local/lib/python2.5/urllib.pyR G s
c C s* t p
t a n t i | | | | S( N( R$ R t retrieve( R& t filenamet
reporthookR' ( ( s" /usr/local/lib/python2.5/urllib.pyR U s
c C s t o t i n d S( N( R$ t cleanup( ( ( s" /usr/local/lib/python2.5/urllib.pyR Z s t ContentTooShortErrorc B s e Z d Z RS( c C s t i | | | | _ d S( N( t IOErrort __init__t content( t selft messageR0 ( ( s" /usr/local/lib/python2.5/urllib.pyR/ ` s ( t __name__t
__module__R/ ( ( ( s" /usr/local/lib/python2.5/urllib.pyR- _ s c B s e Z d Z d Z d e Z d d Z d Z d Z d Z
d Z d d Z d d Z
d d Z d d d d
Z d d Z d d Z d
Z e e d o d d Z n d Z d Z d Z d Z d d Z RS( s, Class to open URLs.
This is a class rather than just a subroutine because we may need
more than one set of global protocol-specific options.
Note -- this is a base class for those who don't want the
automatic handling of errors type 302 (relocated) and 401
(authorization needed).s Python-urllib/%sc K s | d j o
t } n t | d p
t d | | _ | i d | _ | i d | _ d | i f g | _ g | _
t i | _
d | _ t | _ d S( Nt has_keys proxies must be a mappingt key_filet cert_files
User-Agent( R# R t hasattrt AssertionErrorR" t getR6 R7 t versiont
addheaderst _URLopener__tempfilest ost unlinkt _URLopener__unlinkt tempcachet ftpcache( R1 R" t x509( ( s" /usr/local/lib/python2.5/urllib.pyR/ r s
c C s | i d S( N( t close( R1 ( ( s" /usr/local/lib/python2.5/urllib.pyt __del__ s c C s | i d S( N( R, ( R1 ( ( s" /usr/local/lib/python2.5/urllib.pyRD s c C so | i oF x8 | i D]- } y | i | Wq t j
o q Xq W| i 2n | i o | i i n d S( N( R= R@ t OSErrorRA t clear( R1 t file( ( s" /usr/local/lib/python2.5/urllib.pyR, s
c G s | i i | d S( sd Add a header to be used by the HTTP interface only
e.g. u.addheader('Accept', 'sound/basic')N( R< t append( R1 t args( ( s" /usr/local/lib/python2.5/urllib.pyt addheader s c C s t t | } | i oF | | i j o6 | i | \ } } t | d } t | | | Sn t | \ } } | p
d } n | | i j oA | i | } t | \ } } t | \ }
} |
| f } n d } d | } | | _ | i
d d } t | | p2 | o | i | | | SqC| i
| | Sn y> | d j o t | | | Sn t | | | | SWn4 t i j
o% }
t d |
f t i d n Xd S( s6 Use URLopener().open(file) instead of open(file, 'r').t rbRH t open_t -t _s socket errori N( R t toBytesRA R% t
addinfourlR R" R R# t typet replaceR8 t open_unknown_proxyt open_unknownt getattrt sockett errorR. t syst exc_info( R1 t fullurlR' R* t headerst fpt urltypeR& t proxyt proxyhostt hostt selectort namet msg( ( s" /usr/local/lib/python2.5/urllib.pyR% s6
c C s( t | \ } } t d d | f d S( s/ Overridable interface to open unknown URL type.s url errors unknown url typeN( R R. ( R1 R[ R' RR R& ( ( s" /usr/local/lib/python2.5/urllib.pyRU s c C s, t | \ } } t d d | | f d S( s/ Overridable interface to open unknown URL type.s url errors invalid proxy for %sN( R R. ( R1 R_ R[ R' RR R& ( ( s" /usr/local/lib/python2.5/urllib.pyRT s c C s t t | } | i o | | i j o | i | Sn t | \ } } | d j om | p
| d j oX y< | i | } | i } ~ t t | d | f SWq t j
o } q Xn | i
| | } | i }
| o t
| d } n d d k } t | \ }
} t | p d \ }
} t | p d \ } }
t
| p d \ } }
t i i | d } | i | \ } } | i i | t i | d } | |
f } | i d j o | | i | <n d
} d } d } d } | o5 d
|
j o t |
d } n | | | | n xf | i | } | d j o Pn | t | 7} | i | | d 7} | o | | | | q9q9| i | i ~ ~ | d j o* | | j o t d | | f | n | S( st retrieve(url) returns (filename, headers) for a local object
or (tempfilename, headers) for a remote object.RH i t wbiNt i i i s content-lengths Content-Lengths1 retrieval incomplete: got only %i out of %i bytesi ( R RP RA R R# t open_local_filet infoR R R. R% t tempfileR R R> t patht splitextt mkstempR= RI t fdopent intt readt lent writeRD R- ( R1 R& R* R+ R' RR t url1R] t hdrsRd R\ t tfpRi t garbageRj t suffixt fdt resultt bst sizeRo t blocknumt block( ( s" /usr/local/lib/python2.5/urllib.pyR) sj "
c C sX d d k } d } d } t | t oE t | \ } } | o" t | \ } } t | } n | } n | \ } } t | \ } } t | \ } }
|
} d } | i d j o
d } ne t |
\ } }
| o t | \ } } n | o d | | |
f } n t | o
| } n | p
t
d n | o% d d k } | i | i
} n d } | o% d d k } | i | i
}
n d }
| i | } | d j o> | i d | | i d d | i d
d t | n | i d | | o | i d
d | n |
o | i d d |
n | o | i d | n x | i D] } | i | qoW| i | d j o | i | n | i \ } } } | d j o
t
d n | i } | d j o t | | d | SnG | d j o | i | | | | | Sn | i | | | | | | Sd S( s Use HTTP protocol.iNt https %s://%s%ss
http errors
no host givent POSTs Content-Types! application/x-www-form-urlencodeds Content-Lengths %dt GETs Proxy-Authorizations Basic %st
Authorizationt Hosts http protocol errori s got a bad status linei s http:( s
http errors
no host given( s http protocol errori s got a bad status lineN( t httplibR# t
isinstancet strR R R R t lowert proxy_bypassR. t base64t b64encodet stript HTTPt
putrequestt putheaderRp R< t
endheaderst sendt getreplyt getfileRQ t
http_error( R1 R& R' R t user_passwdt proxy_passwdRa Rb t realhostR^ t restR t
proxy_autht autht hRJ t errcodet errmsgR\ R] ( ( s" /usr/local/lib/python2.5/urllib.pyt open_http sz
c
C s d | } t | | of t | | } | d j o | | | | | | } n | | | | | | | } | o | Sq n | i | | | | | S( s Handle http errors.
Derived class can override this, or provide specific handlers
named http_error_DDD where DDD is the 3-digit error code.s
http_error_%dN( R8 RV R# t http_error_default(
R1 R& R] R R R\ R' Rc t methodRx ( ( s" /usr/local/lib/python2.5/urllib.pyR V s
c C s/ | i } | i t d | | | f d S( s> Default error handler: close the connection and raise IOError.s
http errorN( Ro RD R. ( R1 R& R] R R R\ t void( ( s" /usr/local/lib/python2.5/urllib.pyR e s
t sslc C sV d d k } d } d } t | t oE t | \ } } | o" t | \ } } t | } n | } n | \ } } t | \ } } t | \ } }
|
} d } | i d j o
d } nN t |
\ } }
| o t | \ } } n | o d | | |
f } n | p
t d n | o% d d k
} | i | i } n d } | o% d d k
} | i | i }
n d }
| i
| d d | i d | i } | d j o> | i d
| | i d d | i d
d t | n | i d | | o | i d d | n |
o | i d d |
n | o | i d | n x | i D] } | i | qmW| i | d j o | i | n | i \ } } } | d j o
t d n | i } | d j o t | | d | SnG | d j o | i | | | | | Sn | i | | | | | | Sd S( s Use HTTPS protocol.iNt httpss %s://%s%ss https errors
no host giveni R6 R7 R~ s Content-Types! application/x-www-form-urlencodeds Content-Lengths %dR s Proxy-Authorizations Basic %sR R s http protocol errors got a bad status linei s https:( s https errors
no host given( s http protocol errori s got a bad status lineN( R R# R R R R R R R R. R R R t HTTPSR6 R7 R R Rp R< R R R R RQ R ( R1 R& R' R R R Ra Rb R R^ R R R R R RJ R R R\ R] ( ( s" /usr/local/lib/python2.5/urllib.pyt
open_httpsl s~
c C s t | t p
t d n d d k } t | \ } } | p
t d n t | } t | \ } } t | \ } } t | } | o% t | } | i | | | } n | i | | } t
| t d | S( s Use Gopher protocol.s gopher errors; proxy support for gopher protocol currently not implementediNs
no host givens gopher:( s gopher errors; proxy support for gopher protocol currently not implemented( s gopher errors
no host given( R R R. t gopherlibR R R R t
send_queryt
send_selectorRQ t noheaders( R1 R& R Ra Rb RR t queryR] ( ( s" /usr/local/lib/python2.5/urllib.pyt open_gopher s
c C s~ t | t p
t d
n | d d j o? | d d !d j o+ | d d !i d j o | i | Sn | i | Sd S( s/ Use local file or FTP depending on form of URL.s
file errors9 proxy support for file protocol currently not implementedi s //i t /i s
localhost/N( s
file errors9 proxy support for file protocol currently not implemented( R R R. R t open_ftpRg ( R1 R& ( ( s" /usr/local/lib/python2.5/urllib.pyt open_file s
?c C s d d k } d d k } d d k } y d d k l } Wn# t j
o d d k l } n Xt | \ } } t | } y t i | } Wn0 t
j
o$ }
t |
i |
i
|
i n X| i } | i i | i d t } | i | d }
| i | d |
p d | | f } | pB | } | d d j o d
| } n t t | d | | Sn t | \ } } | od t i | t t f j oB | } | d d j o d
| } n t t | d | | Sn t d d S( s Use local file.iN( t StringIOt usegmti s6 Content-Type: %s
Content-Length: %d
Last-modified: %s
s
text/plaini R s file://RL s local file errors not on local host( s local file errors not on local host( t mimetypest mimetoolst email.Utilst cStringIOR t ImportErrorR R R> t statRF R. t errnot strerrorR* t st_sizet Utilst
formatdatet st_mtimet Truet
guess_typet MessageRQ R% R RW t
gethostbynameR R ( R1 R& R R t emailR Ra RH t localnamet statst eRz t modifiedt mtypeR\ t urlfilet port( ( s" /usr/local/lib/python2.5/urllib.pyRg s@ $ "c C s t | t p
t d n d d k } d d k } y d d k l } Wn# t j
o d d k l } n Xt | \ } } | p
t d n t | \ } } t
| \ } } | o t | \ } } n d } t
| } t
| p d } t
| p d } t i | } | p d d k }
|
i } n
t | } t | \ } } t
| } | i d } | d | d } }
| o | d o | d
} n | o | d o d | d <n | | | d i | f } t | i t j oP xM | i i D]8 } | | j o% | i | } | i | =| i qqWn yK| | i j o# t | | | | | | i | <n |
p
d } n d } xP | D]H } t | \ } } | i d
j o | d j o | i } qqW| i | i |
| \ } } | i d | d } d } | o | d | 7} n | d j o | d j o | d | 7} n | i! | | } t" | | d | SWn4 t# j
o% } t d | f t$ i% d n Xd S( s Use FTP protocol.s ftp errors8 proxy support for ftp protocol currently not implementediN( R s
no host givenRf R i i t Dt IRR t at At it ds ftp:s Content-Type: %s
s Content-Length: %d
i ( s ftp errors8 proxy support for ftp protocol currently not implemented( s ftp errors
no host given( R R R R R R (& R R R. R R R R R R R R R R# R RW R t ftplibt FTP_PORTRn R t splitt joinRp RB t MAXFTPCACHEt keysRD t
ftpwrapperR R t uppert retrfileR R RQ R RY RZ ( R1 R& R R R Ra Rj R t usert passwdR t attrst dirsRH t keyt kt vRR t attrt valueR] t retrlenR R\ Rd ( ( s" /usr/local/lib/python2.5/urllib.pyR s|
#
c C s t | t p
t d n d d k } y d d k l } Wn# t j
o d d k l } n Xy | i d d \ } } Wn t j
o t d n X| p
d } n | i d
} | d j o- d | | j o | | d } | | } n d
} g } | i
d t i d t i
t i | i
d | | d j o d d k } | i | } n
t | } | i
d t | | i
d
| i
| d i | } | | }
| i |
d } t |
| | S( s Use "data" URL.s
data errors9 proxy support for data protocol currently not implementediN( R t ,i s bad data URLs text/plain;charset=US-ASCIIt ;i t =Rf s Date: %ss %a, %d %b %Y %T GMTs Content-type: %sR s Content-Length: %ds
( s
data errors9 proxy support for data protocol currently not implemented( s
data errors bad data URL( R R R. R R R R R t
ValueErrort rfindRI t timet strftimet gmtimeR t decodestringR Rp R R RQ ( R1 R& R' R R RR t semit encodingRd R t fR\ ( ( s" /usr/local/lib/python2.5/urllib.pyt open_data. sB
N( R3 R4 t __doc__R# R= t __version__R; R/ RE RD R, RK R% RU RT R) R R R R8 RW R R R Rg R R ( ( ( s" /usr/local/lib/python2.5/urllib.pyR e s,
! ? H F # >c B s e Z d Z d Z d Z d d Z d Z d d Z d d Z d d Z
d d Z d d Z d d
Z
d d Z d d Z d d
Z d d Z d Z RS( s? Derived class with handlers for errors we can handle (perhaps).c O s2 t i | | | h | _ d | _ d | _ d S( Ni i
( R R/ t
auth_cachet triest maxtries( R1 RJ t kwargs( ( s" /usr/local/lib/python2.5/urllib.pyR/ ` s c C s t | | d | S( s3 Default error handling -- don't raise an exception.s http:( RQ ( R1 R& R] R R R\ ( ( s" /usr/local/lib/python2.5/urllib.pyR f s c C s | i d 7_ | i o\ | i | i j oI t | d o
| i } n
| i } d | _ | | | d d | Sn | i | | | | | | } d | _ | S( s% Error 302 -- relocated (temporarily).i t http_error_500i i s) Internal Server Error: Redirect Recursion( R R R8 R R t redirect_internal( R1 R& R] R R R\ R' t methRx ( ( s" /usr/local/lib/python2.5/urllib.pyt http_error_302j s
c C sw d | j o | d } n d | j o | d } n d S| i } | i t | i d | | } | i | S( Nt locationt urit :( Ro RD R RR R% ( R1 R& R] R R R\ R' t newurlR ( ( s" /usr/local/lib/python2.5/urllib.pyR z s
c C s | i | | | | | | S( s* Error 301 -- also relocated (permanently).( R ( R1 R& R] R R R\ R' ( ( s" /usr/local/lib/python2.5/urllib.pyt http_error_301 s c C s | i | | | | | | S( s; Error 303 -- also relocated (essentially identical to 302).( R ( R1 R& R] R R R\ R' ( ( s" /usr/local/lib/python2.5/urllib.pyt http_error_303 s c C sJ | d j o | i | | | | | | Sn | i | | | | | Sd S( s1 Error 307 -- relocated, but turn POST into error.N( R# R R ( R1 R& R] R R R\ R' ( ( s" /usr/local/lib/python2.5/urllib.pyt http_error_307 s
c
C s d | j o t i | | | | | | n | d } d d k } | i d | } | p t i | | | | | | n | i \ }
} |
i d j o t i | | | | | | n d | i d } | d j o t | | | | Sn t | | | | | Sd S( s_ Error 401 -- authentication required.
This function supports Basic authentication only.s www-authenticateiNs! [ ]*([^ ]+)[ ]+realm="([^"]*)"t basict retry_t _basic_auth( R R t ret matcht groupsR RR R# RV (
R1 R& R] R R R\ R' t stuffR R t schemet realmRc ( ( s" /usr/local/lib/python2.5/urllib.pyt http_error_401 s"
c
C s d | j o t i | | | | | | n | d } d d k } | i d | } | p t i | | | | | | n | i \ }
} |
i d j o t i | | | | | | n d | i d } | d j o t | | | | Sn t | | | | | Sd S( se Error 407 -- proxy authentication required.
This function supports Basic authentication only.s proxy-authenticateiNs! [ ]*([^ ]+)[ ]+realm="([^"]*)"R t retry_proxy_R ( R R R R R R RR R# RV (
R1 R& R] R R R\ R' R R R R R Rc ( ( s" /usr/local/lib/python2.5/urllib.pyt http_error_407 s"
c C s t | \ } } d | | } | i d } t | \ } } t | \ } }
| i d d } | | } | i | | | \ } }
| p |
p d Sn t | d d d t |
d d d | } d | |
| i d <| d j o | i | Sn | i | | Sd S( Ns http://R} t @i t safeRf R ( R R" R t findt get_user_passwdR# R R% ( R1 R& R R' Ra Rb R R_ R^ R` t
proxyselectorR R R ( ( s" /usr/local/lib/python2.5/urllib.pyt retry_proxy_http_basic_auth s
.
c C s t | \ } } d | | } | i d } t | \ } } t | \ } }
| i d d } | | } | i | | | \ } }
| p |
p d Sn t | d d d t |
d d d | } d | |
| i d <| d j o | i | Sn | i | | Sd S( Ns https://R R i R
Rf R ( R R" R R R R# R R% ( R1 R& R R' Ra Rb R R_ R^ R` R
R R R ( ( s" /usr/local/lib/python2.5/urllib.pyt retry_proxy_https_basic_auth s
.
c
C s t | \ } } | i d d } | | } | i | | | \ } } | p | p d Sn t | d d d t | d d d | } d | | } | d j o | i | Sn | i | | Sd S( NR i R
Rf R s http://( R R R R# R R% (
R1 R& R R' Ra Rb R R R R ( ( s" /usr/local/lib/python2.5/urllib.pyt retry_http_basic_auth s
.
c
C s t | \ } } | i d d } | | } | i | | | \ } } | p | p d Sn t | d d d t | d d d | } d | | } | d j o | i | Sn | i | | Sd S( NR i R
Rf R s https://( R R R R# R R% (
R1 R& R R' Ra Rb R R R R ( ( s" /usr/local/lib/python2.5/urllib.pyt retry_https_basic_auth s
.
i c C s | d | i } | | i j o$ | o | i | =qH | i | Sn | i | | \ } } | p | o | | f | i | <n | | f S( NR ( R R t prompt_user_passwd( R1 Ra R t clear_cacheR R R ( ( s" /usr/local/lib/python2.5/urllib.pyR s c C sk d d k } y@ t d | | f } | i d | | | f } | | f SWn t j
o Hd Sn Xd S( s# Override this in a GUI environment!iNs Enter username for %s at %s: s# Enter password for %s in %s at %s: ( NN( t getpasst raw_inputt KeyboardInterruptR# ( R1 Ra R R R R ( ( s" /usr/local/lib/python2.5/urllib.pyR s
N( R3 R4 R R/ R R# R R R R R R R R R R R R R ( ( ( s" /usr/local/lib/python2.5/urllib.pyR ] s
c C s$ t d j o t i d a n t S( s8 Return the IP address of the magic hostname 'localhost'.R N( t
_localhostR# RW R ( ( ( s" /usr/local/lib/python2.5/urllib.pyR s
c C s* t d j o t i t i a n t S( s* Return the IP address of the current host.N( t _thishostR# RW R t gethostname( ( ( s" /usr/local/lib/python2.5/urllib.pyR " s
c C s* t d j o d d k } | i a n t S( s1 Return the set of errors raised by the FTP class.iN( t
_ftperrorsR# R t
all_errors( R ( ( s" /usr/local/lib/python2.5/urllib.pyR * s
c C s} t d j ol d d k } y d d k l } Wn# t j
o d d k l } n X| i | d a t i i n t S( s) Return an empty mimetools.Message object.iN( R i ( t
_noheadersR# R R R R R R] RD ( R R ( ( s" /usr/local/lib/python2.5/urllib.pyR 3 s
R c B s; e Z d Z d Z d Z d Z d Z d Z RS( s; Class used by open_ftp() for cache of open FTP connections.c C s; | | _ | | _ | | _ | | _ | | _ | i d S( N( R R Ra R R t init( R1 R R Ra R R ( ( s" /usr/local/lib/python2.5/urllib.pyR/ F s c C s~ d d k } d | _ | i | _ | i i | i | i | i i | i | i x! | i
D] } | i i | q` Wd S( Nii ( R t busyt FTPt ftpt connectRa R t loginR R R t cwd( R1 R t dir( ( s" /usr/local/lib/python2.5/urllib.pyR N s
c
C s d d k } | i | d j o d } d } n d | } d } y | i i | Wn0 | i j
o! | i | i i | n Xd } | o~ | ov y d | } | i i | } Wq| i j
o@ } t | d d
j o t
d | f t i d qqXn | pA | i i d | o d
| } n d } | i i | } n d | _
t | d i d | i | d f S( NiR R s TYPE Ai s TYPE i s RETR i t 550s ftp errori s LIST t LISTRL ( R R ( R t endtransferR t voidcmdR R R# t ntransfercmdt
error_permR R. RY RZ R t addclosehookt makefile( R1 RH RR R t cmdt isdirt connt reason( ( s" /usr/local/lib/python2.5/urllib.pyR W s:
) c C sI | i p d Sn d | _ y | i i Wn t j
o n Xd S( Ni ( R R t voidrespR ( R1 ( ( s" /usr/local/lib/python2.5/urllib.pyR' u s
c C s8 | i y | i i Wn t j
o n Xd S( N( R' R RD R ( R1 ( ( s" /usr/local/lib/python2.5/urllib.pyRD ~ s
( R3 R4 R R/ R R R' RD ( ( ( s" /usr/local/lib/python2.5/urllib.pyR C s t addbasec B s) e Z d Z d Z d Z d Z RS( s( Base class for addinfo and addclosehook.c C s | | _ | i i | _ | i i | _ t | i d o | i i | _ n t | i d o | i i | _ n
d | _ t | i d o9 | i i | _ t | i d o | i i | _ q n d S( Nt readlinest filenoc S s d S( N( R# ( ( ( s" /usr/local/lib/python2.5/urllib.pyt <lambda> s t __iter__t next( R] Ro t readlineR8 R3 R4 R6 R7 ( R1 R] ( ( s" /usr/local/lib/python2.5/urllib.pyR/ s c C s d | i i t | | i f S( Ns <%s at %r whose fp = %r>( t __class__R3 t idR] ( R1 ( ( s" /usr/local/lib/python2.5/urllib.pyt __repr__ s c C sL d | _ d | _ d | _ d | _ | i o | i i n d | _ d S( N( R# Ro R8 R3 R4 R] RD ( R1 ( ( s" /usr/local/lib/python2.5/urllib.pyRD s
( R3 R4 R R/ R; RD ( ( ( s" /usr/local/lib/python2.5/urllib.pyR2 s R+ c B s e Z d Z d Z d Z RS( s* Class to add a close hook to an open file.c G s& t i | | | | _ | | _ d S( N( R2 R/ t closehookt hookargs( R1 R] R< R= ( ( s" /usr/local/lib/python2.5/urllib.pyR/ s c C sA t i | | i o& | i | i d | _ d | _ n d S( N( R2 RD R< R= R# ( R1 ( ( s" /usr/local/lib/python2.5/urllib.pyRD s
( R3 R4 R R/ RD ( ( ( s" /usr/local/lib/python2.5/urllib.pyR+ s t addinfoc B s e Z d Z d Z d Z RS( s. class to add an info() method to an open file.c C s t i | | | | _ d S( N( R2 R/ R\ ( R1 R] R\ ( ( s" /usr/local/lib/python2.5/urllib.pyR/ s c C s | i S( N( R\ ( R1 ( ( s" /usr/local/lib/python2.5/urllib.pyRh s ( R3 R4 R R/ Rh ( ( ( s" /usr/local/lib/python2.5/urllib.pyR> s RQ c B s) e Z d Z d Z d Z d Z RS( s9 class to add info() and geturl() methods to an open file.c C s& t i | | | | _ | | _ d S( N( R2 R/ R\ R& ( R1 R] R\ R& ( ( s" /usr/local/lib/python2.5/urllib.pyR/ s c C s | i S( N( R\ ( R1 ( ( s" /usr/local/lib/python2.5/urllib.pyRh s c C s | i S( N( R& ( R1 ( ( s" /usr/local/lib/python2.5/urllib.pyt geturl s ( R3 R4 R R/ Rh R? ( ( ( s" /usr/local/lib/python2.5/urllib.pyRQ s c C s d S( Ni ( ( t x( ( s" /usr/local/lib/python2.5/urllib.pyt _is_unicode s c C s
t | t S( N( R t unicode( R@ ( ( s" /usr/local/lib/python2.5/urllib.pyRA s c C sX t | oG y | i d } WqT t j
o! t d t | d qT Xn | S( s toBytes(u"URL") --> 'URL'.t ASCIIs URL s contains non-ASCII characters( RA t encodet UnicodeErrort repr( R& ( ( s" /usr/local/lib/python2.5/urllib.pyRP s
c C sn | i } | d d j o( | d d j o | d d !i } n | d d j o | d i } n | S( s8 unwrap('<URL:type://host/path>') --> 'type://host/path'.i t <it >i s URL:( R ( R& ( ( s" /usr/local/lib/python2.5/urllib.pyR s " c C s} t d j o d d k } | i d a n t i | } | o1 | i d } | i | t | d f Sn d | f S( s: splittype('type:opaquestring') --> 'type', 'opaquestring'.iNs
^([^/:]+):i ( t _typeprogR# R t compileR t groupR Rp ( R& R R R ( ( s" /usr/local/lib/python2.5/urllib.pyR s
"c C s` t d j o d d k } | i d a n t i | } | o | i d d Sn d | f S( s; splithost('//host[:port]/path') --> 'host[:port]', '/path'.iNs ^//([^/?]*)(.*)$i i ( t _hostprogR# R RJ R RK ( R& R R ( ( s" /usr/local/lib/python2.5/urllib.pyR s
c C si t d j o d d k } | i d a n t i | } | o t t | i d d Sn d | f S( sJ splituser('user[:passwd]@host[:port]') --> 'user[:passwd]', 'host[:port]'.iNs ^(.*)@(.*)$i i ( t _userprogR# R RJ R t mapR RK ( Ra R R ( ( s" /usr/local/lib/python2.5/urllib.pyR s
c C s` t d j o d d k } | i d a n t i | } | o | i d d Sn | d f S( s/ splitpasswd('user:passwd') -> 'user', 'passwd'.iNs ^([^:]*):(.*)$i i ( t _passwdprogR# R RJ R RK ( R R R ( ( s" /usr/local/lib/python2.5/urllib.pyR s
c C s` t d j o d d k } | i d a n t i | } | o | i d d Sn | d f S( s* splitport('host:port') --> 'host', 'port'.iNs ^(.*):([0-9]+)$i i ( t _portprogR# R RJ R RK ( Ra R R ( ( s" /usr/local/lib/python2.5/urllib.pyR + s
c C s t d j o d d k } | i d a n t i | } | of | i d d \ } } y$ | p
t d n t | } Wn t j
o
d } n X| | f Sn | | f S( s Split host and port, returning numeric port.
Return given default port if no ':' found; defaults to -1.
Return numerical port if a valid number are found after ':'.
Return None if ':' but not a valid number.iNs ^(.*):(.*)$i i s no digits( t
_nportprogR# R RJ R RK R Rn ( Ra t defportR R R t nport( ( s" /usr/local/lib/python2.5/urllib.pyR 7 s
c C s` t d j o d d k } | i d a n t i | } | o | i d d Sn | d f S( s/ splitquery('/path?query') --> '/path', 'query'.iNs ^(.*)\?([^?]*)$i i ( t
_queryprogR# R RJ R RK ( R& R R ( ( s" /usr/local/lib/python2.5/urllib.pyR M s
c C s` t d j o d d k } | i d a n t i | } | o | i d d Sn | d f S( s) splittag('/path#tag') --> '/path', 'tag'.iNs ^(.*)#([^#]*)$i i ( t _tagprogR# R RJ R RK ( R& R R ( ( s" /usr/local/lib/python2.5/urllib.pyR
Y s
c C s! | i d } | d | d f S( sk splitattr('/path;attr1=value1;attr2=value2;...') ->
'/path', ['attr1=value1', 'attr2=value2', ...].R i i ( R ( R& t words( ( s" /usr/local/lib/python2.5/urllib.pyR d s c C s` t d j o d d k } | i d a n t i | } | o | i d d Sn | d f S( s- splitvalue('attr=value') --> 'attr', 'value'.iNs ^([^=]*)=(.*)$i i ( t
_valueprogR# R RJ R RK ( R R R ( ( s" /usr/local/lib/python2.5/urllib.pyR k s
c C s? | d d j o$ | d d !o | d | d f Sn d | f S( s2 splitgophertype('/Xselector') --> 'X', 'selector'.i R i N( R# ( Rb ( ( s" /usr/local/lib/python2.5/urllib.pyR v s c c s) x" | ] } d | t | f Vq Wd S( s %02xN( t chr( t .0R ( ( s" /usr/local/lib/python2.5/urllib.pys <genexpr>| s i c c s) x" | ] } d | t | f Vq Wd S( s %02XN( RX ( RY R ( ( s" /usr/local/lib/python2.5/urllib.pys <genexpr>} s c C s | i d } x t d t | D] } | | } y t | d | d | | <Wq% t j
o d | | | <q% t j
o, t t | d d | d | | <q% Xq% Wd i | S( s" unquote('abc%20def') -> 'abc def'.t %i i i Rf ( R t xrangeRp t _hextochrt KeyErrort UnicodeDecodeErrort unichrRn R ( t st resR t item( ( s" /usr/local/lib/python2.5/urllib.pyR s
.c C s | i d d } t | S( s% unquote('%7e/abc+def') -> '~/abc def't +t ( RS R ( R` ( ( s" /usr/local/lib/python2.5/urllib.pyR s sA ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz0123456789_.-R c C s | t f } y t | } Wnr t j
of | t 7} h } xB t d D]4 } t | } | | j o | p d | | | <qH W| t | <n Xt | i | } d i | S( s quote('abc def') -> 'abc%20def'
Each part of a URL, e.g. the path info, the query, etc., has a
different set of reserved characters that must be quoted.
RFC 2396 Uniform Resource Identifiers (URI): Generic Syntax lists
the following reserved characters.
reserved = ";" | "/" | "?" | ":" | "@" | "&" | "=" | "+" |
"$" | ","
Each of these characters is reserved in some component of a URL,
but not necessarily in all of them.
By default, the quote function is intended for quoting the path
section of a URL. Thus, it will not encode '/'. This character
is reserved, but in typical usage the quote function is being
called on a path where the existing slash characters are used as
reserved characters.
i s %%%02XRf ( t always_safet _safemapsR] t rangeRX RN t __getitem__R ( R` R
t cachekeyt safe_mapR t cRa ( ( s" /usr/local/lib/python2.5/urllib.pyR s
&Rf c C sA d | j o' t | | d } | i d d Sn t | | S( s9 Quote the query fragment of a URL; replacing ' ' with '+'Rd Rc ( R RS ( R` R
( ( s" /usr/local/lib/python2.5/urllib.pyR s
i c
C s t | d o | i } nh y0 t | o t | d t o
t n Wn4 t j
o( t i \ } } } t d | n Xg } | pT xl| D]E \ } } t t | } t t | } | i
| d | q Wn x| D]\ } } t t | } t | t o% t | } | i
| d | q t | o1 t | i d d } | i
| d | q y t | } Wn: t j
o. t t | } | i
| d | q Xx/ | D]' } | i
| d t t | qWq Wd i
| S( sv Encode a sequence of two-element tuples or dictionary into a URL query string.
If any values in the query arg are sequences and doseq is true, each
sequence element is converted to a separate parameter.
If the query arg is a sequence of two-element tuples, the order of the
parameters in the output will match the order of parameters in the
input.
t itemsi s1 not a valid non-string sequence or mapping objectR RC RS t &( R8 Rl Rp R t tuplet TypeErrorRY RZ R R RI RA RD R (
R t doseqt tyt vat tbt lR R R@ t elt( ( s" /usr/local/lib/python2.5/urllib.pyR
sB "
)c C s` h } xS t i i D]B \ } } | i } | o# | d d j o | | | d <q q W| S( s Return a dictionary of scheme -> proxy server URL mappings.
Scan the environment for variables named <scheme>_proxy;
this seems to be the standard convention. If you need a
different way, you can pass a proxies dictionary to the
[Fancy]URLopener constructor.
it _proxy( R> t environRl R ( R" Rc R ( ( s" /usr/local/lib/python2.5/urllib.pyt getproxies_environment s t darwinc
C s y d d k } Wn t j
o h Sn Xy | i } Wn | i j
o h Sn Xh } d | j oD | d o9 y | d } Wn | i j
o q Xd | | d <n | S( s Return a dictionary of scheme -> proxy server URL mappings.
By convention the mac uses Internet Config to store
proxies. An HTTP proxy, for instance, is stored under
the HttpProxy key.
iNt UseHTTPProxyt
HTTPProxyHosts http://%sR} ( t icR t ICRX ( R| t configR" R ( ( s" /usr/local/lib/python2.5/urllib.pyt getproxies_internetconfig s c C s d S( Ni ( ( R@ ( ( s" /usr/local/lib/python2.5/urllib.pyR . s c C s t p t S( N( Rx R ( ( ( s" /usr/local/lib/python2.5/urllib.pyR 1 s c C sn h } y d d k } Wn t j
o | Sn Xy| i | i d } | i | d d } | o t | i | d d } d | j os x | i d D][ } | i d d \ } } d d k } | i d
| p d | | f } n | | | <q Wq@| d d
j o | | d <q@d | | d <d | | d <n | i Wn t
t t f j
o n X| S( sx Return a dictionary of scheme -> proxy server URL mappings.
Win32 uses the registry to store proxies.
iNs; Software\Microsoft\Windows\CurrentVersion\Internet Settingst ProxyEnablei t ProxyServerR R i s ^([^/:]+)://s %s://%si s http:R} s http://%ss ftp://%sR (
t _winregR t OpenKeyt HKEY_CURRENT_USERt QueryValueExR R R R t Closet WindowsErrorR Ro ( R" R t internetSettingst proxyEnablet proxyServert pt protocolt addressR ( ( s" /usr/local/lib/python2.5/urllib.pyt getproxies_registry5 s:
c C s t p t S( s Return a dictionary of scheme -> proxy server URL mappings.
Returns settings gathered from the environment, if specified,
or the registry.
( Rx R ( ( ( s" /usr/local/lib/python2.5/urllib.pyR b s c
C s` y d d k } d d k } Wn t j
o d Sn XyK | i | i d } | i | d d } t | i | d d } Wn t j
o d Sn X| p | o d Sn t | \ } } | g } y1 t i
| } | | j o | i | n Wn t i j
o n Xy1 t i
| } | | j o | i | n Wn t i j
o n X| i d } d }
xi |
t | j oU | |
d j o6 d d t i t i
t i g | |
|
d
+n |
d
7}
qzWxv | D]n } | i d d } | i d
d } | i d d } x/ | D]' } | i | | | i o d
Sq-q-WqWd S( Nii s; Software\Microsoft\Windows\CurrentVersion\Internet SettingsR t
ProxyOverrideR s <local>R s 127.0.0.1i t .s \.t *s .*t ?( R R R R R R R R R RW R RI RX t getfqdnR Rp R RS R R (
Ra R R R R t
proxyOverridet rawHostR t addrt fqdnR t testt val( ( s" /usr/local/lib/python2.5/urllib.pyR k sf
! c C s d S( Ni ( ( Ra ( ( s" /usr/local/lib/python2.5/urllib.pyR s c C s d } x$ t d D] } | t | } q W| d } t i } t | } t | } t i } | | j o d GHn t | GHt | GHt | GHt | | d Gd GHd S( NRf i i s Wrong!i t sec( Rg RX R R R RF t round( R` R t t0t qst uqst t1( ( s" /usr/local/lib/python2.5/urllib.pyt test1 s
c C s d | | | f GHd S( Ns0 Block number: %d, Block size: %d, Total size: %d( ( R{ t blocksizet totalsize( ( s" /usr/local/lib/python2.5/urllib.pyR+ s c C s9 | p: d d d d d g } t t d o | i d qA n z x | D] } d G| Gd GHt | d t \ } } | GH| o6 d
GHx% | i D] } | d G| | GHq Wd
GHn t | d } | i } ~ d
| j o( t i
d d } | i | d
} n | GHd \ } } qK Wd d GHWd t Xd S( Ns /etc/passwds file:/etc/passwds file://localhost/etc/passwds ftp://ftp.gnu.org/pub/READMEs http://www.python.org/index.htmlR s! https://synergy.as.cmu.edu/~geek/RN i
s ======R RL s
Rf i( s
----------s
----------( NN(
R8 R RI R R# R+ R R% Ro t stringt maketranst translateR ( RJ R& t fnR R R] R' t table( ( s" /usr/local/lib/python2.5/urllib.pyR s<
c C s! d d k } d d k } y# | i | i d d \ } } Wn& | i j
o } | GHd GHd Sn Xd } xR | D]J \ } } | d j o | d } n | d j o d GHd Gd
GHd Sqq qq W| o& | d j o t n t | n2 | p d GHn x | D] } t | i GqWd S( Nii t ths Use -h for helpi s -ts -hs& Usage: python urllib.py [-t] [url ...]s -t runs self-test;s' otherwise, contents of urls are printed( t getoptRY t argvRX R R R Ro ( R RY t optsRJ Rd t tt oR R& ( ( s" /usr/local/lib/python2.5/urllib.pyt main s4 #
t __main__(X R R RW R> R RY t urlparseR R t __all__R R Rc t macurl2pathR R t
nturl2patht
rourl2pathR# R$ R R R R. R- RB R R R R R R R R R R R R2 R+ R> RQ RB t NameErrorRA RP R RI R RL R RM R RO R RP R RQ R RT R RU R
R RW R R t dictRg R\ t updateR R Re Rf R R R
Rx t platformR R R R R R+ R R R3 ( ( ( s" /usr/local/lib/python2.5/urllib.pys <module> s
B
" @
-
= !