ó |£*^c@sÑdZddlZddlZddlmZddlmZmZddlm Z de fd„ƒYZ de fd „ƒYZ d „Zdd „Zd efd „ƒYZdefd„ƒYZdd„ZdS(s SQL LexeriÿÿÿÿN(ttokens(tKEYWORDStKEYWORDS_COMMON(tStringIOtincludecBseZRS((t__name__t __module__(((sb/home/gitlab-runner/builds/8480fa44/0/bergerc/fluidmanager-web/art-framework/bin/sqlparse/lexer.pyRstcombinedcBs eZdZd„Zd„ZRS(s0Indicates a state combined from multiple states.cGstj||ƒS(N(ttuplet__new__(tclstargs((sb/home/gitlab-runner/builds/8480fa44/0/bergerc/fluidmanager-web/art-framework/bin/sqlparse/lexer.pyR scGsdS(N((tselfR ((sb/home/gitlab-runner/builds/8480fa44/0/bergerc/fluidmanager-web/art-framework/bin/sqlparse/lexer.pyt__init__!s(RRt__doc__R R (((sb/home/gitlab-runner/builds/8480fa44/0/bergerc/fluidmanager-web/art-framework/bin/sqlparse/lexer.pyRs cCs1|jƒ}tj|tj|tjƒƒ|fS(N(tupperRtgetRRtName(tvaluettest((sb/home/gitlab-runner/builds/8480fa44/0/bergerc/fluidmanager-web/art-framework/bin/sqlparse/lexer.pyt is_keyword&s cs3‡fd†}x|D]}|||ƒ}qW|S(s¤ Use this method to apply an iterable of filters to a stream. If lexer is given it's forwarded to the filter, otherwise the filter receives `None`. c3s&x|jˆ|ƒD] }|VqWdS(N(tfilter(tfilter_tstreamttoken(tlexer(sb/home/gitlab-runner/builds/8480fa44/0/bergerc/fluidmanager-web/art-framework/bin/sqlparse/lexer.pyt_apply2s((RtfiltersRRR((Rsb/home/gitlab-runner/builds/8480fa44/0/bergerc/fluidmanager-web/art-framework/bin/sqlparse/lexer.pyt apply_filters+s t LexerMetacBs)eZdZd„Zd„Zd„ZRS(sr Metaclass for Lexer, creates the self._tokens attribute from self.tokens on the first instantiation. c CsRt|ƒtks"td|ƒ‚|ddksBtd|ƒ‚||krV||Sg}||<|j}xÞ||D]Ò}t|tƒrÑ||ks©td|ƒ‚|j|j||t|ƒƒƒqxnt|ƒtksótd|ƒ‚yt j |d|ƒj }Wn3t k rE}t d|d|||fƒ‚nXt|dƒtjks†t|dƒs†td |dfƒ‚t|ƒd kr¡d} n|d } t| tƒr9| d krÏd } q0| |krç| f} q0| d krü| } q0| d dkr t| dƒ } q0ts0td| ƒ‚n÷t| tƒrÉd|j} |jd7_g} xF| D]>} | |ks“td| ƒ‚| j|j||| ƒƒqqW| || <| f} ngt| tƒrx6| D].}||ksß|dksßtd|ƒ‚qßW| } nts0td| ƒ‚|j||d| fƒqxW|S(Nswrong state name %rit#sinvalid state name %rscircular state reference %rswrong rule def %rs+uncompilable regex %r in state %r of %r: %sis2token type must be simple type or callable, not %ris#popiÿÿÿÿs#pushis#pop:sunknown new state %rs_tmp_%dscircular state ref %rsunknown new state sunknown new state def %r(s#pops#push(ttypetstrtAssertionErrortflagst isinstanceRtextendt_process_stateRtretcompiletmatcht Exceptiont ValueErrorRt _TokenTypetcallabletlentNonetinttFalseRt_tmpnametappend( R t unprocessedt processedtstatet tokenlisttrflagsttdeftrexterrt new_statettdef2titokenstistate((sb/home/gitlab-runner/builds/8480fa44/0/bergerc/fluidmanager-web/art-framework/bin/sqlparse/lexer.pyR%Asl"    ",                cCsZi|_d|_i}|j|j=~!]+s[+/@#%^&|`?^-]+troots\*/s#pops[^/\*]+s[/*]cCs g|_dS(N(R(R ((sb/home/gitlab-runner/builds/8480fa44/0/bergerc/fluidmanager-web/art-framework/bin/sqlparse/lexer.pyR ÞscKsBddlm}t||ƒs.||}n|jj|ƒdS(Niÿÿÿÿ(tFilter(tsqlparse.filtersRJR#RR2(R RtoptionsRJ((sb/home/gitlab-runner/builds/8480fa44/0/bergerc/fluidmanager-web/art-framework/bin/sqlparse/lexer.pyt add_filteráscCsôtjddkr)t|tƒr)|Sn|jdkr“y5|jdƒ}|jdƒrl|tdƒ}nWqÌtk r|jdƒ}qÌXn9y|j|jƒ}Wn tk rË|jdƒ}nX|j dkrð|j |j ƒ}n|S(Niitguesssutf-8utlatin1sunicode-escape( tsyst version_infoR#R tencodingtdecodet startswithR-tUnicodeDecodeErrorttabsizet expandtabs(R ttext((sb/home/gitlab-runner/builds/8480fa44/0/bergerc/fluidmanager-web/art-framework/bin/sqlparse/lexer.pyt_decodeçs"  csÑtˆtƒr”ˆjr'ˆjƒ‰nˆjrBˆjdƒ‰ntjddkr…tˆtƒr…tˆj dƒƒ‰dˆ_ q”tˆƒ‰n‡‡fd†}|ƒ}|sÍt |ˆj ˆƒ}n|S(s= Return an iterable of (tokentype, value) pairs generated from `text`. If `unfiltered` is set to `True`, the filtering mechanism is bypassed even if filters are defined. Also preprocess the text, i.e. expand tabs and strip it if wanted and applies registered filters. s iisutf-8c3s2x+ˆjˆƒD]\}}}||fVqWdS(N(tget_tokens_unprocessed(titttv(R RX(sb/home/gitlab-runner/builds/8480fa44/0/bergerc/fluidmanager-web/art-framework/bin/sqlparse/lexer.pytstreamers( R#t basestringtstripalltstriptstripnlRPRQtunicodeRtencodeRRRR(R RXt unfilteredR^R((R RXsb/home/gitlab-runner/builds/8480fa44/0/bergerc/fluidmanager-web/art-framework/bin/sqlparse/lexer.pyt get_tokensüs   "  ccs¹d}|j}t|ƒ}||d}i}|jƒ}|j|ƒ}xhxa|D]Ý\} } } | ||ƒ} | rT| jƒ} | |kr¥||| | fVnt| ƒtjkrË|| | fVn[t| dƒr| | ƒ\}} ||| <||| fVnx| || ƒD] }|VqW| j ƒ}| d k r-t | t ƒrÍxÌ| D]r}|dkrs|j ƒqT|dkr“|j|dƒqT|dks¶| s¶|ddkrT|j|ƒqTqTWnOt | tƒræ|| 3n6| dkr|j|dƒntstd| ƒ‚||d}nPqTqTWyg||dkr||d 7}d g}|d }|tjd fVwMn|tj||fV|d 7}WqMtk r°PqMXqMWd S( s} Split ``text`` into (tokentype, text) pairs. ``stack`` is the inital stack (default: ``['root']``) iiÿÿÿÿREs#pops#pushsmultiline-commentsswrong state def: %rs iRIu N(RBtlisttreadRYtgroupRRR+RDtendR.R#RtpopR2R/R0R!tTexttErrort IndexError(R Rtstacktpost tokendefst statestackt statetokenst known_namesRXtrexmatchtactionR;tmRtttypetitemR5((sb/home/gitlab-runner/builds/8480fa44/0/bergerc/fluidmanager-web/art-framework/bin/sqlparse/lexer.pyRZsh                    (RI()RRRt __metaclass__RRR0R`RbRVR&t IGNORECASEtUNICODER"RtCommenttSingletNewlinet Whitespacet Multilinet Assignmentt PunctuationtWildcardtKeywordRtBuiltint PlaceholdertNumbert HexadecimaltFloattIntegertStringtSymboltDDLRtOperatort ComparisonR RMRYRfRZ(((sb/home/gitlab-runner/builds/8480fa44/0/bergerc/fluidmanager-web/art-framework/bin/sqlparse/lexer.pyRG›sj                       cCs.tƒ}|dk r!||_n|j|ƒS(sTokenize sql. Tokenize *sql* using the :class:`Lexer` and return a 2-tuple stream of ``(token type, value)`` items. N(RGR.RRRf(tsqlRRR((sb/home/gitlab-runner/builds/8480fa44/0/bergerc/fluidmanager-web/art-framework/bin/sqlparse/lexer.pyttokenizeas   (RR&RPtsqlparseRtsqlparse.keywordsRRt cStringIORR RRRRR.RRRtobjectRGR’(((sb/home/gitlab-runner/builds/8480fa44/0/bergerc/fluidmanager-web/art-framework/bin/sqlparse/lexer.pyts    `Æ