���] � @ s� d d d d g Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d Z d! Z d" Z d# Z d$ Z! d% Z" d& Z# d' Z$ d( Z% d) Z& d* Z' d+ Z( d, Z) d- Z* d. Z+ d/ Z, d0 Z- d1 Z. d2 Z/ d3 Z0 d4 Z1 d5 Z2 d6 Z3 d7 Z4 d8 Z5 d9 Z6 d: Z7 d; Z8 d< Z9 d= Z: d> Z; d? d@ � e< � j= � D� Z> e j? e> j@ � � dA d � ZA dB d � ZB dC d � ZC dD dE � ZD eE dF k r�eD � dG S)H�tok_name� ISTERMINAL� ISNONTERMINAL�ISEOF� � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � � �! �" �# �$ �% �& �' �( �) �* �+ �, �- �. �/ �0 �1 �2 �3 �4 �5 �6 �7 �8 �9 � c C s> i | ]4 \ } } t | t � r | j d � r | | � q S)�_)� isinstance�int� startswith)�.0�name�value� rG �*/opt/alt/python35/lib64/python3.5/token.py� <dictcomp>J s rI c C s | t k S)N)� NT_OFFSET)�xrG rG rH r O s c C s | t k S)N)rJ )rK rG rG rH r R s c C s | t k S)N)� ENDMARKER)rK rG rG rH r U s c J C s d d l } d d l } | j d d � } | r; | d p> d } d } t | � d k rc | d } y t | � } WnL t k r� } z, | j j d t | � � | j d � WYd d } ~ Xn X| � | j � j d � } Wd QRX| j d | j � } i } xQ | D]I } | j | � } | r| j d d � \ } } t | � } | | | <qWt | j � � } y t | � } WnL t k r�} z, | j j d t | � � | j d � WYd d } ~ Xn X| � | j � j d � } Wd QRXy& | j d � d } | j d � } Wn/ t k r?| j j d � | j d � Yn Xg } x) | D]! } | j d | | | f � qMW| | | | � <y t | d � } WnL t k r�} z, | j j d t | � � | j d � WYd d } ~ Xn X| � | j d j | � � Wd QRXd S)Nr r zInclude/token.hz Lib/token.pyzI/O error: %s � z:#define[ ][ ]*([A-Z0-9][A-Z0-9_]*)[ ][ ]*([0-9][0-9]*)r z#--start constants--z#--end constants--z&target does not contain format markersr z%s = %d�wr )�re�sys�argv�len�open�OSError�stdout�write�str�exit�read�split�compile� IGNORECASE�match�grouprB �sorted�keys�stderr�index� ValueError�append�join)rO rP �args� inFileName� outFileName�fp�err�lines�prog�tokens�liner] rE �valr` �format�start�endrG rG rH �_mainY sb rs �__main__N)F�__all__rL �NAME�NUMBER�STRING�NEWLINE�INDENT�DEDENT�LPAR�RPAR�LSQB�RSQB�COLON�COMMA�SEMI�PLUS�MINUS�STAR�SLASH�VBAR�AMPER�LESS�GREATER�EQUAL�DOT�PERCENT�LBRACE�RBRACE�EQEQUAL�NOTEQUAL� LESSEQUAL� GREATEREQUAL�TILDE� CIRCUMFLEX� LEFTSHIFT� RIGHTSHIFT� DOUBLESTAR� PLUSEQUAL�MINEQUAL� STAREQUAL� SLASHEQUAL� PERCENTEQUAL� AMPEREQUAL� VBAREQUAL�CIRCUMFLEXEQUAL�LEFTSHIFTEQUAL�RIGHTSHIFTEQUAL�DOUBLESTAREQUAL� DOUBLESLASH�DOUBLESLASHEQUAL�AT�ATEQUAL�RARROW�ELLIPSIS�OP�AWAIT�ASYNC� ERRORTOKEN�N_TOKENSrJ �globals�itemsr �extend�valuesr r r rs �__name__rG rG rG rH �<module> s� 5