<_9Y�
� @ s` d d l m Z d d l m Z m Z d d l m Z d d l m Z Gd d � d e � Z d S)� )�
CharSetProber)� ProbingState� MachineState)�CodingStateMachine)�
UTF8_SM_MODELc sv e Z d Z d Z � f d d � Z � f d d � Z e d d � � Z e d d � � Z d
d � Z d d
� Z
� S)�
UTF8Proberg �?c s9 t t | � j � t t � | _ d | _ | j � d S)N)�superr �__init__r r � coding_sm�
_num_mb_chars�reset)�self)� __class__� �/utf8prober.pyr & s zUTF8Prober.__init__c s- t t | � j � | j j � d | _ d S)N� )r r r r
r )r
)r r r r , s
zUTF8Prober.resetc C s d S)Nzutf-8r )r
r r r � charset_name1 s zUTF8Prober.charset_namec C s d S)N� r )r
r r r �language5 s zUTF8Prober.languagec C s� x� | D]� } | j j | � } | t j k r> t j | _ Pq | t j k r] t j | _ Pq | t j k r | j j
� d k r | j d 7_ q W| j t j
k r� | j � | j k r� t j | _ | j S)N� r )r
Z
next_stater �ERRORr ZNOT_ME�_stateZITS_MEZFOUND_ITZSTARTZget_current_charlenr �stateZ DETECTING�get_confidenceZSHORTCUT_THRESHOLD)r
Zbyte_str�cZ coding_stater r r �feed9 s
zUTF8Prober.feedc C s9 d } | j d k r1 | | j | j 9} d | S| Sd S)Ng�G�z��?� g �?)r �
ONE_CHAR_PROB)r
Zunliker r r r L s
zUTF8Prober.get_confidence) �__name__�
__module__� __qualname__r r r �propertyr r r r r r )r r r # s r N)
Z
charsetproberr Zenumsr r Zcodingstatemachiner Zmbcssmr r r r r r �<module> s