R6�WWU � > @ s y d d l m Z Wn e k
r. e Z Yn Xd d l m Z d d l Z d d l Ty d d l m Z WnA e k
r� y d d l m Z Wn e k
r� d Z Yn XYn Xy d d l
m Z Wn e k
r� d Z Yn Xe d d d d
d d d
d d d d d d d d d d d d d d d d d d d d! d" d# d$ d% g � Z
Gd& d' � d' e � Z Gd( d) � d) e � Z Gd* d+ � d+ e � Z Gd, d- � d- e � Z Gd. d/ � d/ e � Z Gd0 d1 � d1 e � Z e d2 d> � Z Gd8 d9 � d9 e � Z Gd: d; � d; e � Z d d< d= � Z d S)?� )� OrderedDict)�
namedtupleN)�*)�
FIELD_TYPE)� postgres_ext�and�as�assert�break�class�continue�def�del�elif�else�except�exec�finally�for�from�global�if�import�in�is�lambda�not�or�pass�print�raise�return�try�while�with�yieldc @ s e Z d Z d S)� UnknownFieldN)�__name__�
__module__� __qualname__� r* r* �/reflection.pyr& s r& c @ s� e Z d Z d Z e e f Z d d d d d d � Z d d � Z d d � Z d
d � Z
d d
� Z d d � Z d d d d � Z
d d � Z d S)�Columnz1
Store metadata about a database column.
FNc C sg | | _ | | _ | | _ | | _ | | _ | | _ | | _ | | _ d | _ d | _ d | _
d S)N) �name� field_class�raw_column_type�nullable� primary_key� db_column�index�unique� rel_model� related_name�to_field) �selfr- r. r/ r0 r1 r2 r3 r4 r* r* r+ �__init__' s zColumn.__init__c sH d d d d d g } d j � f d d � | D� � } d � j | f S)
Nr. r/ r0 r1 r2 z, c 3 s( | ] } d | t � | � f Vq d S)z%s=%sN)�getattr)�.0�attr)r8 r* r+ � <genexpr>? s z"Column.__repr__.<locals>.<genexpr>zColumn(%s, %s))�joinr- )r8 �attrsZ keyword_argsr* )r8 r+ �__repr__7 s
zColumn.__repr__c C s i } | j r d | d <| j t k s: | j | j k rK d | j | d <| j rm | j t k rm d | d <| j � r� | j | d <| j r� d | j | d <| j
r� d | j
| d <| j � s� | j r� d | d
<n | j
r� | j � r� d | d <| S) NT�nullz'%s'r2 r1 r5 r7 r6 �Truer4 r3 )r0 r. �ForeignKeyFieldr- r2 r1 �PrimaryKeyField�is_foreign_keyr5 r7 r6 �is_primary_keyr4 r3 )r8 �paramsr* r* r+ �get_field_parametersC s&
!
zColumn.get_field_parametersc C s | j t k p | j S)N)r. rD r1 )r8 r* r* r+ rF _ s zColumn.is_primary_keyc C s
| j t k S)N)r. rC )r8 r* r* r+ rE b s zColumn.is_foreign_keyc C s | j t k o | j d k S)Nz'self')r. rC r5 )r8 r* r* r+ �is_self_referential_fke s z Column.is_self_referential_fkc C sk | | _ t | _ | j | j k r0 d | _ n | | j | _ | rO | j pR d | _ | pa d | _ d S)Nz'self') � foreign_keyrC r. �
dest_table�tabler5 r- r7 r6 )r8 rJ � model_names�destr6 r* r* r+ �set_foreign_keyi s zColumn.set_foreign_keyc C sv | j � } d j d d � t | j � � D� � } d | j | j j | f } | j t k rr d | | j f } | S)Nz, c s s% | ] \ } } d | | f Vq d S)z%s=%sNr* )r; �k�vr* r* r+ r= w s z#Column.get_field.<locals>.<genexpr>z %s = %s(%s)z%s # %s) rH r> �sorted�itemsr- r. r' r& r/ )r8 Z field_paramsZ param_str�fieldr* r* r+ � get_fieldt s
zColumn.get_field)r' r( r) �__doc__� IntegerFieldrD Zprimary_key_typesr9 r@ rH rF rE rI rO rU r* r* r* r+ r, ! s
r, c @ s e Z d Z i Z d Z d d � Z d d � Z d d d � Z d d d
� Z d d d � Z d d
d � Z
d d d � Z d S)�Metadata� c C s | | _ d | _ d S)NF)�database�requires_extension)r8 rZ r* r* r+ r9 � s zMetadata.__init__c G s | j j | | � S)N)rZ Z execute_sql)r8 ZsqlrG r* r* r+ �execute� s zMetadata.executeNc
C s� t d d � | j j | | � D� � } | j | | � } | j | | � } t | � d k r� | d } | | t k r� t | | <t � } xU | j � D]G \ } } t | d | | d | j
d | j d | j d | �| | <q� W| S)
Nc s s | ] } | j | f Vq d S)N)r- )r; �metadatar* r* r+ r= � s z'Metadata.get_columns.<locals>.<genexpr>� r r. r/ r0 r1 r2 )
r rZ � get_columns�get_column_types�get_primary_keys�lenrW rD rS r, � data_typerA r1 )
r8 rL �schemar] � column_typesZpk_namesZpk�columnsr- Z column_datar* r* r+ r_ � s&
zMetadata.get_columnsc C s
t � d S)N)�NotImplementedError)r8 rL rd r* r* r+ r` � s zMetadata.get_column_typesc C s | j j | | � S)N)rZ �get_foreign_keys)r8 rL rd r* r* r+ rh � s zMetadata.get_foreign_keysc C s | j j | | � S)N)rZ ra )r8 rL rd r* r* r+ ra � s zMetadata.get_primary_keysc C s | j j | | � S)N)rZ � get_indexes)r8 rL rd r* r* r+ ri � s zMetadata.get_indexes) r' r( r) �
column_map�extension_importr9 r\ r_ r` rh ra ri r* r* r* r+ rX � s rX c " s� e Z d Z d e d e d e d e d e d e d e d e d e d
e d e
d e d
e d e d e d e
d e i Z d Z � f d d � Z d d � Z d � f d d � Z d � f d d � Z d � f d d � Z d � f d d � Z � S) �PostgresqlMetadata� � � � � � i� i� i i i: iZ i� i; i� i� i� z$from playhouse.postgres_ext import *c s� t t | � j | � t d k r� | j d � } | j � } xn | D]f \ } } d | k ro t j | j | <qD d | k r� t j | j | <qD d | k rD t j | j | <qD Wd S)Nz!select oid, typname from pg_type;ZjsonZhstoreZtsvector)
�superrl r9 r r\ Zfetchall� JSONFieldrj � HStoreField�
TSVectorField)r8 rZ �cursor�resultsZoidZtypname)� __class__r* r+ r9 � s zPostgresqlMetadata.__init__c C s� i } t d k r0 t t j t j t j f � n t � } d | | f } | j d | � } xL | j D]A } | j j | j t
� | | j <| | j | k rf d | _ qf W| S)Nz "%s"."%s"zSELECT * FROM %s LIMIT 1T)
r �setrt rv ru r\ � descriptionrj �get� type_coder& r- r[ )r8 rL rd re Zextension_typesZ
identifierrw �column_descriptionr* r* r+ r` � s 3
z#PostgresqlMetadata.get_column_typesNc s% | p d } t t | � j | | � S)N�public)rs rl r_ )r8 rL rd )ry r* r+ r_ � s z PostgresqlMetadata.get_columnsc s% | p d } t t | � j | | � S)Nr )rs rl rh )r8 rL rd )ry r* r+ rh � s z#PostgresqlMetadata.get_foreign_keysc s% | p d } t t | � j | | � S)Nr )rs rl ra )r8 rL rd )ry r* r+ ra � s z#PostgresqlMetadata.get_primary_keysc s% | p d } t t | � j | | � S)Nr )rs rl ri )r8 rL rd )ry r* r+ ri � s z PostgresqlMetadata.get_indexes)r' r( r) � BooleanField� BlobField�BigIntegerFieldrW � TextField�
FloatField� CharField� DateField�
DateTimeField� TimeField� DecimalFieldrj rk r9 r` r_ rh ra ri r* r* )ry r+ rl � s0 rl c ( s e Z d Z e d k r! i Z n� e j e e j e e j e
e j e e j
e e j e e j e e j e e j e e j e e j e e j e e j e e j e e j e e j e e j e e j e e j e e j! e i Z � f d d � Z" d d d � Z# � S)�
MySQLMetadataNc s< d | k r | j d � | d <t t | � j | | � d S)NZpasswordZpasswd)�poprs r� r9 )r8 rZ �kwargs)ry r* r+ r9 s zMySQLMetadata.__init__c C s` i } | j d | � } x@ | j D]5 } | d d � \ } } | j j | t � | | <q# W| S)NzSELECT * FROM `%s` LIMIT 1� )r\ r{ rj r| r& )r8 rL rd re rw r~ r- r} r* r* r+ r` # s z MySQLMetadata.get_column_types)$r' r( r) r rj ZBLOBr� ZCHARr� ZDATEr� ZDATETIMEr� ZDECIMALr� ZDOUBLEr� �FLOATZINT24rW Z LONG_BLOB�LONGZLONGLONGr� Z MEDIUM_BLOBZ
NEWDECIMALZSHORT�STRINGZ TIMESTAMPZTIMEr� Z TINY_BLOBZTINYZ
VAR_STRINGr9 r` r* r* )ry r+ r� s0 r� c $ @ s� e Z d Z d e d e d e d e d e d e d e d e d e
d
e
d e
d e d
e d e
d e
d e
d e d e
i Z d Z d Z d j d e d e � Z d Z d d � Z d d d � Z d S) �SqliteMetadataZbigintZblob�boolZboolean�charZdateZdatetimeZdecimalZintegerzinteger unsigned�int�long�realZ smallintegerZsmallintzsmallint unsigned�text�timez
(?:["\[\(]+)?z
(?:["\]\)]+)?zi(?:FOREIGN KEY\s*)?{begin}(.+?){end}\s+(?:.+\s+)?references\s+{begin}(.+?){end}\s*\(["|\[]?(.+?)["|\]]?\)�begin�endz&^\s*(?:var)?char\s*\(\s*(\d+)\s*\)\s*$c C sw | j � } | | j k r+ | j | } nH t j | j | � rI t } n* t j d d | � } | j j | t � } | S)Nz\(.+\)rY ) �lowerrj �re�search�
re_varcharr� �subr| r& )r8 Z column_typer/ r. r* r* r+ �_map_colP s zSqliteMetadata._map_colNc C sF i } | j j | � } x' | D] } | j | j � | | j <q W| S)N)rZ r_ r� rc r- )r8 rL rd re rf �columnr* r* r+ r` [ s
z SqliteMetadata.get_column_types)r' r( r) r� r� r� r� r� r� r� rW r� r� r� rj r� r� �formatZre_foreign_keyr� r� r` r* r* r* r+ r� 1 s2 r� �_DatabaseMetadatarf � primary_keys� foreign_keysrM �indexesc @ s( e Z d Z d d � Z d d � Z d S)�DatabaseMetadatac sl g } x_ � j � D]P } t | j � d k r � � f d d � | j D� } | j | | j f � q W| S)Nr^ c s7 g | ]- } | � j � k r � j � | j � q Sr* )rf r- )r; r� )r8 rL r* r+ �
<listcomp>r s z9DatabaseMetadata.multi_column_indexes.<locals>.<listcomp>)r� rb rf �appendr4 )r8 rL �accumr3 � field_namesr* )r8 rL r+ �multi_column_indexesn s
z%DatabaseMetadata.multi_column_indexesc C sK i } x> | j | D]/ } t | j � d k r | j | | j d <q W| S)Nr^ r )r� rb rf r4 )r8 rL r� r3 r* r* r+ �column_indexesx s
z DatabaseMetadata.column_indexesN)r' r( r) r� r� r* r* r* r+ r� m s
r� c @ s� e Z d Z e e g Z d d d � Z d d � Z e d d d � � Z d d � Z
d
d � Z d d
� Z d d � Z
d d � Z d d � Z d d d � Z d d d d � Z d S)� IntrospectorNc C s | | _ | | _ d S)N)r] rd )r8 r] rd r* r* r+ r9 � s zIntrospector.__init__c C s d | j j S)Nz<Introspector: %s>)r] rZ )r8 r* r* r+ r@ � s zIntrospector.__repr__c C sX t | t � r t | � } n* t | t � r< t | � } n t | � } | | d | �S)Nrd )�
isinstanceZPostgresqlDatabaserl Z
MySQLDatabaser� r� )�clsrZ rd r] r* r* r+ �
from_database� s zIntrospector.from_databasec C s t | j j � S)N)�typer] rZ )r8 r* r* r+ �get_database_class� s z Introspector.get_database_classc C s
| j j j S)N)r] rZ )r8 r* r* r+ �get_database_name� s z Introspector.get_database_namec C s
| j j j S)N)r] rZ Zconnect_kwargs)r8 r* r* r+ �get_database_kwargs� s z Introspector.get_database_kwargsc C s | j j r d | j j Sd S)N�
rY )r] r[ rk )r8 r* r* r+ �get_additional_imports� s z#Introspector.get_additional_importsc C sX t j d d | � } d j d d � | j d � D� � } | d j � sT d | } | S)Nz[^\w]+rY c s s | ] } | j � Vq d S)N)�title)r; r� r* r* r+ r= � s z/Introspector.make_model_name.<locals>.<genexpr>�_r �T)r� r� r> �split�isalpha)r8 rL �modelZ
model_namer* r* r+ �make_model_name� s
%
z Introspector.make_model_namec C s\ t j d d | j � j � � p* | j � } t j d d | � } | t k rX | d 7} | S)Nz_id$rY z[^\w]+r� )r� r� r� �strip�RESERVED_WORDS)r8 r� r* r* r+ �make_column_name� s
-
z Introspector.make_column_namec s� | j r' | j j j d | j � } n | j j j � } � d k r^ � f d d � | D� } i } i } i } i } i } x�| D]�} | j j | | j � } | j j | | j � }
y | j j | | j � | | <Wn< t k
r} z t | j � g | | <WYd d } ~ Xn X| j
| � | | <t d d � |
D� � } xe |
j � D]W \ }
} | j
|
� } |
j � } | j d � r�| | k r�|
j � } | | _ qQWxY | D]Q } t | j � d k r�| j d } | |
k r�| j |
| _ d |
| _ q�W| j j | | j � | | <|
| | <| | | <q� Wi } d
d � } x� | D]� } t � } x� t | | d | �D]o } y | | | j } Wn t k
r�w{Yn X| j } | | k r�d
| | j f | | <q{| j | � q{WqUWx� | D]� } x� | | D]x } | | j | j } y | | j | j } Wn t k
rVd } Yn X| j d | d | d | d | j | � � q
Wq�Wt | | | | | � S)Nrd c s" g | ] } | � k r | � q Sr* r* )r; rL )� table_namesr* r+ r� � s z+Introspector.introspect.<locals>.<listcomp>c s s | ] } | j � Vq d S)N)r� )r; Z column_namer* r* r+ r= � s z*Introspector.introspect.<locals>.<genexpr>Z_idr^ r Tc S s | j S)N)r� )rJ r* r* r+ �<lambda>� s z)Introspector.introspect.<locals>.<lambda>�keyz %s_%s_setrJ rM rN r6 ) rd r] rZ Z
get_tablesri r_ rh �
ValueError�err�messager� rz rS r� r� �endswithr- rb rf r4 r3 ra rR r� �KeyErrorrK �addrL Z dest_columnrO r| r� )r8 r� Ztablesrf r� r� rM r� rL Z
table_indexesZ
table_columns�excZlower_col_namesZcol_namer� �new_nameZ
lower_namer3 Z
related_namesZsort_fnZmodels_referencedrJ rK �srcrN r* )r� r+ �
introspect� s�
zIntrospector.introspectFc s� � j d | � � i } G� f d d � d t � � � � � � f d d � � x< t � j j � � D]% \ } } | | k re � | | � qe W| S)Nr� c s) e Z d Z G� f d d � d � Z d S)z/Introspector.generate_models.<locals>.BaseModelc s e Z d Z � j j Z d S)z4Introspector.generate_models.<locals>.BaseModel.MetaN)r' r( r) r] rZ r* )r8 r* r+ �Meta! s r� N)r' r( r) r� r* )r8 r* r+ � BaseModel s r� c s� xC � j | D]4 } | j } | | k r | | k r � | | � q Wg � � j | } x3 | j � D]% \ } } | j rf � j | j � qf W� j | � � � j | � } G� f d d � d � } d } t � � d k r� | j
� � t � � d k r*t � f d d � | j � D� � | _ d } d | i }
xY| j � D]K\ } } | j } | t
k rjt } d | d
| j i } | j r�| r�| t k r�t } d | d <n | j r�| t k r�d | d <| j � r5| j � r�d | d
<n | j j }
| |
| d
<| j r!| j | d <d | | f | d <| | k r{| j � r{| | red | d <n | j � s{d | d <| | � |
| j <qCWy# t t | � � f |
� | | <Wn t k
r�� s�� Yn Xd S)Nc s e Z d Z � Z d S)zAIntrospector.generate_models.<locals>._create_model.<locals>.MetaN)r' r( r) r� r* )r� r* r+ r� 4 s r� Fr r^ c s+ g | ]! \ } } | � k r | j � q Sr* )r- )r; �colrT )r� r* r+ r� = s zGIntrospector.generate_models.<locals>._create_model.<locals>.<listcomp>Tr2 rA r1 r8 r5 r7 z %s_%s_relr6 r4 r3 )r� rK rf rS r1 r� r- r� r� rb �keysZ CompositeKeyr. r& Z BareFieldr0 rD rW rE rI rJ r7 rF r� �strr� )rL �modelsrJ rN rf r2 r� r� r� Z
composite_keyr? Z
FieldClassrG rK )r� �
_create_modelrZ � skip_invalid)r� r� r+ r� $ sf
%
#
z3Introspector.generate_models.<locals>._create_model)r� ZModelrR rM rS )r8 r� r� r� rL r� r* )r� r� rZ r8 r� r+ �generate_models s F" z Introspector.generate_models)r' r( r) rD rW Z
pk_classesr9 r@ � classmethodr� r� r� r� r� r� r� r� r� r* r* r* r+ r� � s lr� c C s t j | d | �} | j � S)Nrd )r� r� r� )rZ rd Z introspectorr* r* r+ r� q s r� )rf r� r� rM r� )� collectionsr � ImportError�dictr r� ZpeeweeZMySQLdb.constantsr Zpymysql.constantsZ playhouser rz r� �objectr& r, rX rl r� r� r� r� r� r� r* r* r* r+ �<module> sJ
c3L.4 �