o y\b@s:dZddlmZddlmZddlmZddlmZddlm Z ddlm Z dd lm Z dd l m Z dd l mZdd lmZdd lmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlm Z ddlm!Z!ddlm"Z"ddlm#Z#e#j$%ej&dZ'dd Z(d!d"Z) # # # # #dLd$d%Z*d&d'Z+d(d)Z,d*d+Z-d,d-Z.d.d/Z/dMd1d2Z0d3d4Z1d5d6Z2d7d8Z3Gd9d:d:e4Z5Gd;d<dd>e5Z7d?d@Z8dNdBdCZ9dDdEZ: A A #dOdFdGZ;GdHdIdIej<Z=GdJdKdKe=Z>dAS)Pz;High level utilities which build upon other modules here. )deque)chain) operators)visitors)_deep_annotate)_deep_deannotate)_shallow_annotate) _from_objects) ColumnSet) sort_tables) _find_columns)_label_reference)_textual_label_reference) BindParameter) ColumnClause) ColumnElement)Null)UnaryExpression)Column) FromClause) FromGrouping)Join) ScalarSelect) SelectBase)exc)utilz.sql.util.join_conditioncCsFtt|}t|D]\}}|D]}||r||fSqq dS)aGiven a list of FROM clauses and a selectable, return the first index and element from the list of clauses which can be joined against the selectable. returns None, None if no match is found. e.g.:: clause1 = table1.join(table2) clause2 = table4.join(table5) join_to = table2.join(table3) find_join_source([clause1, clause2], join_to) == clause1 )NN)listr enumerateis_derived_from)clausesjoin_to selectablesifsr'E/var/www/html/env/lib/python3.10/site-packages/sqlalchemy/sql/util.pyfind_join_source.s  r)cs$gfddt|dS)aProduce a traversal of the given expression, delivering column comparisons to the given function. The function is of the form:: def my_fn(binary, left, right) For each binary expression located which has a comparison operator, the product of "left" and "right" will be delivered to that function, in terms of that binary. Hence an expression like:: and_( (a + b) == q + func.sum(e + f), j == r ) would have the traversal:: a q a e a f b q b e b f j r That is, every combination of "left" and "right" that doesn't further contain a binary comparison is passed as pairs. c3st|tr |VdS|jdkrFt|jrFd||jD]}|jD] }d||q(q! d| D]}|q=dSt|t rN|V| D] }|D]}|VqXqRdS)Nbinaryr) isinstancer__visit_name__r is_comparisonoperatorinsertleftrightpop get_childrenr)elementlrelemefnstackvisitr'r(r<ms,         z#visit_binary_product..visitN)r)r:exprr'r9r(visit_binary_productHs#r>Fcsgi}|rj|d<|d<|rj|d<|rj|d<|r/fdd|d<|d<|d <|r;fd d }||d <j|d <t|ddi|S)z1locate Table objects within the given expression.selectcompound_selectjoinaliascs |jSNappendtable)enttablesr'r(s zfind_tables..r/updatedeletec|jdSrCrD)columnrHr'r( visit_columnz!find_tables..visit_columnrNrFcolumn_collectionsF)rErtraverse)clause check_columnsinclude_aliases include_joinsinclude_selects include_crud _visitorsrOr'rHr( find_tabless&      rZcCst}g}t|g}|rL|}t|tr>t|tr!t|j s>t|t r)|j }t|t r/q ||vr=| |||n |D]}||qB|s |S)zqBreak up an 'order by' expression into individual column-expressions, without DESC/ASC/NULLS FIRST/NULLS LAST)r column_setrpopleftr+rrris_ordering_modifiermodifierrr4raddrEr3)rScolsresultr;tcr'r'r(unwrap_order_bys,         rdcCsdd}t|i|S)NcSst|ttfr |jSdSrC)r+rrr4)r7r'r'r(replacesz'unwrap_label_reference..replace)rreplacement_traverse)r4rer'r'r(unwrap_label_referencesrgcs2tdd|Dfddtdd|DDS)zGiven the columns clause and ORDER BY of a selectable, return a list of column expressions that can be added to the collist corresponding to the ORDER BY, without repeating those already in the collist. cSs g|] }|jdur |jn|qSrC)_order_by_label_elementr4.0colr'r'r( sz4expand_column_list_from_order_by..csg|]}|vr|qSr'r'ricols_already_presentr'r(rls cSsg|]}t|qSr')rd)rjor'r'r(rls)setr)collistorder_byr'rmr( expand_column_list_from_order_bys rscCs t|D] }||kr dSqdS)zGiven a target clause and a second to search within, return True if the target is plainly present in the search without any subqueries or aliases involved. Basically descends through Joins. TF)surface_selectables)rSsearchr7r'r'r(clause_is_presents rvccsZ|g}|r+|}|Vt|tr||j|jfn t|tr'||j|sdSdSrC) r2r+rextendr0r1rrEr4)rSr;r7r'r'r(rts    rtTccsbtf}|s |tf7}t|g}|r/|}|V|D] }t||r%q||q|sdSdS)ztraverse and yield only outer-exposed column elements, such as would be addressable in the WHERE clause of a SELECT if this element were in the columns clause.N)rrrr\r3r+rE)rSinclude_scalar_selectsfilter_r;r7subr'r'r(surface_column_elementss      r{cCsttt|t|S)z:Return True if left/right have some overlapping selectable)boolrprt intersection)r0r1r'r'r(selectables_overlapsr~cs&gfdd}t|id|iS)zReturn an ordered list of "bound" values in the given clause. E.g.:: >>> expr = and_( ... table.c.foo==5, table.c.foo==7 ... ) >>> bind_values(expr) [5, 7] crMrC)rEeffective_value)bindvr'r(visit_bindparam)rPz$bind_values..visit_bindparam bindparam)rrR)rSrr'rr( bind_valuess rcCs(t|tjr|dd}d|St|S)N'z''z'%s')r+r string_typesrerepr)r4r'r'r(_quote_ddl_expr0s  rc@s$eZdZdZdZdZdZddZdS) _repr_baserrr) max_charscCsPt|}t|}||jkr&|jd}|d|d||j|| d}|S)Nrrz# ... (%d characters truncated) ... )rlenr)selfvaluereplenrepsegment_lengthr'r'r(trunc?s    z_repr_base.truncN)__name__ __module__ __qualname___LIST_TUPLE_DICT __slots__rr'r'r'r(r8s  rc@s&eZdZdZdZd ddZddZdS) _repr_rowzProvide a string view of a row.)row,cC||_||_dSrC)rr)rrrr'r'r(__init__T z_repr_row.__init__cs>|jddfdd|jDt|jdkrdfSdfS)N(%s%s), c3|]}|VqdSrCr'rjrrr'r( [z%_repr_row.__repr__..r,)rrArr)rr'rr(__repr__Xsz_repr_row.__repr__Nr)rrr__doc__rrrr'r'r'r(rOs   rc@s6eZdZdZdZd ddZddZdd Zd d Zd S) _repr_paramszProvide a string view of bound parameters. Truncates display to a given numnber of 'multi' parameter sets, as well as long values to a given number of characters. )paramsbatchesrcCs||_||_||_dSrC)rrr)rrrrr'r'r(rjs z_repr_params.__init__c Cst|jtr|j}|jot|jdtttf}n*t|jtr0|j}|jo.t|jdtttf}nt|jtr<|j}d}n||jS|r{t |j|j kr{d}d | |jd|j d|dd||j t |jf| |jdd|ddfS|r| |j|S| |j|S) NrFz8 ... displaying %i of %i total bound parameter sets ...  rr)r+rrrdicttuplerrrrrrA _repr_multir)rtypismultimsgr'r'r(ros6     z_repr_params.__repr__cs|r;t|dtr jn t|dtrjnt|dtr#jn Jdt|ddfdd|D}nd}|jkrFd|Sd |S) NrFzUnknown parameter type %src3s|] }|VqdSrC)r)rjr elem_typerr'r(rs  z+_repr_params._repr_multi..r[%s]z(%s)) r+rrrrrrtyperA)r multi_paramsrelementsr'rr(rs"   z_repr_params._repr_multics|j||jurddfdd|DS||jur7ddfdd|Dt|dkr3dfSd fSd dfd d|DS) Nz{%s}rc3s$|] \}}d||fVqdS)z%r: %sNr')rjkeyrrr'r(rs  z,_repr_params._repr_params..rc3rrCr'rrr'r(rrrrrrc3rrCr'rrr'r(rr)rrrAitemsrr)rrrr'rr(rs  z_repr_params._repr_paramsNr) rrrrrrrrrr'r'r'r(r`s ! rcsfdd}t|id|iS)zWgiven criterion containing bind params, convert selected elements to IS NULL. csxt|jtr|jjvr|j|_t|_tj|_tj |_ dSt|jtr8|jjvr:t|_tj|_tj |_ dSdSdSrC) r+r0r_identifying_keyr1rris_r.isnotnegater*nullsr'r( visit_binarys      z-adapt_criterion_to_null..visit_binaryr*)rcloned_traverse)critrrr'rr(adapt_criterion_to_nulls rNcCs|dur|S|dfg}t|}d}|rN|\}}t|tr:||ur:|}|||j|_||j |fn||}|durF||_ |durL|}|s|SrC) ClauseAdapterr2r+r_clone_reset_exportedrRonclauserEr0)r0r1stop_onr;adapterret prevrightr'r'r( splice_joinss&   rc s|dd}|ddttD]L}tdd|jDD]?}D]:}||ur.q'z|j}Wntjy@|r?Yq'tj yL|rKYq'w| |rarZ|j |j kra |nq'q#q|rfdd}|D]} | durt | id |iqptS) aCgiven a list of columns, return a 'reduced' set based on natural equivalents. the set is reduced to the smallest list of columns which have no natural equivalent present in the list. A "natural equivalent" means that two columns will ultimately represent the same value because they are related by a foreign key. \*clauses is an optional list of join clauses which will be traversed to further identify columns that are "equivalent". \**kw may specify 'ignore_nonexistent_tables' to ignore foreign keys whose tables are not yet configured, or columns that aren't yet present. This function is primarily used to determine the most minimal "primary key" from a selectable, by reducing the set of primary key columns present in the selectable to just those that are not repeated. ignore_nonexistent_tablesF only_synonymscSg|]}|jqSr') foreign_keysrjrcr'r'r(rl z"reduce_columns..cs|jtjkr=ttddD}|j|vr?|j|vrAt D]}| |jr<r4|j |jj kr< |dSq#dSdSdSdS)NcSrr') proxy_setrr'r'r(rl(rz8reduce_columns..visit_binary..) r.reqrr[r differencer0r1reversedshares_lineagenamer_)r*r`rccolumnsomitrr'r(r%s    z$reduce_columns..visit_binaryNr*)r2rordered_column_setr[rrrNrNoReferencedColumnErrorNoReferencedTableErrorrrr_rrRr r) rr!kwrrkfkrcfk_colrrSr'rr(reduce_columnssF        rcsHr r tdddfdd}gt|id|iS)z9traverse an expression and locate binary criterion pairs.zSCan only specify one of 'consider_as_foreign_keys' or 'consider_as_referenced_keys'cSs ||SrC)compare)abr'r'r(col_isHs z"criterion_as_pairs..col_iscss |jtjur dSt|jtrt|jtsdSrV|jvr6|j|js+|jvr6|j|jfdS|jvrR|j|jsG|jvrT|j|jfdSdSdSr|jvrt|j|jsi|jvrt|j|jfdS|jvr|j|js|jvr|j|jfdSdSdSt|jtrt|jtr|j |jr|j|jfdS|j |jrȈ|j|jfdSdSdSdSrC) r.rrr+r0rr1rEr referencesr any_operatorrconsider_as_foreign_keysconsider_as_referenced_keyspairsr'r(rLsR            z(criterion_as_pairs..visit_binaryr*)r ArgumentErrorrrR) expressionrrrrr'rr(criterion_as_pairs9s'rc@s:eZdZdZ     d ddZejfddZdd ZdS) ra5Clones and modifies clauses based on column correspondence. E.g.:: table1 = Table('sometable', metadata, Column('col1', Integer), Column('col2', Integer) ) table2 = Table('someothertable', metadata, Column('col1', Integer), Column('col2', Integer) ) condition = table1.c.col1 == table2.c.col1 make an alias of table1:: s = table1.alias('foo') calling ``ClauseAdapter(s).traverse(condition)`` converts condition to read:: s.c.col1 == table2.c.col1 NFcCs:|g|d|_||_||_||_t|pi|_||_dS)N)ranonymize_labels)__traverse_options__ selectable include_fn exclude_fnr column_dict equivalentsadapt_on_names)rrrrrrrr'r'r(rs  zClauseAdapter.__init__cCs|jj||d}|dur1||jvr1||vr1|j|D]}|j||||gd}|dur0|Sq|jr@|dur@|jj|j}|S)N)require_embedded)r_seen) rcorresponding_columnr_corresponding_columnunionrrcgetr)rrkrrnewcolequivr'r'r(rs  z#ClauseAdapter._corresponding_columncCs^t|tr|j|r|jSt|tsdS|jr||sdS|jr)||r)dS||dS)NT)r+rrr rrrr)rrkr'r'r(res  zClauseAdapter.replace)NNNFF) rrrrrr EMPTY_SETrrer'r'r'r(rxs  rc@sleZdZdZ        dddZGdddeZd d Zd d ZeZ e j Z d dZ ddZddZdS) ColumnAdapteraExtends ClauseAdapter with extra utility functions. Key aspects of ColumnAdapter include: * Expressions that are adapted are stored in a persistent .columns collection; so that an expression E adapted into an expression E1, will return the same object E1 when adapted a second time. This is important in particular for things like Label objects that are anonymized, so that the ColumnAdapter can be used to present a consistent "adapted" view of things. * Exclusion of items from the persistent collection based on include/exclude rules, but also independent of hash identity. This because "annotated" items all have the same hash identity as their parent. * "wrapping" capability is added, so that the replacement of an expression E can proceed through a series of adapters. This differs from the visitor's "chaining" feature in that the resulting object is passed through all replacing functions unconditionally, rather than stopping at the first one that returns non-None. * An adapt_required option, used by eager loading to indicate that We don't trust a result row column that is not translated. This is to prevent a column from being interpreted as that of the child row in a self-referential scenario, see inheritance/test_basic.py->EagerTargetingTest.test_adapt_stringency NFTc Csftj||||||| d|r||t|j|_|js |jr(| ||j|_||_ ||_ d|_ dS)N)rrrr) rrrrpopulate_column_dict _locate_colrrr_IncludeExcludeMappingadapt_requiredallow_label_resolve_wrap) rrrchain_tor rrrr rr'r'r(rs"    zColumnAdapter.__init__c@seZdZddZddZdS)z$ColumnAdapter._IncludeExcludeMappingcCrrC)parentr)rrrr'r'r(rrz-ColumnAdapter._IncludeExcludeMapping.__init__cCsL|jjr |j|r|jjr!|j|r!|jjr|jjj|S|S|j|SrC)rrrrr)rrr'r'r( __getitem__ s   z0ColumnAdapter._IncludeExcludeMapping.__getitem__N)rrrrrr'r'r'r(r s r cCsP|j|j}|j|j||_t|j|_|j s|j r&| ||j|_|SrC) __class____new____dict__rKrrr r rrrr )rracr'r'r(wraps zColumnAdapter.wrapcCs |j|SrC)r)robjr'r'r(rRs zColumnAdapter.traversecCsHt||}|jr|j|}|dur|}|jr||urdS|j|_|SrC)rrRrr r r _allow_label_resolve)rrkrcc2r'r'r(r %s  zColumnAdapter._locate_colcCs|j}|d=|S)Nr)rcopy)rdr'r'r( __getstate__5s zColumnAdapter.__getstate__cCs|j|t|j|_dSrC)rrKr PopulateDictr r)rstater'r'r( __setstate__:s zColumnAdapter.__setstate__)NNFNNFTF)rrrrrobjectr rrR adapt_clausercopy_and_process adapt_listr rrr'r'r'r(rs&!   r)FFFFF)TrC)NNF)?r collectionsr itertoolsrrrr annotationrrr baser r ddlr rr rrrrrrrschemarrrrrrrrr langhelperspublic_factory_join_conditionjoin_conditionr)r>rZrdrgrsrvrtr{r~rrr rrrrrrrReplacingCloningVisitorrrr'r'r'r(sv                          @ ( Z M ?P