o h>@sddlZddlZddlZddlZddlmZddlmZmZddl m Z m Z ddl m Z mZddlmZddlmZddlmZdd lmZdd lmZmZdZdZd Zejejd Z d dZ!ddedfddZ"GdddeZ#dS)N) timedelta) BaseCommand CommandError)close_old_connections reset_queries) force_str smart_bytes)now connections) NotHandled)SearchQuerySet)haystack_get_modelshaystack_load_apps)levelc Cst|dkrtd|td|\ }}}}}}}}} } ddlm} | jD]*\} } d| dvrQztt | j t r@| j | =nt | j | Wq't yPYq'wq't|t|}||}t|}|j|||d}t|||||||| | |S) N z.update_worker received incorrect arguments: %rz*update_worker received incorrect argumentsrr sqlite3ENGINEusing start_dateend_date)lenLOGerror ValueError django.dbr databasesitemsr isinstance _connectionsdictdelattrKeyErrorhaystack_connectionsreset_sessionsget_unified_index get_index get_backendbuild_queryset do_update)argsmodelstartendtotalrrr verbositycommit max_retriesr aliasinfo unified_indexindexbackendqsr:[/var/www/html/env/lib/python3.10/site-packages/haystack/management/commands/update_index.py update_workersF            r<Tc  Cs|d} | dur| j| dd||} n| ||} d} t| } | r+| dj} ttdo7ttk} |dkrX| rJt d|d||fnt d|d||tfd }||krz|j || |d |dkr{|r{t d |d||d|WnMt y}z=|d7}|d|||t|d }d }| s|d7}||krt |||dkrt j||ddtd|WYd}~nd}~ww||ks^t| S)Npk)pk__gtgetppidz indexed %s - %d of %d.r=z) indexed %s - %d of %d (worker PID: %s).rr2z-Completed indexing {} - {}, tried {}/{} times)r.r/retriesr3pidexczPFailed indexing %(start)s - %(end)s (retry %(retries)s/%(max_retries)s): %(exc)sz (pid %(pid)s): %(exc)sT)exc_info)allorder_byfilterlistr>hasattrosgetpidrAprintupdateformat Exceptionr exceptionwarningtimesleepr)r8r7r9r.r/r0r1r2r3 last_max_pksmall_cache_qs current_qsmax_pkis_parent_processrDrF error_context error_msgr:r:r;r+Hsf     (r+c@s(eZdZdZddZddZddZdS) Commandz(Freshens the index for the given app(s).c Cs|jdddd|jddtdd|jd d ttd d |jd dddd|jddddd|jdddtdd|jdddddd |jd!d"d#gd$d |jd%d&td'd(d |jd)d*d+d,d-d.|jd/d0d1d2ttd3d4dS)5N app_label*z7App label of an application to update the search index.)nargshelpz-mz --minutesz/Number of minutes back to consider objects new.)typerbz-az--agez-Number of hours back to consider objects new.)rcdefaultrbz-sz--startrzwThe start date for indexing. Can be any dateutil-parsable string; YYYY-MM-DDTHH:MM:SS is recommended to avoid confusion)destrbz-ez--endrzuThe end date for indexing. Can be any dateutil-parsable string; YYYY-MM-DDTHH:MM:SS is recommended to avoid confusionz-bz --batch-size batchsizez!Number of items to index at once.)rercrbz-rz--remove store_trueFzIRemove objects from the index that are no longer present in the database.)actionrdrbz-uz--usingappendzdUpdate only the named backend (can be used multiple times). By default all backends will be updated.z-kz --workersrzT)flatcSh|]}t|qSr:r.0r>r:r:r; sz)Command.update_backend..cSrr:rrr:r:r;rsidz removing %d stale records.z removing %s.rC),r%r)r'rr(r r1stdoutwritertrr*rrcountr_metaverbose_name_pluralrf batch_sizerangeminr+r2r3rimultiprocessingPoolmapr<rstderrreprclosejoinrsindex_queryset values_listr connection_aliasmodelssetradd)rprrr8r6r-r7r9r0r ghetto_queuerZr.r/poolsuccessful_tasksi database_pks index_total index_pks stale_records upper_boundr>rec_idr:r:r;r-s                    zCommand.update_backendN)__name__ __module__ __qualname__rbrrrrr:r:r:r;r^s O s0     7 W