o h<@sdZddlZddlZddlZddlmZddlZddlmZddl m Z ddl m Z m Z mZddlmZmZddlmZmZmZdd lmZdd lmZd Zd Zd dZddZddZddZGdddZ Gddde Z!ej"eddddej#eddZ$dS)aStart multiple worker instances from the command-line. .. program:: celery multi Examples ======== .. code-block:: console $ # Single worker with explicit name and events enabled. $ celery multi start Leslie -E $ # Pidfiles and logfiles are stored in the current directory $ # by default. Use --pidfile and --logfile argument to change $ # this. The abbreviation %n will be expanded to the current $ # node name. $ celery multi start Leslie -E --pidfile=/var/run/celery/%n.pid --logfile=/var/log/celery/%n%I.log $ # You need to add the same arguments when you restart, $ # as these aren't persisted anywhere. $ celery multi restart Leslie -E --pidfile=/var/run/celery/%n.pid --logfile=/var/log/celery/%n%I.log $ # To stop the node, you need to specify the same pidfile. $ celery multi stop Leslie --pidfile=/var/run/celery/%n.pid $ # 3 workers, with 3 processes each $ celery multi start 3 -c 3 celery worker -n celery1@myhost -c 3 celery worker -n celery2@myhost -c 3 celery worker -n celery3@myhost -c 3 $ # override name prefix when using range $ celery multi start 3 --range-prefix=worker -c 3 celery worker -n worker1@myhost -c 3 celery worker -n worker2@myhost -c 3 celery worker -n worker3@myhost -c 3 $ # start 3 named workers $ celery multi start image video data -c 3 celery worker -n image@myhost -c 3 celery worker -n video@myhost -c 3 celery worker -n data@myhost -c 3 $ # specify custom hostname $ celery multi start 2 --hostname=worker.example.com -c 3 celery worker -n celery1@worker.example.com -c 3 celery worker -n celery2@worker.example.com -c 3 $ # specify fully qualified nodenames $ celery multi start foo@worker.example.com bar@worker.example.com -c 3 $ # fully qualified nodenames but using the current hostname $ celery multi start foo@%h bar@%h $ # Advanced example starting 10 workers in the background: $ # * Three of the workers processes the images and video queue $ # * Two of the workers processes the data queue with loglevel DEBUG $ # * the rest processes the default' queue. $ celery multi start 10 -l INFO -Q:1-3 images,video -Q:4,5 data -Q default -L:4,5 DEBUG $ # You can show the commands necessary to start the workers with $ # the 'show' command: $ celery multi show 10 -l INFO -Q:1-3 images,video -Q:4,5 data -Q default -L:4,5 DEBUG $ # Additional options are added to each celery worker's command, $ # but you can also modify the options for ranges of, or specific workers $ # 3 workers: Two with 3 processes, and one with 10 processes. $ celery multi start 3 -c 3 -c:1 10 celery worker -n celery1@myhost -c 10 celery worker -n celery2@myhost -c 3 celery worker -n celery3@myhost -c 3 $ # can also specify options for named workers $ celery multi start image video data -c 3 -c:image 10 celery worker -n image@myhost -c 10 celery worker -n video@myhost -c 3 celery worker -n data@myhost -c 3 $ # ranges and lists of workers in options is also allowed: $ # (-c:1-3 can also be written as -c:1,2,3) $ celery multi start 5 -c 3 -c:1-3 10 celery worker -n celery1@myhost -c 10 celery worker -n celery2@myhost -c 10 celery worker -n celery3@myhost -c 10 celery worker -n celery4@myhost -c 3 celery worker -n celery5@myhost -c 3 $ # lists also works with named workers $ celery multi start foo bar baz xuzzy -c 3 -c:foo,bar,baz 10 celery worker -n foo@myhost -c 10 celery worker -n bar@myhost -c 10 celery worker -n baz@myhost -c 10 celery worker -n xuzzy@myhost -c 3 Nwraps)cached_property)VERSION_BANNER)Cluster MultiParserNamespacedOptionParser) CeleryCommandhandle_preload_options) EX_FAILUREEX_OKsignals)term) pluralize) MultiToolausage: {prog_name} start [worker options] {prog_name} stop [-SIG (default: -TERM)] {prog_name} restart [-SIG] [worker options] {prog_name} kill {prog_name} show [worker options] {prog_name} get hostname [-qv] [worker options] {prog_name} names {prog_name} expand template {prog_name} help additional options (must appear after command name): * --nosplash: Don't display program info. * --quiet: Don't show as much output. * --verbose: Show more output. * --no-color: Don't display colors. cCstttjdSN)sysexitrexecute_from_commandlineargvrrB/var/www/html/env/lib/python3.10/site-packages/celery/bin/multi.pymainsrctfdd}|S)Ncs||g|Ri|Sr)splash)selfargskwargsfunrr_innerszsplash.._innerrrr rrrrsrcr)Ncs|||fi|Sr)cluster_from_argv)rrrrrrr zusing_cluster.._innerrr!rrr using_clustersr$cr)Ncs,||\}}||}|||fi|Sr)_cluster_from_argv_find_sig_argument)rrrpclustersigrrrr s z%using_cluster_and_sig.._innerrr!rrrusing_cluster_and_sigsr*c@seZdZdZdeiZdZ  dddZdd d Zdd d Z dd dZ dddZ dddZ dddZ eddZddZeddZdS) TermLoggerzcelery multi v{version}versionrFcKs4|ptj|_|p tj|_||_||_||_||_dSr)rstdoutstderrnosplashquietverboseno_color)rr-r.r/r0r1r2rrrrsetup_terminals   zTermLogger.setup_terminalTNcCs|j|||dtS)N)newlinefile)sayr rmr4r5rrroksz TermLogger.okcCs t||p|j|r dndddS)N )r5end)printr-r7rrrr6s zTermLogger.saycCs||||p|jSr)r6r.r7rrrcarpzTermLogger.carpcCs|r|||tSr)r>usager )rmsgrrrerrors zTermLogger.errorcCs|jr |j||ddSdSNr4)r1noterrAr4rrrinfoszTermLogger.infocCs |js|jt||ddSdSrC)r0r6strrFrrrrEszTermLogger.notecCs|tj|jddS)N) prog_name)r6USAGEformatrIrrrrr@r#zTermLogger.usagecCs0|js||j|jjdi|jdSdS)Nr)r/rEcoloredcyan splash_textrKsplash_contextrLrrrrs   zTermLogger.splashcCstj|j dS)N)enabled)rrMr2rLrrrrMzTermLogger.colored)FFFF)TNr)T)__name__ __module__ __qualname__rOrrPretcoder3r9r6r>rBrGrErr@rrMrrrrr+s$      r+c@seZdZdZeZeZgdZ  dPddZdQddZ dd Z d d Z d d Z e eddZe eddZe eddZeZe eddZeddZddZeddZe eddZddZd d!Zejfd"d#ZdQd$d%ZdQd&d'ZdQd(d)Z dQd*d+Z!d,d-Z"d.d/Z#d0d1Z$d2d3Z%d4d5Z&d6d7Z'd8d9Z(d:d;Z)dd?Z+d@dAZ,dBdCZ-dDdEZ.dFdGZ/dHdIZ0e1dJdKZ2e1dLdMZ3e1dNdOZ4dS)RrzThe ``celery multi`` program.))z --nosplashr/)z--quietr0)z-qr0)z --verboser1)z --no-colorr2Nc Ksj||_||_|j|p ||fi||j|_d|_|j|j|j|j |j |j |j |j |j |j|jd |_dS)Nz celery multi) startshowstopstopwait stop_verifyrestartkillnamesexpandgethelp)envcmdr3r-fhrIrWrXrYrZr\r]r^r_r`racommands)rrbrcrdr-r.rrrr__init__s" zMultiTool.__init__cCs\||}|dur |n|j|_tj|d|_||s"|S| |d|ddS)Nr) _handle_reserved_optionsrcospathbasenamepoprIvalidate_argumentsrB call_command)rrrcrrrrs  z"MultiTool.execute_from_commandlinecCs|o |dddkS)Nr-rrrrrrrmr?zMultiTool.validate_argumentscCs8z |j||p tWSty|d|YSw)NzInvalid command: )rer KeyErrorrB)rcommandrrrrrns  zMultiTool.call_commandc Cs@t|}|jD]\}}||vrt||t|||q|Sr)listreserved_optionssetattrboolrlindex)rrargattrrrrrhs z"MultiTool._handle_reserved_optionscCs|dtt|S)Nz> Starting nodes...)rEintanyrWrr(rrrrW!s zMultiTool.startcK|jdd|i|SNr)r)rYrr(r)rrrrrY'zMultiTool.stopcKr}r~)rZrrrrrZ,rzMultiTool.stopwaitcKstt|jdd|i|Sr~)rzr{r\rrrrr\2szMultiTool.restartcCs|ddd|DdS)Nr:css|]}|jVqdSr)name).0nrrr 9sz"MultiTool.names..)r6joinr|rrrr^7szMultiTool.namescGs>z |||}Wn tytYSw|d|jS)N )r"findrqr r9rr)rwantedrnoderrrr`;s  z MultiTool.getcCs|ddd|DS)Nr:css|] }d|jVqdS)rN)rargv_with_executablerrrrrrEs  z!MultiTool.show..)r9rr|rrrrXCs zMultiTool.showcCs|Sr)r]r|rrrr]JszMultiTool.killcs$|dfdd||DS)Nr:c3s|]}|VqdSr)expanderrtemplaterrrPs  z#MultiTool.expand..)r9rr")rrrrrrr_Os zMultiTool.expandcGs|tdSr)r6__doc__rprrrraUzMultiTool.helpc Cs|jt|jd}t|D]?}t|dkr/|ddkr/z t|dWSty.Ynw|ddkrMz t|ddWStt fyLYqwq|S)Nrrorg) rlenvaluesreversedrz ValueErrorr signumAttributeError TypeError)rr'defaultrrxrrrr&Xs    zMultiTool._find_sig_argumentcCs:|dur|n|j}||}|||j|d|fSN)rc)rc OptionParserparser)rrrcr'rrr_nodes_from_argvgs zMultiTool._nodes_from_argvcCs|j||d\}}|Sr)r%)rrrc_r(rrrr"mszMultiTool.cluster_from_argvcCs(|j||d\}}||jt||dfSr)rrrs)rrrcr'nodesrrrr%qszMultiTool._cluster_from_argvcCst|fid|d|jd|jd|jd|jd|jd|jd|jd |jd |j d |j d |j d |j d|j d|jd|jd|jS)Nrcrbon_stopping_preambleon_send_signalon_still_waiting_foron_still_waiting_progresson_still_waiting_end on_node_starton_node_restarton_node_shutdown_okon_node_statuson_node_signal_deadon_node_signal on_node_downon_child_spawnon_child_signalledon_child_failure)rrbrrrrrrrrrrrrrrr)rrrcrrrrusJ     zMultiTool.ClustercCs||jddS)Nz> Stopping nodes...)rErMbluerrrrrrzMultiTool.on_stopping_preamblecCs|d||dS)Nz > {0.name}: {1} -> {0.pid}rErKrrr)rrrrrzMultiTool.on_send_signalc CsJt|}|r#|j|jd|t|dddd|DdddSdS)Nz> Waiting for {} {} -> {}...rz, css|]}t|jVqdSr)rHpidrrrrrsz1MultiTool.on_still_waiting_for..FrD)rrErMrrKrr)rrnum_leftrrrrs   zMultiTool.on_still_waiting_forcCs|jddddS)N.FrDrErrrrrsz#MultiTool.on_still_waiting_progresscCs|ddS)Nr;rrLrrrrrzMultiTool.on_still_waiting_endcCs|d|dS)Nz4Could not signal {0.name} ({0.pid}): No such processrrrrrrrs zMultiTool.on_node_signal_deadcCs|jd|jddddS)Nz > : FrD)rErrrrrrszMultiTool.on_node_startcCs$|j|jd|jddddS)Nz> Restarting node rFrD)rErMrrrrrrrs   zMultiTool.on_node_restartcC|d|jd|jdS)Nz> r)rErDOWNrrrrrzMultiTool.on_node_downcCr)Nz > r)rErOKrrrrrrzMultiTool.on_node_shutdown_okcCs||r|jp |jdSr)rEFAILEDr)rrretvalrrrrszMultiTool.on_node_statuscCs|dj||ddS)Nz(Sending {sig} to node {0.name} ({0.pid}))r)rrrrrrs zMultiTool.on_node_signalcC|d|dS)Nz )rG)rrargstrrbrrrrr?zMultiTool.on_child_spawncCr)Nz!* Child was terminated by signal r)rrrrrrrr?zMultiTool.on_child_signalledcCr)Nz"* Child terminated with exit code r)rrrVrrrrr?zMultiTool.on_child_failurecCt|jdS)Nr)rHrMgreenrLrrrrrRz MultiTool.OKcCr)Nr)rHrMredrLrrrrrRzMultiTool.FAILEDcCr)Nr)rHrMmagentarLrrrrrRzMultiTool.DOWN)NNNNNr)5rSrTrUrrrrrtrfrrmrnrhrr$rWr*rYrZr[r\r^r`rXr]r_rasignalSIGTERMr&rr"r%rrrrrrrrrrrrrrrrrrrrrrrrrsz                rT)allow_extra_argsignore_unknown_options)clscontext_settingscKsPt|jj|jjd}tjdd}||dd|d|d}||S)z Start multiple worker instances.)r0r2rgNmulti)robjr0r2rrrwr)ctxrrcrrrrrs $ r)%rrirr functoolsrclickkombu.utils.objectsrceleryrcelery.apps.multirrrcelery.bin.baser r celery.platformsr r r celery.utilsrcelery.utils.textr__all__rJrrr$r*r+rrr pass_contextrrrrrs>d       8n