Server : LiteSpeed System : Linux barito.iixcp.rumahweb.net 5.14.0-611.49.1.el9_7.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Apr 21 16:39:08 EDT 2026 x86_64 User : elvh3918 ( 1528) PHP Version : 8.2.31 Disable Function : mail Directory : /usr/local/lib/python3.9/site-packages/celery/backends/__pycache__/ |
a
��Sh�g � @ s� d Z ddlZddlmZ ddlmZ ddlmZmZm Z ddl
m Z ddl m
Z
ddlmZ dd lmZmZ dd
lmZ dd lmZ dd lmZ dd
lmZmZm Z ddl m Z m Z ddl m!Z!m"Z" ddl#m$Z$ ddl%m&Z& ddl'm(Z(m)Z) ddl*m+Z+ zddl,Z-ddl.m/Z/ W n e0�y, dZ-dZ/Y n0 z ddl1Z-W n e0�yN Y n0 dZ2dZ3dZ4dZ5dZ6dZ7d Z8d Z9d Z:e$e;�Z<G d d � d e)�Z=G d!d"� d"e+e(�Z>e?e-d#d��r�G d$d%� d%e-j@jAe-jB�ZCG d&d'� d'e>�ZDdS )(zRedis result store backend.� N)�contextmanager)�partial)� CERT_NONE�
CERT_OPTIONAL�
CERT_REQUIRED)�unquote)�retry_over_time)�cached_property)�
_parse_url�maybe_sanitize_url)�states)�task_join_will_block)�maybe_signature)�BackendStoreError�
ChordError�ImproperlyConfigured)� GroupResult�allow_join_result)�_regen�
dictfilter)�
get_logger)�humanize_seconds� )�AsyncBackendMixin�BaseResultConsumer)�BaseKeyValueStoreBackend)�get_redis_error_classes)� RedisBackend�SentinelBackendzW
You need to install the redis library in order to use the Redis result store backend.
zp
You need to install the redis library with support of sentinel in order to use the Redis result store backend.
z�
Setting ssl_cert_reqs=CERT_OPTIONAL when connecting to redis means that celery might not validate the identity of the redis broker when connecting. This leaves you vulnerable to man in the middle attacks.
z�
Setting ssl_cert_reqs=CERT_NONE when connecting to redis means that celery will not validate the identity of the redis broker when connecting. This leaves you vulnerable to man in the middle attacks.
z�
SSL connection parameters have been provided but the specified URL scheme is redis://. A Redis SSL connection URL should use the scheme rediss://.
zv
A rediss:// URL must have parameter ssl_cert_reqs and this must be set to CERT_REQUIRED, CERT_OPTIONAL, or CERT_NONE
z+Connection to Redis lost: Retry (%s/%s) %s.z�
Retry limit exceeded while trying to reconnect to the Celery redis result store backend. The Celery application must be restarted.
c s� e Zd ZdZ� fdd�Z� fdd�Zdd� Zedd � �Zd
d � Z � fd d
�Z
dd� Z dd� Z dd� Z
d dd�Zdd� Zdd� Zdd� Z� ZS ) �ResultConsumerNc sF t � j|i |�� | jj| _| jj| _| jj| _| jj | _
t � | _ d S �N)
�super�__init__�backendZget_key_for_task�_get_key_for_taskZ
decode_result�_decode_result�ensure�_ensure�connection_errors�_connection_errors�set�
subscribed_to��self�args�kwargs�� __class__� �?/usr/local/lib/python3.9/site-packages/celery/backends/redis.pyr" S s
zResultConsumer.__init__c
sh z&| j jj�� | jd ur$| j�� W n2 tyX } zt�t |�� W Y d }~n
d }~0 0 t
� � � d S r ) r# �client�connection_pool�reset�_pubsub�close�KeyError�logger�warning�strr! �
on_after_fork)r- �er0 r2 r3 r= [ s
$z ResultConsumer.on_after_forkc C s� d | _ | jjj�� | jrT| jj�| j�}dd� |D �}|D ]}| �| �|�d � q<| jjj dd�| _ | jr|| j j
| j� n*| j j� d| j j �| j _
| j j
�| j j� d S )Nc S s g | ] }|r|�qS r2 r2 )�.0�metar2 r2 r3 �
<listcomp>k � z4ResultConsumer._reconnect_pubsub.<locals>.<listcomp>T�Zignore_subscribe_messages�pubsub)r7 r# r4 r5 r6 r+ �mget�on_state_changer% rD � subscribe�get_connectionZ
shard_hint�
connectionZregister_connect_callbackZ
on_connect)r- Zmetasr@ r2 r2 r3 �_reconnect_pubsubd s ��z ResultConsumer._reconnect_pubsubc c sX z
d V W nH | j yR z| �| jd� W n | j yL t�t� � Y n0 Y n0 d S )Nr2 )r) r' rJ r: �critical�E_RETRY_LIMIT_EXCEEDED�r- r2 r2 r3 �reconnect_on_error| s
z!ResultConsumer.reconnect_on_errorc C s |d t jv r | �|d � d S )N�status�task_id)r Z READY_STATES�
cancel_for)r- r@ r2 r2 r3 �_maybe_cancel_ready_task� s z'ResultConsumer._maybe_cancel_ready_taskc s t � �||� | �|� d S r )r! rF rR )r- r@ �messager0 r2 r3 rF � s z ResultConsumer.on_state_changec K s | j jjdd�| _| �|� d S )NTrC )r# r4 rD r7 �
_consume_from)r- Zinitial_task_idr/ r2 r2 r3 �start� s �zResultConsumer.startc K s. |j f i |��D ]}|d ur| �|d � qd S r )Z
_iter_metarF )r- �resultr/ r@ r2 r2 r3 �on_wait_for_pending� s z"ResultConsumer.on_wait_for_pendingc C s | j d ur| j �� d S r )r7 r8 rM r2 r2 r3 �stop� s
zResultConsumer.stopc C sv | j rd| �� �D | j j|d�}|rD|d dkrD| �| �|d �|� W d � qr1 sX0 Y n|rrt�|� d S )N)�timeout�typerS �data)r7 rN Z get_messagerF r% �time�sleep)r- rY rS r2 r2 r3 � drain_events� s
6zResultConsumer.drain_eventsc C s" | j d u r| �|�S | �|� d S r )r7 rU rT �r- rP r2 r2 r3 � consume_from� s
zResultConsumer.consume_fromc C sX | � |�}|| jvrT| j�|� | �� � | j�|� W d � n1 sJ0 Y d S r )r$ r+ �addrN r7 rG �r- rP �keyr2 r2 r3 rT � s
z ResultConsumer._consume_fromc C sT | � |�}| j�|� | jrP| �� � | j�|� W d � n1 sF0 Y d S r )r$ r+ �discardr7 rN Z unsubscriberb r2 r2 r3 rQ � s
zResultConsumer.cancel_for)N)�__name__�
__module__� __qualname__r7 r" r= rJ r rN rR rF rU rW rX r^ r` rT rQ �
__classcell__r2 r2 r0 r3 r P s
r c sN e Zd ZdZeZeZer ejndZdZdZ dZ
dZ d>� fdd� Z dd� Z
d d
� Ze� fd d ��Zd
d� Zdd� Zdd� Zdd� Zdd� Zdd� Zdd� Z� fdd �Zd d � Zd d � Zd!d"� Zd#d$� Z e j e j fd%d&�Z d'd(� Z!d)d*� Z"ed+d,� �Z#ed-d.� �Z$d?d/d0�Z%d1d2� Z&d3d4� Z'd5d6� Z(e)d7d8� �Z*ed9d:� �Z+d@� fd<d=� Z,� Z-S )Ar zyRedis task result store.
It makes use of the following commands:
GET, MGET, DEL, INCRBY, EXPIRE, SET, SETEX
NTi c s t � jf dti|�� | jjj} | jd u r6tt� � ��|rLd|v rL|d }}|p\| d�p\| j
| _
|| _ | d�}
| d�} | d�} | d�}
| d�}| d �p�d
| d �p�d | d
�p�d| d�| j
|
o�t |
�| p�d| o�t | �d�| _
| d�}|r�|| j
d< |r�|| j
d< |
�r |
| j
d< | d�}|�r2| j
�|� | j| j
d< |�rH| �|| j
�| _
d| j
v �r�t| j
d tj��r�d}ttttttd�}| j
�d|�}|�||�}||�� v�r�tt��|tk�r�t�t� n|tk�r�t�t � || j
d< || _ t �r�t � nd\| _ | _ | �!| | j| j"| j#| j$�| _%d S ) NZ expires_typez://Zredis_max_connectionsZredis_socket_timeoutZ redis_socket_connect_timeoutZredis_retry_on_timeoutZredis_socket_keepaliveZ#redis_backend_health_check_intervalZ
redis_host� localhostZ
redis_porti� Zredis_dbr Zredis_passwordF)�host�port�db�password�max_connections�socket_timeout�retry_on_timeout�socket_connect_timeoutZredis_username�username�health_check_interval�socket_keepaliveZredis_backend_use_ssl�connection_class�MISSING)r r r �required�optional�none�
ssl_cert_reqs)r2 r2 )&r! r" �int�app�conf�get�redisr �E_REDIS_MISSING�striprn �_ConnectionPool�float�
connparams�update�connection_class_ssl�_params_from_url�
issubclass�
SSLConnectionr r r �values�
ValueError�%E_REDIS_SSL_CERT_REQS_MISSING_INVALIDr: r; �W_REDIS_SSL_CERT_OPTIONAL�W_REDIS_SSL_CERT_NONE�urlr r( Zchannel_errorsr �acceptZ_pending_resultsZ_pending_messages�result_consumer)r- rj rk rl rm rn r� r5 r/ �_getro rq rp rt rs rr �sslZssl_cert_reqs_missingZssl_string_to_constantrz r0 r2 r3 r" � s�
��
�
��
�
�zRedisBackend.__init__c s� t |�\}}}}}}�t|fi t||||��dd �d����� |dkr�� �| jjd| d�� � �dd � � �dd � � �d� n|� d < g d
�} |d kr�t� fd d
�| D ��s�t�fdd
�| D ��r�tt ��|dk�rtj
� d< | D ] }
��|
d �} | r�t | �� |
< q� � d ��pd} t
| t��r.| �d�n| } t| �� d < ��� D ],\}
}|
tjjv �rFtjj|
|��|
< �qF� ��� � S )NZ virtual_host)rj rk rr rm rl �socket�/)ru �pathrj rk rq rl )Z ssl_ca_certsZ ssl_certfileZ ssl_keyfilerz r c 3 s | ]}|� v V qd S r r2 �r? rc )r� r2 r3 � <genexpr>N rB z0RedisBackend._params_from_url.<locals>.<genexpr>c 3 s | ]}|� v V qd S r r2 r� )�queryr2 r3 r� O rB Zredissru r )r
�dictr �popr� r ZUnixDomainSocketConnection�anyr� �&E_REDIS_SSL_PARAMS_AND_SCHEME_MISMATCHr� r r~ �
isinstancer< r� r{ �itemsrI ZURL_QUERY_ARGUMENT_PARSERS)r- r� �defaults�schemerj rk rr rm r� Zssl_param_keysZ ssl_settingZssl_valrl rc �valuer2 )r� r� r3 r� 3 sP � ��� �
�
z RedisBackend._params_from_urlc C s t || j�rdS dS )NTF)r� r( )r- �excr2 r2 r3 �exception_safe_to_retryj s z$RedisBackend.exception_safe_to_retryc s. t � j}d| jv r*|�� }|�| jd � |S )N� retry_policy)r! r� �_transport_options�copyr� )r- r� r0 r2 r3 r� o s
zRedisBackend.retry_policyc C s t � s| j�|� d S r )r
r� r` )r- ZproducerrP r2 r2 r3 � on_task_callx s zRedisBackend.on_task_callc C s | j �|�S r )r4 r~ �r- rc r2 r2 r3 r~ | s zRedisBackend.getc C s | j �|�S r )r4 rE )r- �keysr2 r2 r3 rE s zRedisBackend.mgetc K s> t | jfi |��}|�d�}t|| j|i t| j|�fi |��S )N� max_retries)r� r� r~ r r( r �on_connection_error)r- Zfunr. �policyr� r� r2 r2 r3 r& � s
��zRedisBackend.ensurec C s* t |�}t�t�� ||pdt|d�� |S )NZInfzin )�nextr: �error�E_LOSTr� r )r- r� r� Z intervals�retriesZttsr2 r2 r3 r� � s �z RedisBackend.on_connection_errorc K s: t |t�r t|�| jkr td��| j| j||ffi |��S )Nz!value too large for Redis backend)r� r< �len�_MAX_STR_VALUE_SIZEr r& �_set)r- rc r� r� r2 r2 r3 r* � s zRedisBackend.setc C sf | j �� �H}| jr$|�|| j|� n |�||� |�||� |�� W d � n1 sX0 Y d S r )r4 �pipeline�expires�setexr* �publish�execute)r- rc r� �piper2 r2 r3 r� � s zRedisBackend._setc s t � �|� | j�|� d S r )r! �forgetr� rQ r_ r0 r2 r3 r� � s zRedisBackend.forgetc C s | j �|� d S r )r4 �deleter� r2 r2 r3 r� � s zRedisBackend.deletec C s | j �|�S r )r4 �incrr� r2 r2 r3 r� � s zRedisBackend.incrc C s | j �||�S r )r4 �expire)r- rc r� r2 r2 r3 r� � s zRedisBackend.expirec C s | j �| �|d�d� d S )N�.tr )r4 r� �get_key_for_group)r- �group_idrV r2 r2 r3 � add_to_chord� s zRedisBackend.add_to_chordc C sB ||�\}}}}||v r"| � |�}||v r>td|� d|����|S )Nz Dependency z raised )Zexception_to_pythonr ) r- �tup�decode�EXCEPTION_STATES�PROPAGATE_STATES�_�tid�state�retvalr2 r2 r3 �_unpack_chord_result� s
z!RedisBackend._unpack_chord_resultc C s | � | �|d�|� d S )N�.s)r* r� )r- r� Z
chord_sizer2 r2 r3 �set_chord_size� s zRedisBackend.set_chord_sizec K s> t |d t�s:| jj|� }tdd� |jD ��r:|j| d� d S )Nr c s s | ]}t |t�V qd S r )r� r )r? �nrr2 r2 r3 r� � rB z+RedisBackend.apply_chord.<locals>.<genexpr>)r# )r� r r| r r� �results�save)r- Zheader_result_args�bodyr/ �
header_resultr2 r2 r3 � apply_chord� s zRedisBackend.apply_chordc C s | j �dd�S )NZresult_chord_orderedT)r� r~ rM r2 r2 r3 � _chord_zset� s zRedisBackend._chord_zsetc C s | j j�di �S )NZ result_backend_transport_options)r| r} r~ rM r2 r2 r3 r� � s z RedisBackend._transport_optionsc s | j }|j|j|j }}} |r$|s(d S | d u r4d} | j}
| �|d�} | �|d�} | �|d�}
| �||�}| �d|||g�}|
�� ��}| j r�|�
| || i�� | dd�n|� | |��
| ��| ��|
�}| jr�|�| | j��| | j��|
| j�}|�� d d� \}}}}W d � n1 �s0 Y t|�p.d�}|�r
�zBt|j|d �}t|�| }||k�rzt�|�}|d u�r�|�� |j�r�|jn|j}t� � ||j j d
d �}W d � n1 �s�0 Y n|| j | j � �|
�� �@}| j �r�|� | dd �}n|�!| d|�}|�� \}W d � n1 �s(0 Y � �fd
d�|D �}z�z|�"|� W n� t#�y� } zzt$�%d|j|� | �&|t'd|����W Y d }~W |
�� �*}|�(| ��(| ��(|
��� W d � n1 �s�0 Y W S d }~0 0 W |
�� �*}|�(| ��(| ��(|
��� W d � n1 �s(0 Y nF|
�� �*}|�(| ��(| ��(|
��� W d � n1 �sn0 Y 0 W n� t'�y� } z(t$�%d|j|� | �&||�W Y d }~S d }~0 t#�y } z2t$�%d|j|� | �&|t'd|����W Y d }~S d }~0 0 d S )Nz+infz.jr� r� r z-inf� r )r| T)rY � propagate���c s g | ]}�|� ��qS r2 r2 )r? r� �r� �unpackr2 r3 rA rB z5RedisBackend.on_chord_part_return.<locals>.<listcomp>z Chord callback for %r raised: %rzCallback error: zChord %r raised: %rz Join error: ))r| �id�group� group_indexr4 r� Z
encode_result�encoder� r� ZzaddZzcountZrpushZllenr~ r� r� r� r{ r Zchordr �restoreZon_ready�supports_native_joinZ join_native�joinr r} Zresult_chord_join_timeoutr� r� ZzrangeZlrange�delay� Exceptionr: � exceptionZchord_error_from_stackr r� )r- �requestr� rV r� r/ r| r� �gidr� r4 ZjkeyZtkeyZskey�encodedr� r� r� Z
readycountZ totaldiffZchord_size_bytes�callback�totalr� Z join_funcZreslr� r2 r� r3 �on_chord_part_return� s�
� ������8
�
��(
*� �
���(�
���*�
���. �z!RedisBackend.on_chord_part_returnc K s | � � | jf i |��d�S )N)r5 )� _get_client� _get_pool�r- �paramsr2 r2 r3 �_create_client0 s �zRedisBackend._create_clientc C s | j jS r )r Z StrictRedisrM r2 r2 r3 r� 5 s zRedisBackend._get_clientc K s | j f i |��S r )�ConnectionPoolr� r2 r2 r3 r� 8 s zRedisBackend._get_poolc C s | j d u r| jj| _ | j S r )r� r r� rM r2 r2 r3 r� ; s
zRedisBackend.ConnectionPoolc C s | j f i | j��S r )r� r� rM r2 r2 r3 r4 A s zRedisBackend.clientr2 c s( |si n|}t � �|t|| j| jd��S )N)r� r� )r! �
__reduce__r� r� r� r, r0 r2 r3 r� E s �zRedisBackend.__reduce__)NNNNNNN)N)r2 N).re rf rg �__doc__r r r� r� rn Zsupports_autoexpirer� r� r" r� r� r r� r� r~ rE r& r� r* r� r� r� r� r� r� r r� r� r� r� r� r� r� r� r� r� r� �propertyr� r4 r� rh r2 r2 r0 r3 r � s^ �a7 �
�
_
r �sentinelc @ s e Zd ZdZdS )� SentinelManagedSSLConnectionz�Connect to a Redis server using Sentinel + TLS.
Use Sentinel to identify which Redis server is the current master
to connect to and when connecting to the Master server, use an
SSL Connection.
N)re rf rg r� r2 r2 r2 r3 r� L s r� c sf e Zd ZdZdZeedd�Zer$endZ � fdd�Z
d� fdd � Z � fd
d �Z d d
� Z
dd� Z� ZS )r z!Redis sentinel task result store.�;r� Nc s, | j d u rtt�� ��t� j|i |�� d S r )r� r �E_REDIS_SENTINEL_MISSINGr� r! r" r, r0 r2 r3 r" ` s
zSentinelBackend.__init__Fc sD |rt � j|d�S dd� | jp d�| j�D �}| j�dd� |D ��S )zDReturn the server addresses as URIs, sanitizing the password or not.)�include_passwordc s s | ]}t |�V qd S r )r )r? �chunkr2 r2 r3 r� o s �z)SentinelBackend.as_uri.<locals>.<genexpr>� c s s( | ] }|� d �r |dd� n|V qdS )z:///Nr� )�endswith)r? �urir2 r2 r3 r� u s �)r! �as_urir� �split�_SERVER_URI_SEPARATORr� )r- r� Z
uri_chunksr0 r2 r3 r� f s �� �zSentinelBackend.as_uric s� |� | j�}t|g d�}|D ]"}t� j||d�}|d �|� q dD ]}|�|� qDdD ]2}|d rX||d d v rX|d d �|�||< qX|S )N)�hosts)r� r� r� )rj rk rl rm )rl rm r )r� r� r� r! r� �appendr� r~ )r- r� r� �chunksr� r� r[ �paramr0 r2 r3 r� z s � z SentinelBackend._params_from_urlc K sV |� � }|�d�}| j�dd�}| j�di �}| jjdd� |D �f||d�|��}|S )Nr� �min_other_sentinelsr �sentinel_kwargsc S s g | ]}|d |d f�qS )rj rk r2 )r? �cpr2 r2 r3 rA � rB z:SentinelBackend._get_sentinel_instance.<locals>.<listcomp>)r r )r� r� r� r~ r� ZSentinel)r- r� r� r� r r �sentinel_instancer2 r2 r3 �_get_sentinel_instance� s
���z&SentinelBackend._get_sentinel_instancec K s2 | j f i |��}| j�dd �}|j|| �� d�jS )N� master_name)Z service_nameZ redis_class)r r� r~ Z
master_forr� r5 )r- r� r r r2 r2 r3 r� � s �zSentinelBackend._get_pool)F)re rf rg r� r� �getattrr r� r� r� r" r� r� r r� rh r2 r2 r0 r3 r W s r )Er� r\ �
contextlibr � functoolsr r� r r r � urllib.parser Zkombu.utils.functionalr Zkombu.utils.objectsr Zkombu.utils.urlr
r Zceleryr Z
celery._stater
Z
celery.canvasr Zcelery.exceptionsr r r Z
celery.resultr r Zcelery.utils.functionalr r Zcelery.utils.logr Zcelery.utils.timer Z asynchronousr r �baser Zredis.connectionr Zkombu.transport.redisr � ImportErrorZredis.sentinel�__all__r� r� r� r� r� r� r� rL re r: r r r r� ZSentinelManagedConnectionr� r� r r2 r2 r2 r3 �<module> sb
k
�