shW SSKrSSKrSSKrSSKJrJr SSKJr SSK Js J r SSK J r SSK J r Jr \R"5(d#\"S\R"S9 \R$"S5 \ S-rSS\S \4S jjrSS jrSS \S\S \4SjjrSS\S S4SjjrS \\\44SjrSS\S\S \S\S S4 SjjrS \S\S S4SjrS \S \4SjrSr g)N)partialwraps_rref_context_get_debug_info) FILE_SCHEMATEST_WITH_TSANz"c10d not available, skipping tests)filez {file_name} setup_rpcclean_shutdownch^^^^^Tc[[TTTTS9$[T5UUUUU4Sj5nU$)aC We use this decorator for setting up and tearing down state since MultiProcessTestCase runs each `test*` method in a separate process and each process just runs the `test*` method without actually calling 'setUp' and 'tearDown' methods of unittest. Note: pass the string representation of MessageTypes that should be used with the faulty agent's send function. By default, all retriable messages ("RREF_FORK_REQUEST", "RREF_CHILD_ACCEPT", "RREF_USER_DELETE", "CLEANUP_AUTOGRAD_CONTEXT_REQ") will use the faulty send (this default is set from faulty_rpc_agent_test_fixture.py). )r r faulty_messagesmessages_to_delayc>SSKJs Js Jn SUlUR UlURTT5 URnT (a[(a7[RRS-Ul S[Rl [R"SUR S3URUR UR US9 T "U/UQ70UD6nT (a[R""TS9 U$) NrF<workerd)namebackendrank world_sizerpc_backend_options)graceful)torch.distributed.rpc.api distributedrpcapi_ignore_rref_leakr worker_idsetup_fault_injectionrr constantsDEFAULT_RPC_TIMEOUT_SEC rpc_timeoutDEFAULT_SHUTDOWN_TIMEOUTinit_rpc rpc_backendrshutdown) selfargkwargsrr return_valuer r rold_test_methodr s v/Users/tiagomarins/Projetos/claudeai/copy_bank/venv/lib/python3.13/site-packages/torch/testing/_internal/dist_utils.pynew_test_method"dist_init..new_test_method7s 0/ % ""?4EF"66 ~25--2W2WZ[2[#/9; 6 LLdii]+((YY??$7  't r0returncg)Nr4r0r-noopr5Zsr0rexpected_error_regexc[R"SU3[SS9 [R"S5 M6![ a=n[ R"U[U5S9(a[U5sSnA$SnANDSnAff=f)a' Loops until an RPC to the given rank fails. This is used to indicate that the node has failed in unit tests. Args: rank (int): Rank of the node expected to fail expected_error_regex (optional, str): Regex of exception message expected. Useful to ensure a specific failure occurs, not just any. rr4)args皙?)patternstringN) rrpc_syncr5timesleep Exceptionresearchstr)rr6es r-wait_until_node_failurerD^sf   LL6$$R 8 JJsO  yy!5c!fE1v F s38 A?-A:/A?:A?timeoutc [R"5n[5n[US5n[US5nUS:XaUS:Xag[R"S5 [R"5U- U:a[ SUSUS35eMy) a The RRef protocol holds forkIds of rrefs in a map until those forks are confirmed by the owner. The message confirming the fork may arrive after our tests check whether this map is empty, which leads to failures and flaky tests. to_here also does not guarantee that we have finished processind the owner's confirmation message for the RRef. This function loops until the map is empty, which means the messages have been received as processed. Call this function before asserting the map returned by _get_debug_info is empty. num_pending_futuresnum_pending_usersrr9z:Timed out waiting to flush pending futures and users, had z pending futures and z pending usersN)r=rintr> ValueError)rEstart debug_inforGrHs r-,wait_until_pending_futures_and_users_flushedrMps IIKE 13 !*-B"CD +> ?@ ! #(9Q(>  3 99;  (*++@AR@SSac  r0c0[5nUSnUSnX4$)zZ Retrieves number of OwnerRRefs and forks on this node from _rref_context_get_debug_info. num_owner_rrefs num_forksr) rref_dbg_info num_ownersrPs r-get_num_owners_and_forksrSs* 12M01Jk*I   r0rRrPc Z[R"5n[R"[U5[SSS9upV[ U5n[ U5nXP:XaXa:Xag[R "S5 [R"5U- U:a[SUSUSUS USUS 3 5eM) zz Waits until timeout for num_forks and num_owners to exist on the rank. Used to ensure proper deletion of RRefs in tests. r4r)r8rENzTimed out waiting z sec for z owners and z forks on rank, had z forks)r=rr< worker_namerSrIr>rJ)rRrPrrErKnum_owners_on_ranknum_forks_on_ranks r-#wait_until_owners_and_forks_on_rankrYs IIKE 03  7b!1 -!!34 12  +0A0N  1 99;  ($WIYzl,ykZ*+<8I7J&R  r0rch[R"5(d[R"SUUUS9 gg)Ngloo)r init_methodrr)distis_initializedinit_process_group)r\rrs r- initialize_pgr`s0     #!   !r0c SU3$)Nrr4)rs r-rVrVs D6?r0c^UVs/sHo!UR;dMUPM snSnU$s snf)a5 Returns the first event that matches partial_event_name in the provided function_events. These function_events should be the output of torch.autograd.profiler.function_events(). Args: function_events: function_events returned by the profiler. event_name (str): partial key that the event was profiled with. r)r)function_eventspartial_event_nameevents r-get_function_eventrfs2!0 Tu3SU TUV WE L Us**)NTTNN)r2N)z.*))!r@sysr= functoolsrrtorch.distributedrr]torch.distributed.rpcrr$torch.testing._internal.common_utilsrr is_availableprintstderrexitINIT_METHOD_TEMPLATEboolr1r5rIrBrDrMtuplerSrYr`rVrfr4r0r-rts2 $ ##>L  .SZZ@HHQK#]2 BBBJ #SC$#t4!%S/!@B #+.9< 0 S c d cc r0