sh *SSKrSSKrSSKrSSKrSSKrSSKJr SSKJr SSK J r J r J r SSK Jr SSKJr SSKJr SS KJrJr \R,"\5r\R2"S S 9"S S 55r\R2"S S 9"SS55r\R2"S S 9"SS55r\R2"S S 9"SS55r"SS5rg)N)Path)Optional)counters dynamo_timedset_feature_use)justknobs_check)FileLock)triton_cache_dir) _IS_WINDOWSGPU_KERNEL_BIN_EXTST)frozenc8\rSrSr%Sr\\S'\\S'\\S'Srg)TritonBundleEntryz When we have compiled a triton kernel, we take note of that kernel by its triton generated hash, its device, and where this kernel is located. This is the minimum information we can use to later retrieve this kernel from file system. kernel_hashdevice directoryN) __name__ __module__ __qualname____firstlineno____doc__str__annotations__int__static_attributes__rr/Users/tiagomarins/Projetos/claudeai/copy_bank/venv/lib/python3.13/site-packages/torch/_inductor/triton_bundler.pyrrs KNrrcN\rSrSr%Sr\\S'\R"SS9r \ \S'Sr g) TritonKernelArtifact"ze Artifact for an individual kernel converted to bytes. Bytes could be a cubin, json, ttir, or ttgir. filenameF)reprpayloadrN) rrrrrrr dataclassesfieldr&bytesrrrr r"r""s# M &&E2GU2rr"c>\rSrSr%Sr\\S'\\S'\\ \S'Sr g)TritonKernelArtifacts-z2 Collection of artifacts for a particular kernel. rr artifactsrN) rrrrrrrrlistr"rrrr r+r+-s  K())rr+c*\rSrSr%Sr\\\S'Srg)TritonBundlerMetadata8z# Metadata used for instrumentation cached_kernel_namesrN) rrrrrr.rrrrrr r0r08sc"rr0c\rSrSr%SrSr\\\\ S'Sr \ \ S'\ S\ 4Sj5r\SS j5r\SS j5r\S \S \SS4S j5r\S\\\\\44Sj5r\ S\\S\\4Sj5rSrg) TritonBundlerAa Lightweight Triton Kernel bundler that notes each time we compile a triton kernel. When collect is called, converts all the previously noted kernels and their artifacts into a structured bytes blob, and later when write is called it writes this structured blob back to file system. Intended Life cycle: - TritonBundler.begin_compile is called when we start compiling in Inductor - TritonBundler.put is called each time a Triton Kernel is compiled - TritonBundler.collect is called when a cache entry is being generated - TritonBundler.end_compile is called to indicate bundling is completed, collect will execute this function as well. - TritonBundler.read_and_emit is called when a cache entry is read N_entriess [REPLACE]_REPLACE_BYTESreturncSSKJn UR(agUR=nbU$UR 5(dg[ S5$)Nr)configFz9pytorch/remote_cache:bundle_triton_into_fx_graph_cache_v2)torch._inductorr:force_disable_caches!bundle_triton_into_fx_graph_cache is_fbcoder)r:bs r is_enabledTritonBundler.is_enabledWsI*  & &99 9A FH!! G  rc[R5(dg[RS5 URbe/Ulg)zh Initializes the TritonBundler. The current TritonBundler bundle is finalized by TritonBundler.collect. Nz%TritonBundler.begin_compile is called)r4r@logdebugr6clss r begin_compileTritonBundler.begin_compilehs: ''))  9:||### rc<[RS5 SUlg)z\ Finalizes the TritonBundler. If collect is not yet called, it discards the current bundle. z#TritonBundler.end_compile is calledN)rCrDr6rEs r end_compileTritonBundler.end_compilets 78 rrrc lUR=nb%UR[X[U555 gg)zo Lazily observes that we have seen a Triton kernel compilation. Remembers it for when collect is later called. N)r6appendrr )rFrrentriess r putTritonBundler.put}s4 || #G 0 NN!+7G7OP  1rc N[R5(d UR5 [SS5 /S4$[SS5 [ SSS9 UR nUGbr/n/nUGHAn/n[ RRURUR5n[ RRU5(dM`[ R"U5GHn[ RRXg5n[ RRU5(de[US5n U R5n UR!S5(aw[R"U ;a0[$R'S [R"U 5 [)S 5eU R+[,R/U5[R"5n UR1[3Xz55 SSS5 [4S S ==S - ss'[ RR;U5S n U [<R>"5;dGMhUR1[AU5RB5 GM U(dGMUR1[EURURFU55 GMD UR5 U[IU54sSSS5 $/S4sSSS5 $!,(df  N=f![6a [$R9SSS9 GN f=f!,(df  g=f)z This is the main function called when a cache write happens. This function converts all the previously remembered kernels into bundled format so that it can be written into a cache entry. This function also finalizes the current bundle. triton_bundlingFNTzTritonBundler.collectkeylog_pt2_compile_eventrb.jsonz'Bundle contains illegal %s, payload: %szBundle contains illegal bytesinductortriton_bundler_save_kernelr zfailed to collect triton kernel)exc_info)%r4r@rJrrr6ospathjoinrrexistslistdirisfileopenreadendswithr7rCwarningAssertionErrorreplacerencoderMr"r ExceptionrDsplitextr valuesrstemr+rr0) rFrNresult kernel_namesentryr-r\r$filepathfiler& extensions r collectTritonBundler.collects'')) OO  -u 5t8O)40 5T RllG"68*, $E<>I77<<9J9JKD77>>$// $&JJt$4#%77<<#?X#%77>>(#;#;;#;!%h!5*.))+#+#4#4W#=#='4'C'Cw'N(+ ,U,9,H,H,3)* /=,K/*)*/6oo(+ 4(8-:V:V/&G!* 0 0$8$K!"#"6(%Z01MNRSSN%'GG$4$4X$>q$A $(;(B(B(DD)//X0C0CD?%5@!y 1 % 1 1 % )M%Z!4\BBgS Rht8iS R"6!5* )XII&GRVIWXGS Rs]B0L2K13B8K +K19L.L8ALL K. *K11L LL L L$bundlec [R5(dg[SSS9 /nUGHn[UR5n[ R RX2R5n[ R RU5(a;[[ R"U55S:wa[RSU5 M[U5RSSS9 [!["R$"55n[ R RUSU35n[ R&"U5 UR(GH<n[ R RXgR*5n[-US 5n UR.n UR*R1S 5(a3U R3[R4[ R7U55n U R9U 5 SSS5 [:S S ==S - ss'[ R R=UR*5S n U [>R@"5;dGMURC[UR*5RD5 GM? [F(aj[IUS-5 [ R RU5(a[JRL"U5 [ R2"Xd5 SSS5 GM[ R2"Xd5 GM [OU5sSSS5 $!,(df  GNB=f!,(df  GM$=f!,(df  g=f)a This is the main function called when a cache read happens. This function converts the bundled format back into individual files and writes them to the filesystem. NOTE: When we are writing to the filesystem, we assume exclusive access to the target directory. This means that if the target folder already exists and is non-empty, we bail out. Exclusive access means that no other process should be writing to or reading from the target directory. NzTritonBundler.read_and_emitTrSrz8Bailing out TritonBundler.read_and_emit, %s is non empty)parentsexist_okztmp.wbrWrX#triton_bundler_read_and_emit_kernelr z.lock)(r4r@rr rr[r\r]rr^lenr_rCrDrmkdirruuiduuid4makedirsr-r$rar&rcrfr7rgwriterrir rjrMrkr r shutilrmtreer0) rtrmr-basedirrrnd_idtmp_dirartifactrorpr&rqs r read_and_emitTritonBundler.read_and_emitsl '')) -T ')L# *9+;+;<GGLL2G2GH 77>>),,RZZ 5J1Kq1PIIR!W ##D4#@TZZ\*'',,w$vh@ G$ ) 3 3H!ww||G5F5FGHh-"*"2"2#,,55g>>&-oo - < S'G 7+ .Z()NOSTTO " 0 01B1B CA FI $7$>$>$@@%++D1B1B,C,H,HI!4 ;!)g"5677>>)44"MM)4 7676 JJw2W$Z)6e  6.-76U  sFEMA1L, 1AMA M!AL>20M, L; 6M> M  M Mr)r8N)rrrrrr6rr.rrr7r) staticmethodboolr@ classmethodrGrJrrrOtupler+r0rrrrrrr r4r4As 37Hht-./6)NE(     c34C t)*H5J,KK LCCJD7*+D7 ' (D7D7rr4)r'loggingr[rr|pathlibrtypingrtorch._dynamo.utilsrrrtorch._utils_internalrtorch.utils._filelockr runtime.runtime_utilsr utilsr r getLoggerrrC dataclassrr"r+r0r4rrr rs GG1*33! d#  $  d#33$3 d#**$* d###$#R7R7r