sh.SSKrSSKrSSKJr SSKJrJrJr SSKrSSK J r J r J r J r JrJrJrJr SSKJr SSKJr SSKJr SSKJr "S S 5r"S S \5r"S S5r"SS\5rg)N)partial)AnyCallableOptional) AHContext AHMetadata AHOperationChoice CHOICE_COLFeedback FEEDBACK_COLget_metadata_str_from_log)LearnedHeuristicController) ChoiceCaller) cache_dir)get_gpu_shared_memorycH\rSrSrSrS\\/\4SS4SjrS\S\4Sjr S r g) LocalFeedbacka' To be able to collect data for a choice, a function providing feedback given a choice has to be provided. LocalFeedback can be used when AutoHeuristic should immediately run the function to collect feedback for each choice (see pad_mm.py, where the autotuning happens locally, for an example). feedback_fnreturnNcXlgNr)selfrs /Users/tiagomarins/Projetos/claudeai/copy_bank/venv/lib/python3.13/site-packages/torch/_inductor/autoheuristic/autoheuristic.py__init__LocalFeedback.__init__ s&choicec$URU5$rrrr s r__call__LocalFeedback.__call__#s''rr) __name__ __module__ __qualname____firstlineno____doc__rr r rr#__static_attributes__rrrrs9 'HfXx-?$@'T'(v(((rrc\rSrSrSrSrg)InconsistentMetadata'z Exception that is thrown when AutoHeuristic tries to log data to a file where the metadata stored in the file does not match the metadata it would store if the file didn't exist. r+N)r%r&r'r(r)r*r+rrr-r-'srr-cB\rSrSr%Sr\\\4\S'SS\ /\4S\ \S\ \ S\ S \S \ \ \S \ \ \\ /\4S S4S jjrS \4SjrS \4SjrSS\S\ \ \S \ \ \4SjjrS\S \4Sjr\S \4Sj5rS \4SjrS \4SjrS\S\S S4SjrSrg) AutoHeuristic.a  AutoHeuristic is a framework that allows one to collect data, learn a heuristic (i.e. a regression tree) and generate the heuristic to code. This class allows one to collect data. The collected data can then be used to train a heuristic (see torchgen/autoheuristic/). collected_feedbackNfallbackchoicesfeedbackcontextnameaugment_context preconditionrcXlX lX0lX@lXPl0UlX`l[[5[RR5URUR5Ul Xpl UR5(dg[RR R"S:XaUR%5UlO)[RR R"Ul[RR R)UR5(aDURb6URH%nURU5n UR+X5 M' ggg)a Initializes an instance of the AutoHeuristic class. Args: fallback: A callable that returns a Choice when the heuristic is unsure which choice to make, or AutoHeuristic is in data collection mode. choices: A list of possible choices the heuristic can make. feedback: An instance of LocalFeedback that provides feedback for a given choice. context: Context to store with each choice and feedback. name: A string that identifies the heuristic. augment_context: An optional list of AHOperation instances that augment the context. precondition: A callable that returns a boolean indicating whether AutoHeuristic should run. NDEFAULT)r3r4r5r6r7r2r8rrtorchcudaget_device_capabilitymetadatar9satisfies_precondition _inductorconfigautoheuristic_log_pathget_default_log_pathlog_pathcollect_autoheuristic save_data) rr3r4r5r6r7r8r9r feedback_vals rrAutoHeuristic.__init__7s.!     "$." ! # JJ , , . LL II   )**,,  ?? ! ! 8 8I E 557DM!OO22IIDM ?? ! ! 7 7 B B}}("llF#'==#8LNN68+) CrcxURSL=(d& URURUR5$r)r9r?r6)rs rr@$AutoHeuristic.satisfies_preconditionks4  D( D,=,= MM4<<-  rcUR5(dUR5$[RRR UR 5(aURb%URRUR5 [URUR5nUR5nX R;aUR5$UbU$UR5$)z Returns the chosen option based on the value of autoheuristic_use. If self.name is one of the comma separated strings in autoheuristic_use, it queries a learned heuristic to make a decision. Otherwise, it returns the fallback option. )r@r3r<rArBuse_autoheuristicr7r8r6apply_operationsrr? get_decisionr4)r controllerdecisions r get_choiceAutoHeuristic.get_choiceps**,,==? " ?? ! ! 3 3DII > >##/ --d.B.BC3  J"..0H||+}}&#}}rtop_kalways_includedcUR5(dg[RRR UR 5(aUR b%URRUR 5 [URUR5nURU5nUcgUb!UHnXT;dM URU5 M U$gr) r@r<rArBrMr7r8r6rNrr?get_decisions_rankedappend)rrTrUrPr4r s rget_top_k_choicesAutoHeuristic.get_top_k_choicess**,, ?? ! ! 3 3DII > >##/ --d.B.BC3  J!55e $v-3c,6GGG T (C A GGDIIe$t+ ,! s +$E E&) r8r4r2r6r3r5rEr?r7r9NNr)r%r&r'r(r)dictr r __annotations__rlistrrrrr rboolrr@rRintrYrr] staticmethodrerDrxrGr*r+rrr0r0.sS VX-..8 $v, ,9V993c)C)--h-4-rr0c^\rSrSrSrSS\/\\4S\\S\\ S\ S\ S \\\ S \\\ \ /\4S S4U4S jjjrS\\ S\\S S4S jrS \\4SjrSS\S\\\ S \\\4SjjrSrU=r$)AutoHeuristicSelectAlgorithmz AutoHeuristicSelectAlgorithm is a subclass of AutoHeuristic that allows one to collect data and learn a heuristic when one wants to use AutoHeuristic for kernel choice selection. Nr3r4 input_nodesr6r7r8r9rc >^X0l0UlUHnXRUR5'M! [URR 55n S[ 4U4Sjjn [ T U]U U SUUUU5 [RRRUR5(a(UR5(aURX25 ggg)a The arguments choices, input_nodes and name have to match the ones used in the call to autotune_select_algorithm(), e.g. if the following call is made autotune_select_algorithm(name, choices, input_nodes, layout), the same name, choices and input_nodes have to be used here. rc:>T"5nUcgUR5$)Nunsure)autoheuristic_id)fallback_choicer3s r fallback_str;AutoHeuristicSelectAlgorithm.__init__..fallback_strs"&jO&"335 5rN)rchoicestr2choicerrkeysrsuperrr<rArBrFr7r@register_global_feedback) rr3r4rr6r7r8r9r choices_strr __class__s ` rr%AutoHeuristicSelectAlgorithm.__init__s '9;F?E ! !&"9"9"; <4005578  6c 6          OO " " 8 8 C C++--  ) )+ ?. Drc^^^ SSKJnJmJm S[S[S[ [ [4S[S[[S[[ S S 4UU U4S jjnT"U5nT "TRXR5n[XEU5nU"U5 g ) z[ Registers a callback in select_algorithm, which is called with the timing of each choice. r)add_feedback_savercreate_inputs_keycreate_precompile_key ah_inputs_keyah_precompile_keytimingsr7rr4rNc>T "U5nX`:wagT "X6U5nXq:wagUR5H%upT RUR5U 5 M' gr)itemsrGr) rrrr7rr4current_inputs_keycurrent_precompile_keyr timerrrs rstore_global_feedbackTAutoHeuristicSelectAlgorithm.register_global_feedback..store_global_feedbacks]"3;!? !2%:'& "&: '  v668$?!0r) torch._inductor.select_algorithmrrrrrrfloatrrr7r) rrr4rr inputs_keyprecompile_keyfeedback_saverrrs ` @@rr5AutoHeuristicSelectAlgorithm.register_global_feedback s   @ @" @,-. @  @ c  @ ,'  @ @ @&'{3 .tyy*N !6NS>*rcZUR5nURRUS5$r)rRrr\r"s rget_choice_caller.AutoHeuristicSelectAlgorithm.get_choice_caller1s'"$$((66rrTrUctURX5nUcgUVs/sHo@RUPM sn$s snfr)rYr)rrTrUr4r s rget_top_k_choices_caller5AutoHeuristicSelectAlgorithm.get_top_k_choices_caller5s=((@ ?E $|$ %EErr)rsrj functoolsrtypingrrrr<1torch._inductor.autoheuristic.autoheuristic_utilsrrr r r r r r:torch._inductor.autoheuristic.learned_heuristic_controllerrtorch._inductor.irr%torch._inductor.runtime.runtime_utilsrtorch._inductor.utilsrr Exceptionr-r0rr+rrrsi **    ,;7 ( (9h-h-VbE=bEr