a f @sddlZddlZddlZddZedkreZejdeddejded dejd e d dejd ed dejdegddejdegdde Z ee dS)Nc Csg}tdD]}t|jd|dddd`}|D]F}zt|}d|d<Wnd dl}|Yn0| |q6Wdq 1s0Yq g}d }d } |D]} d | d} d | } zTt j | d d t j t j d } | j d}| jd}| | d||dd|d7}WnBt jy\}z&| | dt|ddWYd}~n d}~00| d7} q|| d}tdd&}tj||d|ddWdn1s0YdS)N/z.jsonrzutf-8)encoding cmdrz!{"cmd": "%s", "allTactics": true}zecho '%s' | lake exe replT)shellZcheckstdoutstderr file_pathpass)r r r statusZnopass)r errorr dz results.jsonw)results pass_rate)indent)rangeopen input_path readlinesjsonloadsjoinpdb set_traceappend subprocessrunPIPEr decoder ZCalledProcessErrorstrdump)argsZ command_listiZrflineZ json_itemrrZpassedtotalitemdatacommandresultr r erfr0 /opt/tiger/lean4-compile/code.pymain sL   ,       r2__main__z --data_pathz?data/grade-school-math-master/grade_school_math/data/test.jsonl)typedefaultz --input_pathz --cuda_numrz --output_pathz total.jsonz--generate_method)singleZsftcompZself_consistencyZsingle_consistency)r4choicesz--method)r2testget_data) osr rr2__name__ArgumentParserZ arg_parser add_argumentr$int parse_argsr&r0r0r0r1s".