def compare_metafeature_benchmarks(bm_1_name, bm_2_name, n_std_dev=<NUM_LIT:3>):
def compare(item_name, bm_1, bm_2):<EOL><INDENT>if (bm_2["<STR_LIT>"] - bm_1["<STR_LIT>"]) < -bm_1["<STR_LIT>"] * n_std_dev:<EOL><INDENT>rel_imp = (bm_2["<STR_LIT>"] - bm_1["<STR_LIT>"]) / -bm_1["<STR_LIT>"]<EOL>print(f"<STR_LIT>")<EOL><DEDENT>if (bm_1["<STR_LIT>"] - bm_2["<STR_LIT>"]) < -bm_2["<STR_LIT>"] * n_std_dev:<EOL><INDENT>rel_imp = (bm_1["<STR_LIT>"] - bm_2["<STR_LIT>"]) / -bm_2["<STR_LIT>"]<EOL>print(f"<STR_LIT>")<EOL><DEDENT><DEDENT>bm_1_data = read_benchmark_data(bm_1_name)<EOL>bm_2_data = read_benchmark_data(bm_2_name)<EOL>for dataset_filename, benchmark_data_1 in bm_1_data.items():<EOL><INDENT>print(f"<STR_LIT>")<EOL>benchmark_data_2 = bm_2_data[dataset_filename]<EOL>compare(<EOL>"<STR_LIT>", benchmark_data_1["<STR_LIT>"],<EOL>benchmark_data_2["<STR_LIT>"]<EOL>)<EOL>compare(<EOL>"<STR_LIT>", benchmark_data_1["<STR_LIT>"],<EOL>benchmark_data_2["<STR_LIT>"]<EOL>)<EOL>for mf_id, bm_1 in benchmark_data_1["<STR_LIT>"].items():<EOL><INDENT>compare(<EOL>mf_id, bm_1,<EOL>benchmark_data_2["<STR_LIT>"][mf_id]<EOL>)<EOL><DEDENT>print(f"<STR_LIT>")<EOL><DEDENT>
Compares two benchmark tests from the run_metafeature_benchmark function.
Identifies significant differences in individual metafeature computation
time and aggregate computation time. Reports the items that are more than
n_std_dev standard deviations different from each other. Does not test for
correctness.