Athanasius Ultrametric

Reports / branchpoint_nested_selection.md

Nested Branch-point Selection

Generated by scripts/run_branchpoint_nested_selection.py.

Candidate library size K: 200 Repeats: 10 Maximum greedy ensemble size m: 50 Feature subset sizes: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10

Outer leave-one-out folds are evaluation-only. For each random repeat, p-adic subset size, ensemble size, and greedy candidate order are selected by inner leave-one-out on the remaining witnesses, then refit for that repeat's outer prediction. Logistic model family, penalty, and C are selected by the same nested protocol.

Summary

dataset dataset_label model_family model outer_rows outer_folds repeats exact_branch_accuracy mean_padic_loss mean_parameters_used mean_active_parameters_used target_absent_folds
athanasius_epistles_data_bin_csv Binary logistic_nested nested_logistic_selected 12 12 1 0.5 0.0466667 188.083 38.75 2
athanasius_epistles_data_bin_csv Binary padic_greedy_nested nested_padic_greedy 120 12 10 0.416667 0.223333 23.875 10.475 2
athanasius_epistles_data_multistate_csv Multistate logistic_nested nested_logistic_selected 12 12 1 0.5 0.113333 211.833 91.25 2
athanasius_epistles_data_multistate_csv Multistate padic_greedy_nested nested_padic_greedy 120 12 10 0.441667 0.170333 17.975 16.3417 2

Singleton-aware performance

dataset dataset_label model_family scope outer_folds exact_branch_accuracy mean_padic_loss mean_active_parameters_used
athanasius_epistles_data_bin_csv Binary logistic_nested all_outer_folds 12 0.5 0.0466667 38.75
athanasius_epistles_data_bin_csv Binary logistic_nested non_singleton_outer_folds 10 0.6 0.016 46.3
athanasius_epistles_data_bin_csv Binary logistic_nested singleton_outer_folds 2 0 0.2 1
athanasius_epistles_data_bin_csv Binary padic_greedy_nested all_outer_folds 12 0.416667 0.223333 10.475
athanasius_epistles_data_bin_csv Binary padic_greedy_nested non_singleton_outer_folds 10 0.5 0.156 10.9
athanasius_epistles_data_bin_csv Binary padic_greedy_nested singleton_outer_folds 2 0 0.56 8.35
athanasius_epistles_data_multistate_csv Multistate logistic_nested all_outer_folds 12 0.5 0.113333 91.25
athanasius_epistles_data_multistate_csv Multistate logistic_nested non_singleton_outer_folds 10 0.6 0.016 88.7
athanasius_epistles_data_multistate_csv Multistate logistic_nested singleton_outer_folds 2 0 0.6 104
athanasius_epistles_data_multistate_csv Multistate padic_greedy_nested all_outer_folds 12 0.441667 0.170333 16.3417
athanasius_epistles_data_multistate_csv Multistate padic_greedy_nested non_singleton_outer_folds 10 0.52 0.0944 16.78
athanasius_epistles_data_multistate_csv Multistate padic_greedy_nested singleton_outer_folds 2 0.05 0.55 14.15

Top nested feature variables

dataset dataset_label feature book selected_model_count distinct_outer_folds distinct_repeats nonzero_coefficient_count active_for_outer_prediction_count mean_train_loss mean_raw_padic_loss nonzero_support_size nonzero_support_labels nonzero_support_branches nonzero_support_branch_count selected_model_share
athanasius_epistles_data_bin_csv Binary Rom.15.19.1.b2 Rom 143 12 10 143 30 0.0126993 0.108308 3 D; F; G N2; N5 2 0.0574528
athanasius_epistles_data_bin_csv Binary 2Cor.1.10.1.b1 2Cor 115 12 10 115 22 0.0350166 0.379478 2 A; D N5; N6 2 0.0462033
athanasius_epistles_data_bin_csv Binary 1Cor15.54.1.b2 1Cor 95 12 10 91 49 0.0298488 0.302905 6 A; B; C; D; M223; M2423 N1; N4; N5; N6 4 0.0381679
athanasius_epistles_data_bin_csv Binary 1Cor15.54.1.b1 1Cor 93 12 10 82 44 0.0296696 0.299527 6 U1; B; C; D; M223; M2423 N1; N3; N4; N5 4 0.0373644
athanasius_epistles_data_bin_csv Binary Col.1.16.2 Col 89 12 10 89 26 0.0267293 0.252225 3 P46; U1; M1739 N3; N6 2 0.0357573
athanasius_epistles_data_bin_csv Binary Col.1.16.1.b2 Col 85 12 10 85 52 0.0242652 0.2528 6 P46; U1; D; F; G; M1739 N2; N3; N5; N6 4 0.0341503
athanasius_epistles_data_bin_csv Binary Eph.3.18.1 Eph 85 12 10 84 33 0.0381262 0.36 5 U1; A; M223; M1739; M2423 N3; N4; N6 3 0.0341503
athanasius_epistles_data_bin_csv Binary Phil.2.9.1 Phil 84 12 10 74 27 0.0321645 0.401143 5 P46; U1; A; C; M1739 N1; N3; N6 3 0.0337485
athanasius_epistles_data_bin_csv Binary 1Cor.4.6.3.b2 1Cor 84 12 10 61 6 0.0371255 0.365905 2 D; M2423 N4; N5 2 0.0337485
athanasius_epistles_data_bin_csv Binary 1Cor.9.16.2 1Cor 81 12 10 81 29 0.0359596 0.318025 5 B; C; D; F; G N1; N2; N5 3 0.0325432
athanasius_epistles_data_bin_csv Binary 1Cor.2.4.1.b2 1Cor 79 12 10 59 40 0.040939 0.341772 7 U1; A; B; C; D; M1739; M2423 N1; N3; N4; N5; N6 5 0.0317397
athanasius_epistles_data_bin_csv Binary 1Cor.15.47.1.b2 1Cor 77 12 10 77 17 0.0355702 0.287896 3 A; M223; M2423 N4; N6 2 0.0309361
athanasius_epistles_data_multistate_csv Multistate 1Cor.10.13.1 1Cor 118 12 10 118 118 0.0166915 0.102847 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0636462
athanasius_epistles_data_multistate_csv Multistate 1Cor.15.47.1 1Cor 102 12 10 101 101 0.0396135 0.43498 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0550162
athanasius_epistles_data_multistate_csv Multistate 1Cor15.54.1 1Cor 95 12 10 88 88 0.0436443 0.307874 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0512406
athanasius_epistles_data_multistate_csv Multistate Gal.4.8.1 Gal 81 12 10 81 81 0.0317522 0.426272 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0436893
athanasius_epistles_data_multistate_csv Multistate 2Cor.1.10.1 2Cor 73 12 10 65 65 0.0376389 0.356384 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0393743
athanasius_epistles_data_multistate_csv Multistate Col.1.16.1 Col 72 12 10 67 67 0.0385616 0.467333 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.038835
athanasius_epistles_data_multistate_csv Multistate 1Cor.4.6.3 1Cor 72 12 10 38 38 0.032964 0.429667 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.038835
athanasius_epistles_data_multistate_csv Multistate 1Cor.15.53.1 1Cor 71 12 10 23 23 0.0301706 0.392676 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0382956
athanasius_epistles_data_multistate_csv Multistate Col.1.16.2 Col 70 12 10 70 70 0.052399 0.373829 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0377562
athanasius_epistles_data_multistate_csv Multistate 1Cor.9.22.1 1Cor 68 12 10 64 64 0.0512599 0.374706 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0366775
athanasius_epistles_data_multistate_csv Multistate 1Cor.2.4.1 1Cor 67 12 10 40 40 0.0359407 0.449194 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0361381
athanasius_epistles_data_multistate_csv Multistate Eph.3.18.1 Eph 66 12 10 66 66 0.029005 0.324364 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0355987

Top active nested feature variables

dataset dataset_label feature book selected_model_count distinct_outer_folds distinct_repeats nonzero_coefficient_count active_for_outer_prediction_count mean_train_loss mean_raw_padic_loss nonzero_support_size nonzero_support_labels nonzero_support_branches nonzero_support_branch_count selected_model_share
athanasius_epistles_data_bin_csv Binary 1Cor.15.55.1.b1 1Cor 72 12 10 72 54 0.0279798 0.365556 8 P46; U1; B; C; D; F; G; M1739 N1; N2; N3; N5; N6 5 0.0289273
athanasius_epistles_data_bin_csv Binary 1Cor.1.24.1 1Cor 60 12 10 60 53 0.0222424 0.312 10 U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6 6 0.0241061
athanasius_epistles_data_bin_csv Binary Col.1.16.1.b2 Col 85 12 10 85 52 0.0242652 0.2528 6 P46; U1; D; F; G; M1739 N2; N3; N5; N6 4 0.0341503
athanasius_epistles_data_bin_csv Binary Phil.2.5.2 Phil 70 12 10 69 52 0.0309714 0.360686 9 P46; U1; A; B; C; D; F; G; M1739 N1; N2; N3; N5; N6 5 0.0281237
athanasius_epistles_data_bin_csv Binary 1Cor15.54.1.b2 1Cor 95 12 10 91 49 0.0298488 0.302905 6 A; B; C; D; M223; M2423 N1; N4; N5; N6 4 0.0381679
athanasius_epistles_data_bin_csv Binary 1Cor15.54.1.b1 1Cor 93 12 10 82 44 0.0296696 0.299527 6 U1; B; C; D; M223; M2423 N1; N3; N4; N5 4 0.0373644
athanasius_epistles_data_bin_csv Binary 1Cor.2.4.1.b2 1Cor 79 12 10 59 40 0.040939 0.341772 7 U1; A; B; C; D; M1739; M2423 N1; N3; N4; N5; N6 5 0.0317397
athanasius_epistles_data_bin_csv Binary 1Cor.4.6.3.b1 1Cor 65 12 10 43 34 0.0203301 0.345354 8 P46; U1; A; B; C; D; M223; M1739 N1; N3; N4; N5; N6 5 0.0261149
athanasius_epistles_data_bin_csv Binary Eph.3.18.1 Eph 85 12 10 84 33 0.0381262 0.36 5 U1; A; M223; M1739; M2423 N3; N4; N6 3 0.0341503
athanasius_epistles_data_bin_csv Binary Rom.15.19.1.b1 Rom 51 12 10 51 33 0.020877 0.350588 8 P46; U1; A; B; C; M223; M1739; M2423 N1; N3; N4; N6 4 0.0204902
athanasius_epistles_data_bin_csv Binary Phil.2.5.1 Phil 63 12 10 50 32 0.0222222 0.334095 7 P46; D; F; G; M223; M1739; M2423 N2; N3; N4; N5; N6 5 0.0253114
athanasius_epistles_data_bin_csv Binary Rom.15.19.1.b2 Rom 143 12 10 143 30 0.0126993 0.108308 3 D; F; G N2; N5 2 0.0574528
athanasius_epistles_data_multistate_csv Multistate 1Cor.10.13.1 1Cor 118 12 10 118 118 0.0166915 0.102847 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0636462
athanasius_epistles_data_multistate_csv Multistate 1Cor.15.47.1 1Cor 102 12 10 101 101 0.0396135 0.43498 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0550162
athanasius_epistles_data_multistate_csv Multistate 1Cor15.54.1 1Cor 95 12 10 88 88 0.0436443 0.307874 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0512406
athanasius_epistles_data_multistate_csv Multistate Gal.4.8.1 Gal 81 12 10 81 81 0.0317522 0.426272 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0436893
athanasius_epistles_data_multistate_csv Multistate Col.1.16.2 Col 70 12 10 70 70 0.052399 0.373829 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0377562
athanasius_epistles_data_multistate_csv Multistate Col.1.16.1 Col 72 12 10 67 67 0.0385616 0.467333 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.038835
athanasius_epistles_data_multistate_csv Multistate Eph.3.18.1 Eph 66 12 10 66 66 0.029005 0.324364 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0355987
athanasius_epistles_data_multistate_csv Multistate 2Cor.1.10.1 2Cor 73 12 10 65 65 0.0376389 0.356384 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0393743
athanasius_epistles_data_multistate_csv Multistate 1Cor.9.22.1 1Cor 68 12 10 64 64 0.0512599 0.374706 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0366775
athanasius_epistles_data_multistate_csv Multistate 1Cor.9.16.2 1Cor 59 12 10 59 59 0.0307131 0.478644 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0318231
athanasius_epistles_data_multistate_csv Multistate Col.1.18.2 Col 61 12 10 54 54 0.0334002 0.391738 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0329018
athanasius_epistles_data_multistate_csv Multistate Phil.2.9.1 Phil 63 12 10 53 53 0.0400208 0.331175 12 Ath; P46; U1; A; B; C; D; F; G; M223; M1739; M2423 N1; N2; N3; N4; N5; N6; N7 7 0.0339806

P-adic selection distribution

dataset_label selected_repeat_folds mean_selected_m median_selected_m max_selected_m mean_subset_size max_subset_size selected_at_m_cap
Binary 120 3.13333 3 15 6.65 9 0
Multistate 120 2.525 2 15 6.48333 9 0
dataset_label subset_size_s selected_repeat_folds
Binary 4 4
Binary 5 18
Binary 6 32
Binary 7 35
Binary 8 24
Binary 9 7
Multistate 2 1
Multistate 3 8
Multistate 4 10
Multistate 5 14
Multistate 6 16
Multistate 7 31
Multistate 8 31
Multistate 9 9

Logistic selections

dataset dataset_label outer_fold model model_family penalty C inner_mean_padic_loss inner_exact_branch_accuracy inner_mean_active_parameters_used inner_target_absent_folds
athanasius_epistles_data_bin_csv Binary Ath opaque_logistic_l1_C10 opaque_logistic l1 10 0.0363636 0.454545 12.9091 1
athanasius_epistles_data_bin_csv Binary P46 path_logistic_l2_C0.1 path_logistic l2 0.1 0.0436364 0.636364 61.6364 3
athanasius_epistles_data_bin_csv Binary U1 opaque_logistic_l2_C1 opaque_logistic l2 1 0.0618182 0.545455 102.364 3
athanasius_epistles_data_bin_csv Binary A path_logistic_l1_C10 path_logistic l1 10 0.04 0.727273 11.6364 3
athanasius_epistles_data_bin_csv Binary B path_logistic_l2_C1 path_logistic l2 1 0.127273 0.363636 70.3636 3
athanasius_epistles_data_bin_csv Binary C path_logistic_l2_C0.1 path_logistic l2 0.1 0.0545455 0.363636 63.3636 3
athanasius_epistles_data_bin_csv Binary D path_logistic_l1_C10 path_logistic l1 10 0.0290909 0.636364 11.6364 1
athanasius_epistles_data_bin_csv Binary F path_logistic_l1_C10 path_logistic l1 10 0.0654545 0.454545 11.3636 3
athanasius_epistles_data_bin_csv Binary G path_logistic_l1_C10 path_logistic l1 10 0.0654545 0.454545 11.3636 3
athanasius_epistles_data_bin_csv Binary M223 path_logistic_l1_C10 path_logistic l1 10 0.0654545 0.454545 11.3636 3
athanasius_epistles_data_bin_csv Binary M1739 path_logistic_l1_C10 path_logistic l1 10 0.0509091 0.454545 9.90909 3
athanasius_epistles_data_bin_csv Binary M2423 path_logistic_l1_C10 path_logistic l1 10 0.0654545 0.454545 11.9091 3
athanasius_epistles_data_multistate_csv Multistate Ath opaque_logistic_l2_C0.1 opaque_logistic l2 0.1 0.0327273 0.545455 183.182 1
athanasius_epistles_data_multistate_csv Multistate P46 opaque_logistic_l2_C0.1 opaque_logistic l2 0.1 0.04 0.727273 208.545 3
athanasius_epistles_data_multistate_csv Multistate U1 opaque_logistic_l2_C0.1 opaque_logistic l2 0.1 0.0472727 0.545455 208.545 3
athanasius_epistles_data_multistate_csv Multistate A opaque_logistic_l2_C0.1 opaque_logistic l2 0.1 0.04 0.727273 208.545 3
athanasius_epistles_data_multistate_csv Multistate B opaque_logistic_l1_C10 opaque_logistic l1 10 0.0945455 0.454545 32.4545 3
athanasius_epistles_data_multistate_csv Multistate C opaque_logistic_l1_C1 opaque_logistic l1 1 0.123636 0.454545 19.7273 3
athanasius_epistles_data_multistate_csv Multistate D opaque_logistic_l1_C1 opaque_logistic l1 1 0.0327273 0.545455 19.6364 1
athanasius_epistles_data_multistate_csv Multistate F opaque_logistic_l1_C10 opaque_logistic l1 10 0.0690909 0.363636 33.1818 3
athanasius_epistles_data_multistate_csv Multistate G opaque_logistic_l1_C10 opaque_logistic l1 10 0.0690909 0.363636 33 3
athanasius_epistles_data_multistate_csv Multistate M223 opaque_logistic_l1_C10 opaque_logistic l1 10 0.0690909 0.363636 33.2727 3
athanasius_epistles_data_multistate_csv Multistate M1739 opaque_logistic_l1_C10 opaque_logistic l1 10 0.0509091 0.454545 34.1818 3
athanasius_epistles_data_multistate_csv Multistate M2423 opaque_logistic_l1_C10 opaque_logistic l1 10 0.0690909 0.363636 32.8182 3