OpenML-CC18: letter

Best predictive accuracy per machine-learning flow on the letter classification task from the OpenML-CC18 suite.

Community results for the letter classification task from OpenML-CC18, OpenML's curated suite of 72 classification tasks (www.openml.org/t/6). Each subject is a flow — a specific algorithm or pipeline — shown with the best predictive accuracy recorded for it on this task in OpenML's public evaluation listing, under the task's fixed estimation procedure.

Results

predictive_accuracy per subject over 35 measurements, ranked by average.

SubjectAvgMedianMinMaxP95P99Count
sklearn.pipeline.Pipeline(imputation=openmlstudy14.preprocessing.ConditionalImputer,hotencoding=sklearn.preprocessing.data.OneHotEncoder,variencethreshold=sklearn.feature_selection.variance_threshold…0.98090.98090.98090.98090.98090.98091
weka.SMO_RBFKernel(1)0.980.980.980.980.980.981
sklearn.svm.classes.SVC(32)0.97990.97990.97990.97990.97990.97991
sklearn.pipeline.Pipeline(simpleimputer=sklearn.impute._base.SimpleImputer,standardscaler=sklearn.preprocessing.data.StandardScaler,svc=sklearn.svm.classes.SVC)(1)0.97920.97920.97920.97920.97920.97921
sklearn.pipeline.Pipeline(imputation=openmlstudy14.preprocessing.ConditionalImputer,hotencoding=sklearn.preprocessing.data.OneHotEncoder,scaling=sklearn.preprocessing.data.StandardScaler,variencethre…0.97910.97910.97910.97910.97910.97911
sklearn.pipeline.Pipeline(imputation=openmlstudy14.preprocessing.ConditionalImputer,hotencoding=sklearn.preprocessing.data.OneHotEncoder,scaling=sklearn.preprocessing.data.StandardScaler,variencethre…0.97910.97910.97910.97910.97910.97911
sklearn.pipeline.Pipeline(simpleimputer=sklearn.impute._base.SimpleImputer,standardscaler=sklearn.preprocessing.data.StandardScaler,svc=sklearn.svm.classes.SVC)(4)0.97860.97860.97860.97860.97860.97861
sklearn.pipeline.Pipeline(imputation=hyperimp.utils.preprocessing.ConditionalImputer,hotencoding=sklearn.preprocessing.data.OneHotEncoder,scaling=sklearn.preprocessing.data.StandardScaler,variencethr…0.97850.97850.97850.97850.97850.97851
sklearn.pipeline.Pipeline(columntransformer=sklearn.compose._column_transformer.ColumnTransformer(numeric=sklearn.pipeline.Pipeline(imputer=sklearn.preprocessing.imputation.Imputer,standardscaler=skl…0.97850.97850.97850.97850.97850.97851
sklearn.pipeline.Pipeline(imputation=hyperimp.utils.preprocessing.ConditionalImputer2,hotencoding=sklearn.preprocessing.data.OneHotEncoder,scaling=sklearn.preprocessing.data.StandardScaler,varienceth…0.97850.97850.97850.97850.97850.97851
sklearn.model_selection._search.RandomizedSearchCV(estimator=sklearn.pipeline.Pipeline(imputation=hyperimp.utils.preprocessing.ConditionalImputer,hotencoding=sklearn.preprocessing.data.OneHotEncoder,…0.97830.97830.97830.97830.97830.97831
sklearn.model_selection._search.RandomizedSearchCV(estimator=sklearn.pipeline.Pipeline(imputation=mylib.preprocessing_openml14.ConditionalImputer,one-hot-encoder=sklearn.preprocessing.data.OneHotEnco…0.97820.97820.97820.97820.97820.97821
mlr.classif.svm.preproc.preproc.tuned(3)0.97820.97820.97820.97820.97820.97821
sklearn.pipeline.Pipeline(simpleimputer=sklearn.impute._base.SimpleImputer,standardscaler=sklearn.preprocessing.data.StandardScaler,svc=sklearn.svm.classes.SVC)(2)0.9780.9780.9780.9780.9780.9781
weka.FilteredClassifier_MultiSearch_SMO_RBFKernel(1)0.97730.97730.97730.97730.97730.97731
sklearn.pipeline.Pipeline(imputation=openmlstudy14.preprocessing.ConditionalImputer,hotencoding=sklearn.preprocessing.data.OneHotEncoder,variencethreshold=sklearn.feature_selection.variance_threshold…0.97560.97560.97560.97560.97560.97561
weka.SMO_RBFKernel(4)0.9750.9750.9750.9750.9750.9751
sklearn.svm.classes.SVC(45)0.9750.9750.9750.9750.9750.9751
sklearn.pipeline.Pipeline(imputer=sklearn.impute.SimpleImputer,estimator=sklearn.svm.classes.SVC)(1)0.9750.9750.9750.9750.9750.9751
sklearn.svm.classes.SVC(18)0.9750.9750.9750.9750.9750.9751
sklearn.pipeline.Pipeline(simpleimputer=sklearn.impute._base.SimpleImputer,histgradientboostingclassifier=sklearn.ensemble._hist_gradient_boosting.gradient_boosting.HistGradientBoostingClassifier)(1)0.97490.97490.97490.97490.97490.97491
weka.LibSVM(7)0.97490.97490.97490.97490.97490.97491
weka.LibSVM(2)0.97490.97490.97490.97490.97490.97491
sklearn.model_selection._search.RandomizedSearchCV(estimator=sklearn.pipeline.Pipeline(imputation=openmlstudy14.preprocessing.ConditionalImputer,hotencoding=sklearn.preprocessing.data.OneHotEncoder,v…0.97380.97380.97380.97380.97380.97381
sklearn.pipeline.Pipeline(imputer=sklearn.impute._base.SimpleImputer,estimator=sklearn.ensemble._forest.ExtraTreesClassifier)(1)0.97360.97360.97360.97360.97360.97361

…and 10 more subjects.

Metrics

  • predictive_accuracy — recorded on each measurement. Best predictive accuracy this flow achieved on the task: the fraction of test instances classified correctly, from 0 to 1. Higher is better

Subjects (35)

  • mlr.classif.svm.preproc.preproc.tuned(3)
  • sklearn.model_selection._search.RandomizedSearchCV(estimator=sklearn.ensemble._hist_gradient_boosting.gradient_boosting.HistGradientBoostingClassifier)(3)
  • sklearn.model_selection._search.RandomizedSearchCV(estimator=sklearn.pipeline.Pipeline(imputation=openmlstudy14.preprocessing.ConditionalImputer,hotencoding=sklearn.preprocessing.data.OneHotEncoder,v…
  • sklearn.model_selection._search.RandomizedSearchCV(estimator=sklearn.pipeline.Pipeline(imputation=hyperimp.utils.preprocessing.ConditionalImputer,hotencoding=sklearn.preprocessing.data.OneHotEncoder,…
  • sklearn.model_selection._search.RandomizedSearchCV(estimator=sklearn.pipeline.Pipeline(imputation=mylib.preprocessing_openml14.ConditionalImputer,one-hot-encoder=sklearn.preprocessing.data.OneHotEnco…
  • sklearn.model_selection._search.RandomizedSearchCV(estimator=sklearn.pipeline.Pipeline(imputation=hyperimp.utils.preprocessing.ConditionalImputer,hotencoding=sklearn.preprocessing.data.OneHotEncoder,…
  • sklearn.model_selection._search_successive_halving.HalvingRandomSearchCV(estimator=sklearn.ensemble._hist_gradient_boosting.gradient_boosting.HistGradientBoostingClassifier)(4)
  • sklearn.pipeline.Pipeline(columntransformer=sklearn.compose._column_transformer.ColumnTransformer(numeric=sklearn.pipeline.Pipeline(imputer=sklearn.preprocessing.imputation.Imputer,standardscaler=skl…
  • sklearn.pipeline.Pipeline(imputation=hyperimp.utils.preprocessing.ConditionalImputer2,hotencoding=sklearn.preprocessing.data.OneHotEncoder,scaling=sklearn.preprocessing.data.StandardScaler,varienceth…
  • sklearn.pipeline.Pipeline(imputation=hyperimp.utils.preprocessing.ConditionalImputer,hotencoding=sklearn.preprocessing.data.OneHotEncoder,scaling=sklearn.preprocessing.data.StandardScaler,variencethr…
  • sklearn.pipeline.Pipeline(imputation=openmlstudy14.preprocessing.ConditionalImputer,hotencoding=sklearn.preprocessing.data.OneHotEncoder,variencethreshold=sklearn.feature_selection.variance_threshold…
  • sklearn.pipeline.Pipeline(imputation=openmlstudy14.preprocessing.ConditionalImputer,hotencoding=sklearn.preprocessing.data.OneHotEncoder,variencethreshold=sklearn.feature_selection.variance_threshold…
  • sklearn.pipeline.Pipeline(imputation=openmlstudy14.preprocessing.ConditionalImputer,hotencoding=sklearn.preprocessing.data.OneHotEncoder,scaling=sklearn.preprocessing.data.StandardScaler,variencethre…
  • sklearn.pipeline.Pipeline(imputation=openmlstudy14.preprocessing.ConditionalImputer,hotencoding=sklearn.preprocessing.data.OneHotEncoder,scaling=sklearn.preprocessing.data.StandardScaler,variencethre…
  • sklearn.pipeline.Pipeline(imputation=preprocessing.ConditionalImputer2,catencoding=preprocessing.MultiLabelEncoder,variencethreshold=sklearn.feature_selection.variance_threshold.VarianceThreshold,clf…
  • sklearn.pipeline.Pipeline(imputer=sklearn.impute._base.SimpleImputer,estimator=sklearn.ensemble._forest.ExtraTreesClassifier)(1)
  • sklearn.pipeline.Pipeline(imputer=sklearn.impute.SimpleImputer,estimator=sklearn.svm.classes.SVC)(1)
  • sklearn.pipeline.Pipeline(simpleimputer=sklearn.impute._base.SimpleImputer,histgradientboostingclassifier=sklearn.ensemble._hist_gradient_boosting.gradient_boosting.HistGradientBoostingClassifier)(1)
  • sklearn.pipeline.Pipeline(simpleimputer=sklearn.impute._base.SimpleImputer,standardscaler=sklearn.preprocessing.data.StandardScaler,fkc_eigenpro=sklearn_extra.fast_kernel.FKC_EigenPro)(1)
  • sklearn.pipeline.Pipeline(simpleimputer=sklearn.impute._base.SimpleImputer,standardscaler=sklearn.preprocessing.data.StandardScaler,svc=sklearn.svm.classes.SVC)(4)
  • sklearn.pipeline.Pipeline(simpleimputer=sklearn.impute._base.SimpleImputer,standardscaler=sklearn.preprocessing.data.StandardScaler,svc=sklearn.svm.classes.SVC)(1)
  • sklearn.pipeline.Pipeline(simpleimputer=sklearn.impute._base.SimpleImputer,standardscaler=sklearn.preprocessing.data.StandardScaler,svc=sklearn.svm.classes.SVC)(2)
  • sklearn.svm.classes.SVC(18)
  • sklearn.svm.classes.SVC(32)
  • sklearn.svm.classes.SVC(45)
  • weka.AdaBoostM1_J48(1)
  • weka.AdaBoostM1_J48(2)
  • weka.FilteredClassifier_MultiSearch_SMO_RBFKernel(1)
  • weka.LibSVM(2)
  • weka.LibSVM(7)
  • weka.MultiBoostAB_J48(1)
  • weka.MultiBoostAB_RandomForest(1)
  • weka.RotationForest_PrincipalComponents_J48(14)
  • weka.SMO_RBFKernel(1)
  • weka.SMO_RBFKernel(4)

Published by OpenML.