Learning Theory

MSC 68Q32

Computational learning theory, statistical learning, PAC learning, online learning, information-theoretic limits.

74 problems

UnsolvedNotable

AdaBoost Always Cycles? (Global Dynamics Conjecture)

Learning TheoryDynamical Systems & Ergodic TheoryTheoretical Computer Science

Posed by Rudin, Daubechies, and Schapire (2004)

UnsolvedMajor

Tight PAC-Bayes Bounds for Deep Neural Networks

Learning TheoryMathematical Statistics
Partially ResolvedNotable

Optimal Distribution-Free Prediction Intervals

Mathematical StatisticsLearning Theory
UnsolvedMajor

Online Conformal Prediction Beyond Symmetric Intervals and Toward Conditional Validity

Mathematical StatisticsLearning Theory

Posed by Liu, Dobriban, and Orabona (2026)

UnsolvedMajor

Decision-Optimal Prediction Sets with Group/Label-Conditional Guarantees

Mathematical StatisticsLearning Theory

Posed by Wang and Dobriban (2026)

UnsolvedMajor

Multiple Risk Control Beyond Sequential Order: Graph-Structured Dependencies

Mathematical StatisticsLearning TheoryOptimization & Variational Methods

Posed by Joshi, Sun, Hassani, and Dobriban (2025)

UnsolvedMajor

Computational Threshold for Tensor PCA

Mathematical StatisticsLearning TheoryTheoretical Computer Science

Posed by Richard & Montanari (2014)

Partially Resolved

Sharp minimax rate for central-space estimation in the low-signal SIR regime

Mathematical StatisticsLearning Theory

Sourced from the work of Dongming Huang, Songtao Tian, Qian Lin

Unsolved

Universality of exponential decay of the $d$-th SIR eigenvalue

Mathematical StatisticsLearning Theory

Sourced from the work of Dongming Huang, Songtao Tian, Qian Lin

Unsolved

Remove the Polylogarithmic Gap to Exact Minimax Optimality

Mathematical StatisticsLearning TheoryInformation Theory

Sourced from the work of Kaizheng Wang

UnsolvedNotable

Local-asymptotic limit law with unknown diffusivity levels under vanishing jump

Mathematical StatisticsProbability TheoryLearning Theory

Sourced from the work of Markus Reiß, Claudia Strauch, Lukas Trottner

Unsolved

Multiple change-point inference for piecewise constant diffusivity

Mathematical StatisticsProbability TheoryLearning Theory

Sourced from the work of Markus Reiß, Claudia Strauch, Lukas Trottner

Partially Resolved

Higher-dimensional change-set (interface) estimation for discontinuous diffusivity

Mathematical StatisticsProbability TheoryLearning Theory

Sourced from the work of Markus Reiß, Claudia Strauch, Lukas Trottner

Unsolved

Rigorous tempered-overfitting guarantees for MDL ReLU interpolators under label noise

Learning TheoryMathematical StatisticsProbability Theory

Sourced from the work of Sourav Chatterjee, Timothy Sudijono

Unsolved

Does the score-matched optimal convex estimator attain the full semiparametric efficiency bound?

Mathematical StatisticsLearning TheoryOptimization & Variational Methods

Sourced from the work of Oliver Y. Feng, Yu-Chun Kao, Min Xu, Richard J. Samworth

Unsolved

Quantify and characterize the efficiency gap induced by convex-loss restriction for non-log-concave errors

Mathematical StatisticsLearning TheoryOptimization & Variational Methods

Sourced from the work of Oliver Y. Feng, Yu-Chun Kao, Min Xu, Richard J. Samworth

Unsolved

Finite-sample error-rate control and power guarantees under the linear subspace model

Mathematical StatisticsLearning TheoryInformation Theory

Sourced from the work of Amitay Eldar, Keren Mor Waknin, Samuel Davenport, Tamir Bendory, Armin Schwartzman, Yoel Shkolnisky

Unsolved

Complete Generic Identifiability in Cyclic LiNGAM with General Confounding

Mathematical StatisticsProbability TheoryLearning Theory

Sourced from the work of Daniele Tramontano, Jalal Etesami, Mathias Drton

Unsolved

Full Causal Graph Recovery Under Arbitrary Nonlinear Latent Confounding

Mathematical StatisticsProbability TheoryLearning Theory

Sourced from the work of Daniele Tramontano, Jalal Etesami, Mathias Drton

Unsolved

Provable Estimation Procedures Under the New Identifiability Criterion

Mathematical StatisticsProbability TheoryLearning Theory

Sourced from the work of Daniele Tramontano, Mathias Drton, Jalal Etesami

Unsolved

State evolution for gradient descent beyond the mean-field scaling

Mathematical StatisticsOptimization & Variational MethodsLearning Theory

Sourced from the work of Qiyang Han, Xiaocong Xu

Unsolved

Sharp characterization of misspecification robustness for debiased GD inference

Mathematical StatisticsOptimization & Variational MethodsLearning Theory

Sourced from the work of Qiyang Han, Xiaocong Xu

Unsolved

Log-factor-free adaptive contraction on general Minkowski-dimensional domains

Mathematical StatisticsLearning TheoryInformation Theory

Sourced from the work of Tao Tang, Nan Wu, Xiuyuan Cheng, David Dunson

Unsolved

Optimal adaptation beyond compact manifolds

Mathematical StatisticsLearning TheoryInformation Theory

Sourced from the work of Tao Tang, Nan Wu, Xiuyuan Cheng, David Dunson

Unsolved

Generalization-error estimation beyond Gaussian designs

Mathematical StatisticsOptimization & Variational MethodsLearning Theory

Sourced from the work of Pierre C Bellec, Kai Tan

Unsolved

Early-stopping optimality without a U-shape risk assumption

Mathematical StatisticsOptimization & Variational MethodsLearning Theory

Sourced from the work of Pierre C Bellec, Kai Tan

Unsolved

Machine-learning debiased efficient estimation under generalized data-fusion alignments

Mathematical StatisticsLearning TheoryInformation Theory

Sourced from the work of Ellen Sandra Graham, Marco Carone, Andrea Rotnitzky

Unsolved

Beyond smooth finite-dimensional targets in unified semiparametric data fusion

Mathematical StatisticsLearning TheoryInformation Theory

Sourced from the work of Ellen Sandra Graham, Marco Carone, Andrea Rotnitzky

UnsolvedNotable

Polynomial-time warm initialization at statistically optimal thresholds

Mathematical StatisticsProbability TheoryLearning Theory

Sourced from the work of Wanteng Ma, Dong Xia

Unsolved

Sharp computational lower bounds for valid inference in the intermediate regime

Mathematical StatisticsProbability TheoryLearning Theory

Sourced from the work of Wanteng Ma, Dong Xia

Unsolved

General-rank intrinsic Cramér–Rao lower bound on Tucker manifolds

Mathematical StatisticsProbability TheoryLearning Theory

Sourced from the work of Wanteng Ma, Dong Xia

Unsolved

Fixed-Parameter Tractability of Zonotope Problems

Learning TheoryTheoretical Computer Science

Posed by Vincent Froese et al. (2025)

Unsolved

Structure-Agnostic Minimax Risk for Partial Linear Model

Learning TheoryMathematical Statistics

Posed by Yihong Gu (2025)

Unsolved

Data Selection for Regression Tasks

Learning Theory

Posed by Steve Hanneke et al. (2025)

Unsolved

Optimal Instance-Dependent Sample Complexity for finding Nash Equilibrium in Two Player Zero-Sum Matrix games

Learning TheoryMathematical StatisticsTheoretical Computer Science

Posed by Arnab Maiti (2025)

Unsolved

Regret Minimization in Heavy-Tailed Bandits with Unknown Distributional Parameters

Learning TheoryOptimization & Variational Methods

Posed by Gianmarco Genalti et al. (2025)

Unsolved

Can Local Regularization Learn All Multiclass Problems?

Learning Theory

Posed by Julian Asilis et al. (2024)

Unsolved

What is the Complexity of Joint Differential Privacy in Linear Contextual Bandits?

Learning TheoryOptimization & Variational MethodsTheoretical Computer Science

Posed by Achraf Azize et al. (2024)

Unsolved

Tight Characterization of Instance-Optimal Identity Testing

Learning TheoryMathematical Statistics

Posed by Clément Canonne (2024)

Unsolved

Black-Box Reductions and Adaptive Gradient Methods for Nonconvex Optimization

Learning TheoryOptimization & Variational Methods

Posed by Xinyi Chen et al. (2024)

Unsolved

Direct Sums in Learning Theory

Learning Theory

Posed by Steve Hanneke et al. (2024)

Unsolved

Optimal Rates for Stochastic Decision-Theoretic Online Learning Under Differentially Privacy

Learning TheoryOptimization & Variational MethodsTheoretical Computer Science

Posed by Bingshan Hu et al. (2024)

Unsolved

Anytime Convergence Rate of Gradient Descent

Learning TheoryOptimization & Variational Methods

Posed by Guy Kornowski et al. (2024)

Unsolved

Order Optimal Regret Bounds for Kernel-Based Reinforcement Learning

Learning TheoryOptimization & Variational Methods

Posed by Sattar Vakili (2024)

Unsolved

Convergence of single-timescale mean-field Langevin descent-ascent for two-player zero-sum games

Learning TheoryOptimization & Variational Methods

Posed by Guillaume Wang et al. (2024)

Unsolved

log(n) factor in "Local Glivenko-Cantelli"

Learning Theory

Posed by Doron Cohen et al. (2023)

Unsolved

Learning sparse linear concepts by priming the features

Learning Theory

Posed by Manfred K. Warmuth et al. (2023)

Unsolved

The Sample Complexity of Multi-Distribution Learning for VC Classes

Learning TheoryMathematical StatisticsTheoretical Computer Science

Posed by Pranjal Awasthi et al. (2023)

Unsolved

Polynomial linearly-convergent method for g-convex optimization?

Learning TheoryOptimization & Variational Methods

Posed by Christopher Criscitiello et al. (2023)

Unsolved

Is There a First-Order Method that Only Converges to Local Minimax Optima?

Learning Theory

Posed by Jiseok Chae et al. (2023)

Unsolved

Properly learning decision trees in polynomial time?

Learning TheoryTheoretical Computer Science

Posed by Guy Blanc et al. (2022)

Unsolved

Regret Bounds for Noise-Free Kernel-Based Bandits

Learning TheoryOptimization & Variational Methods

Posed by Sattar Vakili (2022)

Unsolved

Running time complexity of accelerated $\ell_1$-regularized PageRank

Learning TheoryTheoretical Computer Science

Posed by Kimon Fountoulakis et al. (2022)

Unsolved

Do you pay for Privacy in Online learning?

Learning TheoryOptimization & Variational MethodsTheoretical Computer Science

Posed by Amartya Sanyal et al. (2022)

Unsolved

Better Differentially Private Learning Algorithms with Margin Guarantees

Learning TheoryTheoretical Computer Science

Posed by Raef Bassily et al. (2022)

Unsolved

Finite-Time Instance Dependent Optimality for Stochastic Online Learning with Feedback Graphs

Learning TheoryOptimization & Variational Methods

Posed by Teodor Vanislavov Marinov et al. (2022)

Unsolved

Optimal Best Arm Identification with Fixed-Budget

Learning Theory

Posed by Chao Qin (2022)

Unsolved

Are all VC-classes CPAC learnable?

Learning TheoryMathematical Statistics

Posed by Sushant Agarwal et al. (2021)

Unsolved

Is There an Online Learning Algorithm That Learns Whenever Online Learning Is Possible?

Learning TheoryOptimization & Variational Methods

Posed by Steve Hanneke (2021)

Unsolved

Tight Online Confidence Intervals for RKHS Elements

Learning TheoryOptimization & Variational Methods

Posed by Sattar Vakili et al. (2021)

Unsolved

Can Single-Shuffle SGD be Better than Reshuffling SGD and GD?

Learning TheoryOptimization & Variational Methods

Posed by Chulhee Yun et al. (2021)

Unsolved

Model Selection for Contextual Bandits

Learning TheoryOptimization & Variational Methods

Posed by Dylan J. Foster et al. (2020)

Unsolved

Tight Convergence of SGD in Constant Dimension

Learning TheoryOptimization & Variational Methods

Posed by Tomer Koren et al. (2020)

Unsolved

Average-Case Hardness of Hypergraphic Planted Clique Detection

Learning Theory

Posed by Yuetian Luo et al. (2020)

Unsolved

Information Complexity of VC Learning

Learning TheoryMathematical StatisticsTheoretical Computer Science

Posed by Thomas Steinke et al. (2020)

Unsolved

Fast and Optimal Online Portfolio Selection

Learning TheoryOptimization & Variational Methods

Posed by Tim Van Erven et al. (2020)

Unsolved

Is Margin Sufficient for Non-Interactive Private Distributed Learning?

Learning TheoryTheoretical Computer Science

Posed by Amit Daniely et al. (2019)

Unsolved

How fast can a multiclass test set be overfit?

Learning Theory

Posed by Vitaly Feldman et al. (2019)

Unsolved

Do Good Algorithms Necessarily Query Bad Points?

Learning Theory

Posed by Rong Ge et al. (2019)

Unsolved

Risk of Ruin in Multiarmed Bandits

Learning TheoryOptimization & Variational Methods

Posed by Filipo S. Perotto et al. (2019)

Unsolved

Monotonicity of Learning

Learning Theory

Posed by Tom Viering et al. (2019)

Unsolved

The Oracle Complexity of Convex Optimization with Limited Memory

Learning TheoryOptimization & Variational MethodsTheoretical Computer Science

Posed by Blake Woodworth et al. (2019)

Unsolved

The Dependence of Sample Complexity Lower Bounds on Planning Horizon

Learning TheoryMathematical StatisticsTheoretical Computer Science

Posed by Nan Jiang et al. (2018)

Unsolved

Improper learning of mixtures of Gaussians

Learning TheoryMathematical Statistics

Posed by Elad Hazan et al. (2018)