arxiv.org/pdf/2301.09633.pdf
1 Users
0 Comments
8 Highlights
1 Notes
Tags
Top Highlights
valid statistical inference when an experimental data set is supplemented with predictions from a machine-learning system
We present prediction-powered inference, a framework that provides an affirmative answer to the question of whether predictions can improve inferential quality.
Instead, our key idea is to use the gold-standard data set to quantify how the prediction errors affect the imputed estimate, and then construct a confidence set for θ∗ by adjusting for this effect
rectifier
the imputation approach
the rectifier captures a notion of prediction error. In the general setting of convex estimation problems, the relevant notion of error is the bias of the subgradient gθ computed using the predictions
n each of the following appli- cations, we compute the prediction-powered confidence interval for an estimand of interest and compare it to two alternatives: the classical interval, which uses only the gold-standard data (X, Y ), and the imputed interval, which uses only the imputed data ( ̃X, ̃f ) by treating it as gold-standard data.
Applications
Glasp is a social web highlighter that people can highlight and organize quotes and thoughts from the web, and access other like-minded people’s learning.