Nearly Dimension-Independent Sparse Linear Bandit over Small Action Spaces via Best Subset Selection
We consider the stochastic contextual bandit problem under the high dimensional linear model. We focus on the case where the action space is finite and random, with each action associated with a randomly generated contextual covariate. This setting finds essential applications such as personalized recommendations, online advertisements, and personalized medicine. However, it is very challenging to balance the exploration and exploitation tradeoff. We modify the LinUCB algorithm in doubly growing epochs and estimate the parameter using the best subset selection method, which is easy to implement in practice. This approach achieves (Formula presented.) regret with high probability, which is nearly independent of the “ambient” regression model dimension d. We further attain a sharper (Formula presented.) regret by using the SupLinUCB framework and match the minimax lower bound of the low-dimensional linear stochastic bandit problem. Finally, we conduct extensive numerical experiments to empirically demonstrate our algorithms’ applicability and robustness. Supplementary materials for this article are available online.
This is an Accepted Manuscript of an article published by Taylor & Francis in Journal of the American Statistical Association on 2022-09-27, available online: https://www.tandfonline.com/10.1080/01621459.2022.2108816.
Files
Metadata
| Work Title | Nearly Dimension-Independent Sparse Linear Bandit over Small Action Spaces via Best Subset Selection |
|---|---|
| Access | |
| Creators |
|
| Keyword |
|
| License | CC BY-NC 4.0 (Attribution-NonCommercial) |
| Work Type | Article |
| Publisher |
|
| Publication Date | September 27, 2022 |
| Publisher Identifier (DOI) |
|
| Deposited | March 24, 2025 |
Versions
Analytics
Collections
This resource is currently not in any collection.