Incorporating Uncertain Costs within a Series of Sequential Probability Ratio Tests
- 1 Discipline of Statistics, Trinity College Dublin, Dublin, Ireland
- 2 Discipline of Statistics, Trinity College Dublin, Dublin, Ireland
Abstract
We consider an extension to Sequential Probability Ratio Tests for when we have uncertain costs, but also opportunity to learn about these in an adaptive manner. In doing so we demonstrate the effects that allowing uncertainty has on observation cost, and the costs associated with Type I and Type II error. The value of information relating to modelled uncertainties is derived and the case of statistical dependence between the parameter affecting decision outcome and the parameter affecting unknown cost is also examined. Numerical examples of the derived theory are provided, along with a simulation comparing this adaptive learning framework to the classical one.
- Wald, A. (1945) Sequential Tests of Statistical Hypotheses. Annals of Mathematical Statistics, 16, 117-186. http://dx.doi.org/10.1214/aoms/1177731118
- Wald, A. and Wolfowitz, J. (1948) Optimum Character of the Sequential Probability Ratio Test. Annals of Mathematical Statistics, 19, 326-339. http://dx.doi.org/10.1214/aoms/1177730197
- Gross, K. and Humenik, K. (1991) Sequential Probability Ratio Test for Nuclear Plant Component Surveillance. Nuclear Technology, 93, 131-137.
- Kulldorf, M., Davis, R.L., Kolczak, M., Lewis, E., Lieu, T. and Platt, R. (2011) A Maximised Sequential Probability Ratio Test for Drug and Vaccine Safety Surveillance. Sequential Analysis, 30, 58-70. http://dx.doi.org/10.1080/07474946.2011.539924
- Spiegelhalter, D., Grigg, O., Kinsman, R. and Treasure, T. (2003) Risk-Adjusted Sequential Probability Ratio Tests: Applications to Bristol, Shipman and Adult Cardiac Surgery. International Journal for Quality in Health Care, 15, 7-13. http://dx.doi.org/10.1093/intqhc/15.1.7
- Spray, J.A. and Reckase, M.D. (1996) Comparison of SPRT and Sequential Bayes Procedures for Classifying Examinees into two Categories using a Computerized Test. Journal of Educational and Behavioral Statistics, 21, 405-414. http://dx.doi.org/10.3102/10769986021004405
- Corsini, G., DalleMese, E., Marchetti, G. and Verrazzani, L. (1985) Design of the SPRT for Radar Target Detection. IEE Proceedings F Communications, Radar and Signal Processing, 132, 139-148. http://dx.doi.org/10.1049/ip-f-1.1985.0035
- Fay, M., Kim, H. and Hachey, M. (2007) On Using Truncated Sequential Probability Ratio Test Boundaries for Monte Carlo Implementation of Hypothesis Tests. Journal of Computational and Graphical Statistics, 16, 946-967. http://dx.doi.org/10.1198/106186007X257025
- Malladi, D. and Speyer, J. (1999) A Generalized Shiryayev Sequential Probability Ratio Test for Change Detection and Isolation. IEEE Transactions on Automatic Control, 44, 1522-1534. http://dx.doi.org/10.1109/9.780416
- Matas, J. and Chum, O. (2005) Randomized Ransac with Sequential Probability Ratio Test. Tenth IEEE International Conference on Computer Vision (ICCV’05), 1, 1727-1732. http://dx.doi.org/10.1109/ICCV.2005.198
- Cyert, R. and DeGroot, M. (1975) Adaptive Economic Models. Academic Press.
- Boutilier, C. (2003) On the Foundations of Expected Expected Utility. Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence (IJCAI-03), Acapulco, 9-15 August 2003, 285-290.