Comparison of Different Regularized and Shrinkage Regression Methods to Predict Daily Tropospheric Ozone Concentration in the Grand Casablanca Area — Oak Academic Publishing
Research ArticleOpen AccessGoogle Scholar indexed
Comparison of Different Regularized and Shrinkage Regression Methods to Predict Daily Tropospheric Ozone Concentration in the Grand Casablanca Area
Laboratory MAE2D, University of Abdelmalek Essaadi, Larache, Morocco
,
Laboratory of Mathematics Jean Leray UMR CNRS 6629, University of Nantes, Nantes, France
,
Laboratory MAE2D, University of Abdelmalek Essaadi, Larache, Morocco
,
Maison des Sciences de l’Homme Ange Guépin USR 3491, University of Nantes, Nantes, France
,
National Meteorological Office, Casablanca, Morocco
,
StatSC, ONIRIS, INRA, Nantes, France
1 Laboratory MAE2D, University of Abdelmalek Essaadi, Larache, Morocco
2 Laboratory of Mathematics Jean Leray UMR CNRS 6629, University of Nantes, Nantes, France
3 Laboratory MAE2D, University of Abdelmalek Essaadi, Larache, Morocco
4 Maison des Sciences de l’Homme Ange Guépin USR 3491, University of Nantes, Nantes, France
5 National Meteorological Office, Casablanca, Morocco
Tropospheric ozone (O3) is one of the pollutants that have a significant impact on human health. It can increase the rate of asthma crises, cause permanent lung infections and death. Predicting its concentration levels is therefore important for planning atmospheric protection strategies. The aim of this study is to predict the daily mean O3 concentration one day ahead in the Grand Casablanca area of Morocco using primary pollutants and meteorological variables. Since the available explanatory variables are multicollinear, multiple linear regressions are likely to lead to unstable models. To counteract the multicollinearity problem, we compared several alternative regression methods: 1 ) Continuum Regression ; 2 ) Ridge & Lasso Regressions ; 3 ) Principal component regression (PCR) ; 4 ) Partial least Square regression & sparse PLS and ; 5 ) Biased Power Regression. The aim is to set up a good prediction model of the daily ozone in the Grand Casablanca area. These models are fitted on a training data set (from the years 2013 and 2014), tested on a data set (from 2015) and validated on yet another data set data (from 2015). The Lasso model showed a better performance for the prediction of ozone concentrations compared to multiple linear regression and its other alternative methods.
KeywordsMultiple Linear RegressionMulticollinearityPenalized RegressionStatistical ForecastingTropospheric Ozone
Anenberg, S.C., Horowitz, L.W., Tong, D.Q. and West, J.J. (2010) An Estimate of the Global Burden of Anthropogenic Ozone and Fine Particulate Matter on Premature Human Mortality Using Atmospheric Modeling. Environmental Health Perspectives, 118, 1189-1195. https://doi.org/10.1289/ehp.0901220
Malig, B.J., Pearson, D.L., Chang, Y.B., Broadwin, R., Basu, R., Green, R.S. and Ostro, B. (2016) A Time-Stratified Case-Crossover Study of Ambient Ozone Exposure and Emergency Department Visits for Specific Respiratory Diagnoses in California (2005-2008). Environmental Health Perspectives, 124, 745-753. https://doi.org/10.1289/ehp.1409495
Russell, B., Cooley, D., Porter, W. and Heald, C. (2016) Modeling the Spatial Behavior of the Meteorological Driver’s Effects on Extreme Ozone. Environmetrics, 27, 334-344. https://doi.org/10.1002/env.2406
Bel, L., Bellanger, L., Bobbia, M., Ciuperca, G., Dacunha-Castelle, D., Gilibert, E., Jackubowicz, P., Oppenheim, G. and Tomassone, R. (1998) On Forecasting Ozone Episodes in the Paris Area. Listy Biometryczne-Biometrical Letters, 35, 37-66.
Bel, L., Bellanger, L., Bonneau, V., Ciuperca, G., Dacunha-Castelle, D., Deniau, C., Ghattas, B., Misiti, M., Misiti, Y., Oppenheim, G., Poggi, J.M. and Tomassone, R. (1999) Eléments de comparaison de prévisions statistiques des pics d’ozone. Revue de Statistique Appliquée, XLVII, 7-25.
Besse, P., Milhem, H., Mestre, O., Dufour, A. and Peuch, V.H. (2007) Comparaison de techniques de pour l’adaptation statistique des prévisions d’ozone du modèle de chimie-transport MOCAGE. Pollution atmosphérique, 195, 285-292. https://doi.org/10.4267/pollution-atmospherique.1442
Tamas, W. (2015) Prévision statistique de la qualité de l’air et d’épisodes de pollution atmosphérique en Corse: Génie des procédés. Ph.D. Thesis, Université de Corse Pascale Paoli, Francais, 254 p.
Lethrosne, M. (2008) Adaptation statistique des prévisions d’ozone issues du système Esméralda. Rapport de stage Master 2 Ingénierie Statistique à Airparif. Université de Rennes.
Oufdou, H. (2010) Réalisation de modèles de prévision par adaptation statistique. Rapport de stage Master 2 Ingénierie Statistique à AIRAQ. Université Bordeaux2.
Eljohra, B. (2005) Prévisibilité à 24 heures des concentrations en ozone troposphérique à Casablanca. Centre National de Recherches Météorologiques, Service Météorologie Sectorielle. DMN Maroc.
Hastie, T., Tibshirani, R. and Friedman, J. (2009) The Element of Statistical Learning: Data Mining, Inference, and Prediction. Springer, Berlin. https://doi.org/10.1007/978-0-387-84858-7
Hoerl, A. and Kennard, R. (1970) Ridge Regression: Biased Estimation for Non Orthogonal Problems. Technometrics, 12, 55-67. https://doi.org/10.1080/00401706.1970.10488634
Tibshirani, R. (1996) Regression Shrinkage and Selection via the Lasso. Journal of the Royal Statistical Society: Series B, 58, 267-288.
Joliffe, I.T. (1982) A Note on the Use of Principal Components in Regression. Journal of the Royal Statistical Society: Series C, 31, 300-303. https://doi.org/10.2307/2348005
Hoskuldsson, A. (1988) PLS Regression Methods. Journal of Chemometrics, 2, 211-228. https://doi.org/10.1002/cem.1180020306
Tenenhaus, M., Gauchi, J.P. and Ménardo, C. (1995) Régression PLS et applications. Revue de Statistique Appliquée, 43, 7-63.
Tenenhaus, M. (1998) La régression PLS, théorie et pratique. Technip, Paris.
Stone, M. and Brooks, R.J. (1990) Continuum Regression: Cross-Validated Sequentially Constructed Prediction Embracing Ordinary Least Squares, Partial Least Squares and Principal Components Regression. Journal of the Royal Statistical Society: Series B, 52, 237-269.
Sundberg, R. (1993) Continuum Regression and Ridge Regression. Journal of the Royal Statistical Society: Series B: Methodological, 55, 653-659. http://www.jstor.org/stable/2345877
Qannari, E.M., El Ghaziri, A. and Hanafi, M. (2017) Biased Power Regression: A New Biased Estimation Procedure in Linear Regression. Electronic Journal of Applied Statistical Analysis, 10, 160-179.
Houze, M.L. (1999) Concentrations en ozone dans les agglomérations dijonnaise et chalonnaise et conditions météorologiques (avril-aout 1998), Mémoire de maitrise de géographie. Université de Bourgogne, 67 p.
Little, R.J.A. and Rubin, D.B. (2002, 2014) Statistical Analysis with Missing Data. John Wiley & Sons, Hoboken.
Sande, I.G. (1983) Hot-Deck Imputation Procedures. Incomplete Data in Sample Surveys, 3, 334-350.
Ford, B.L. (1983) An Overview of Hot-Deck Procedures. Incomplete Data in Sample Surveys, 2, 185-207.
Fuller, W.A. and Kim, J.K. (2005) Hot Deck Imputation for the Response Model. Survey Methodology, 31, 139.
Rubin, D.B. (1987) Multiple Imputation for Non Response in Surveys. Wiley, New York. https://doi.org/10.1002/9780470316696
Beretta, L. and Santaniello, A. (2016) Nearest Neighbor Imputation Algorithms: A Critical Evaluation. BMC Medical Informatics and Decision Making, 16, 74. https://doi.org/10.1186/s12911-016-0318-z
Jolliffe, I.T. (2002) Principal Component Analysis. Second Edition, Chapter 7.
Husson, F., Le, S. and Pages, J. (2010) Exploratory Multivariate Analysis by Example Using R. Chapman and Hall, London. https://doi.org/10.1201/b10345
Bellanger, L. and Tomassone, R. (2014) Exploration de données et méthodes statistiques: Data analysis & Data mining avec R. Collection Références Sci, Editions Ellipses, Paris, 480 p.
Le Cao, K.A., Rossouw, D., Robert-Granié, C. and Besse, P. (2008) A Sparse PLS for Variable Selection When Integrating Omics Data. Statistical Applications in Genetics and Molecular Biology, 7, 32. https://doi.org/10.2202/1544-6115.1390
Chun, H. and Keles, S. (2010) Sparse Partial Least Squares Regression for Simultaneous Dimension Reduction and Variable Selection. Journal of the Royal Statistical Society: Series B, Statistical Methodology, 72, 3-25. https://doi.org/10.1111/j.1467-9868.2009.00723.x
Draper, N.R. and Smith, H. (1998) Selecting the “Best” Regression Equation. In: Applied Regression Analysis, 3rd Edition, John Wiley & Sons, Inc., Hoboken, 473-504.
James, G., Witten, D., Hastie, T. and Tibshirani, R. (2013) An Introduction to Statistical Learning with Applications in R. Springer Science + Business Media, New York.
Wold, H. (1966) Estimation of Principal Components and Related Models by Iterative Least Squares. In: Krishnaiah, P.R., Ed., Multivariate Analysis, Academic Press, New York, 391-420.
Abudu, S., Cui, C.L., King, J.P. and Abudukadeer, K. (2010) Comparison of Performance of Statistical Models in Forecasting Monthly Streamflow of Kizil River, China. Water Science and Engineering, 3, 269-281.
Sayegh, A., Munir, S. and Habeebullah, T.M. (2014) Comparing the Performance of Statistical Models for Predicting PM10 Concentrations. Aerosol and Air Quality Research, 14, 653-665. https://doi.org/10.4209/aaqr.2013.07.0259
Batista, G.E.A.P.A. and Monard, M.C. (2002) K-Nearest Neighbour as Imputation Method: Experimental Results. Technical Report, ICMC-USP.
Akaike, H. (1974) A New Look at the Statistical Model Identification. IEEE Transactions on Automatic Control, 19, 716-723. https://doi.org/10.1109/TAC.1974.1100705
Zhang, Z. (2016) Variable Selection with Stepwise and Best Subset Approaches. Annals of Translational Medicine, 4, 136. https://doi.org/10.21037/atm.2016.03.35