A variety of factors affect air quality, making it a difficult issue. The level of clean air in a certain area is referred to as air quality. It is challenging for conventional approaches to correctly discover aberrant values or outliers due to the significant fluctuation of this sort of data, which is influenced by Climate change and the environment. With accelerating industrial expansion and rising population density in Kolkata City, air pollution is continuously rising. This study involves two phases, in the first phase imputation of missing values and second detection of outliers using Statistical Process Control (SPC), and Functional Data Analysis (FDA), studies to achieve the efficacy of the outlier identification methodology proposed with working days and Nonworking days of the variables NO 2 , SO 2 , and O 3 , which were used for a year in a row in Kolkata, India. The results show how the functional data approach outshines traditional outlier detection methods. The outcomes show that functional data analysis vibrates more than the other two approaches after imputation, and the suggested outlier detector is absolutely appropriate for the precise detection of outliers in highly variable data.
KeywordsStatistical Process ControlFunctional Data AnalysisFuzzy C MeansOutliersAir Quality
Bhunia, G.S., Ghosh, A. and Shit, P.K. (2022) Comprehensive Spatio-Temporal Analysis of Ambient Air Quality of Kolkata Municipal Corporation, Kolkata (West Bengal, India) during 2017-2020. Arabian Journal of Geosciences, 15, Article No. 1782. https://doi.org/10.1007/s12517-022-11081-7
Kumar, K. and Pande, B.P. (2022) Air Pollution Prediction with Machine Learning: A Case Study of Indian Cities. International Journal of Environmental Science and Technology, 20, 5333-5348.
Bera, B., Bhattacharjee, S., Sengupta, N. and Saha, S. (2021) PM2.5 Concentration Prediction during COVID-19 Lockdown over Kolkata Metropolitan City, India Using MLR and ANN Models. Environmental Challenges, 4, Article ID: 100155. https://doi.org/10.1016/j.envc.2021.100155
Rady, A., Beheary, M., El-Metwally, M. and Zahran, A. (2023) Comparative Analysis of PM10 Emission Rates from Controlled and Uncontrolled Cement Silos in Concrete Batching Facilities. Open Journal of Air Pollution, 12, 67-77. https://doi.org/10.4236/ojap.2023.122004
Anyikwa, S., Ndukwe, O., Umeojiakor, T., Nnaji, P. and Amadi, N. (2022) Monitoring and Evaluation of Air Pollution at Ohaji/Egbema Flow Station and Its Environs via GPS in Ohaji Egbema Lga, Imo State Nigeria. Detection, 9, 37-49. https://doi.org/10.4236/detection.2022.94004
Sosa Donoso, J.R., Flores, M., Naya, S. and Tarrío-Saavedra, J. (2023) Local Correlation Integral Approach for Anomaly Detection Using Functional Data. Mathematics, 11, Article 815. https://doi.org/10.3390/math11040815
Sancho, J., Iglesias, C., Piñeiro, J., Martínez, J., Pastor, J.J., Araújo, M. and Taboada, J. (2016) Study of Water Quality in a Spanish River Based on Statistical Process Control and Functional Data Analysis. Mathematical Geosciences, 48, 163-186. https://doi.org/10.1007/s11004-015-9605-y
Dombeck, D.A., Graziano, M.S. and Tank, D.W. (2009) Functional Clustering of Neurons in Motor Cortex Determined by Cellular Resolution Imaging in Awake Behaving Mice. Journal of Neuroscience, 29, 13751-13760. https://doi.org/10.1523/JNEUROSCI.2985-09.2009
Sancho, J., Martínez, J., Pastor, J.J., Taboada, J., Piñeiro, J.I. and García-Nieto, P.J. (2014) New Methodology to Determine Air Quality in Urban Areas Based on Runs Rules for Functional Data. Atmospheric Environment, 83, 185-192. https://doi.org/10.1016/j.atmosenv.2013.11.010
Sancho, J., Pastor, J.J., Martínez, J. and García, M.A. (2013) Evaluation of Harmonic Variability in Electrical Power Systems through Statistical Control of Quality and Functional Data Analysis. Procedia Engineering, 63, 295-302. https://doi.org/10.1016/j.proeng.2013.08.224
Martínez, J., Saavedra, á., García-Nieto, P.J., Piñeiro, J.I., Iglesias, C., Taboada, J. and Pastor, J. (2014) Air Quality Parameters Outliers Detection Using Functional Data Analysis in the Langreo Urban Area (Northern Spain). Applied Mathematics and Computation, 241, 1-10. https://doi.org/10.1016/j.amc.2014.05.004
Majumdar, D., Purohit, P., Bhanarkar, A.D., Rao, P.S., Rafaj, P., Amann, M. and Srivastava, A. (2020) Managing Future Air Quality in Megacities: Emission invEntory and Scenario Analysis for the Delhi Metropolitan City, India. Atmospheric Environment, 222, Article ID: 117135. https://doi.org/10.1016/j.atmosenv.2019.117135
Ahmad, M., Haq, A., Kalam, A. and Shah, S.K. (2022) A Comparative Study of Outlier Detection of Yamuna River Delhi India by Classical Statistics and Statistical Quality Control. Reliability: Theory & Applications, 17, 430-438.
Haque, M. and Singh, R.B. (2017) Air Pollution and Human Health in Delhi, India: A Case Study. Climate, 5, Article 77. https://doi.org/10.3390/cli5040077
Torres, J.M., Nieto, P.G., Alejano, L. and Reyes, A.N. (2011) Detection of Outliers in Gas Emissions from Urban Areas Using Functional Data Analysis. Journal of Hazardous Materials, 186, 144-149. https://doi.org/10.1016/j.jhazmat.2010.10.091
Di Blasi, J.P., Torres, J.M., Nieto, P.G., Fernández, J.A., Muñiz, C.D. and Taboada, J. (2013) Analysis and Detection of Outliers in Water Quality Parameters from Different Automated Monitoring Stations in the Miño River Basin (NW Spain). Ecological Engineering, 60, 60-66. https://doi.org/10.1016/j.ecoleng.2013.07.054
Beevers, S.D., Carslaw, D.C., Dajnak, D., Stewart, G.B., Williams, M.L., Fussell, J.C. and Kelly, F.J. (2016) Traffic Management Strategies for Emissions Reduction: Recent Experience in London. Energy and Emission Control Technologies, 4, 27-39. https://doi.org/10.2147/EECT.S69858
Matías, J.M., Ordóñez, C., Taboada, J. and Rivas, T. (2009) Functional Support Vector Machines and Generalized Linear Models for Glacier Geomorphology Analysis. International Journal of Computer Mathematics, 86, 275-285. https://doi.org/10.1080/00207160801965305
Ben-Gal, I. (2005) Outlier Detection. In: Maimon, O. and Rokach, L., Eds., Data Mining and Knowledge Discovery Handbook, Springer, Boston, 131-146. http://mse415.free.fr/outliermethods.pdf https://doi.org/10.1007/0-387-25465-X_7
Martinez, W.G., Weese, M.L. and Jones-Farmer, L.A. (2020) A One Class Peeling Method for Multivariate Outlier Detection with Applications in Phase I SPC. Quality and Reliability Engineering International, 36, 1272-1295. https://doi.org/10.1002/qre.2629
García-Nieto, P.J. (2001) Parametric Study of Selective Removal of Atmospheric Aerosol by Coagulation, Condensation and Gravitational Settling. International Journal of Environmental Health Research, 11, 149-160. https://doi.org/10.1080/09603120020047528
Karaca, F., Alagha, O. and Ertürk, F. (2005) Statistical Characterisation of Atmospheric PM10 and PM2. 5 Concentrations at a Non-Impacted Suburban Site of Istanbul, Turkey. Chemosphere, 59, 1183-1190. https://doi.org/10.1016/j.chemosphere.2004.11.062
Torres, J.M., Pastor Perez, J., Sancho Val, J., McNabola, A., Martinez Comesana, M. and Gallagher, J. (2020) A Functional Data Analysis Approach for the Detection of Air Pollution Episodes and Outliers: A Case Study in Dublin, Ireland. Mathematics, 8, Article 225. https://doi.org/10.3390/math8020225
Rigueira, X., Araújo, M., Martínez, J., García-Nieto, P.J. and Ocarranza, I. (2022) Functional Data Analysis for the Detection of Outliers and Study of the Effects of the COVID-19 Pandemic on Air Quality: A Case Study in Gijón, Spain. Mathematics, 10, Article 2374. https://doi.org/10.3390/math10142374
Amiri, M. and Jensen, R. (2016) Missing Data Imputation Using Fuzzy-Rough Methods. Neurocomputing, 205, 152-164. https://doi.org/10.1016/j.neucom.2016.04.015
García-Laencina, P.J., Sancho-Gómez, J.L. and Figueiras-Vidal, A.R. (2010) Pattern Classification with Missing Data: A Review. Neural Computing and Applications, 19, 263-282. https://doi.org/10.1007/s00521-009-0295-6
Tang, J., Zhang, G., Wang, Y., Wang, H. and Liu, F. (2015) A Hybrid Approach to Integrate Fuzzy C-Means Based Imputation Method with Genetic Algorithm for Missing Traffic Volume Data Estimation. Transportation Research Part C: Emerging Technologies, 51, 29-40. https://doi.org/10.1016/j.trc.2014.11.003
Tang, J., Yu, S., Liu, F., Chen, X. and Huang, H. (2019) A Hierarchical Prediction Model for Lane-Changes Based on Combination of Fuzzy C-Means and Adaptive Neural Network. Expert Systems with Applications, 130, 265-275. https://doi.org/10.1016/j.eswa.2019.04.032
Hasnain, A., Sheng, Y., Hashmi, M.Z., Bhatti, U.A., Ahmed, Z., and Zha, Y. (2023) Assessing the Ambient Air Quality Patterns Associated to the COVID-19 Outbreak in the Yangtze River Delta: A Random Forest Approach. Chemosphere, 314, Article 137638. https://doi.org/10.1016/j.chemosphere.2022.137638
Chao, Q.I.A.N., Jian-Xun, C.H.E.N., Yan-Bin, L.U.O. and Liang, D.A.I. (2016) Random Forest Based Operational Missing Data Imputation for Highway Tunnel. Journal of Transportation Systems Engineering and Information Technology, 16, 81-87.
Ghose, M.K., Paul, R. and Banerjee, S.K. (2005) Assessment of the Impact on Human Health of Exposure to Urban Air Pollutants: An Indian Case Study. International Journal of Environmental Studies, 62, 201-214. https://doi.org/10.1080/0020723042000275123
Anon (2002) Report of the Committee Constituted by the Order of the Honourable High Court, Calcutta for Recommending Measures to Check the Pollution in the City of Calcutta. Health Effects of Air Pollution: A Study of Kolkata, Department of Environment, Government of West Bengal and West Bengal Pollution Control Board, Kolkata.
Kumar, B. and Singh, R.B. (2003) Urban Development and Anthropogenic Climate Change: Experience in Indian Metropolitan Cities. Manak Publication Pvt. Ltd., New Delhi.
Singh, R.B. and Haque, S. (2016) Urban Ambient Air Quality and Respiratory Health in Kolkata: A Dispensary Level Analysis. European Urban and Regional Studies, 2, 7-21.
Bhaumik, S. (2007) Air Pollution Suffocates Calcutta. BBC News. http://news.bbc.co.uk/2/hi/south_asia/6614561.stm
Mondal, R., Sen, G.K., Chatterjee, M., Sen, B.K. and Sen, S. (2000) Ground-Level Concentration of Nitrogen Oxides (NOx) at Some Traffic Intersection Points in Calcutta. Atmospheric Environment, 34, 629-633. https://doi.org/10.1016/S1352-2310(99)00216-2
Ghose, M.K., Paul, R. and Banerjee, S.K. (2004) Assessment of the Impacts of Vehicular Emissions on Urban Air Quality and Its Management in Indian Context: The Case of Kolkata (Calcutta). Environmental Science & Policy, 7, 345-351. https://doi.org/10.1016/j.envsci.2004.05.004
Mukherjee, A., Mukherjee, G., Banerji, U. and Mukhopadhyay, S.P. (1998) Occupational Exposure of the Traffic Personnel of Calcuta to Lead and Carbonmonoxide. Pollution Research, 17, 359-362.
Kazimuddin, A. and Banerjee, L. (2000) Fighting for Air. http://www.downtoearth.org.in/coverage/fighting-for-air-18428
Ghose, M.K. (2009) Air Pollution in the City of Kolkata: Health Effects Due to Chronic Exposure. Environmental Quality Management, 19, 53-70. https://doi.org/10.1002/tqem.20245
West Bengal Pollution Control Board (2005) Air Quality Management: Final Report. WBPCB in Collaboration with Asian Development Bank, Intercontinental Consultant and Technocrats Pvt. Ltd., New Delhi.
Carslaw, D.C. and Ropkins, K. (2012) Openair—An R Package for Air Quality Data Analysis. Environmental Modelling & Software, 27, 52-61. https://doi.org/10.1016/j.envsoft.2011.09.008
Chan, K.C.C., Wong, A.K.C., Piatesky-Shapiro, G. and Frawley, W.J. (1991) Knowledge Discovery in Databases. MIT Press, Cambridge.
Huang, J., Mao, B., Bai, Y., Zhang, T. and Miao, C. (2020) An Integrated Fuzzy C-Means Method for Missing Data Imputation Using Taxi GPS Data. Sensors, 20, Article 1992. https://doi.org/10.3390/s20071992
Montgomery, D.C. (2017) Design and Analysis of Experiments. John Wiley & Sons, Hoboken.
Shewhart, W.A. (1931) Economic Control of Quality of Manufactured Product. Macmillan, London.
Chen, Y.K. (2003) An Evolutionary Economic-Statistical Design for VSI X Control Charts under Non-Normality. The International Journal of Advanced Manufacturing Technology, 22, 602-610. https://doi.org/10.1007/s00170-003-1612-3
Grant, E. and Leavenworth, R. (1998) Statistical Quality Control. McGraw-Hill, New York.
Champ, C. and Woodall, W. (1987) Exact Results for Shewhart Control Charts with Supplementary Runs Rules. Technometrics, 29, 393-399. https://doi.org/10.1080/00401706.1987.10488266
Zhang, M.H., Lin, W.Y., Klein, S.A., Bacmeister, J.T., Bony, S., Cederwall, R.T., Zhang, J.H., et al. (2005) Comparing Clouds and Their Seasonal Variations in 10 Atmospheric General Circulation Models with Satellite Measurements. Journal of Geophysical Research: Atmospheres, 110, D15S02. https://doi.org/10.1029/2004JD005021
Box, G. and Cox, D. (1964) An Analysis of Transformations. Journal of the Royal Statistical Society: Series B (Methodological), 26, 211-243. https://doi.org/10.1111/j.2517-6161.1964.tb00553.x
Electric, W. (1956) Statistical Quality Control Handbook. AT&T Technologics, Indianapolis.
Ramsay, J. and Silverman, B. (2005) Functional Data Analysis. Springer, New York. https://doi.org/10.1007/b98888
Cuevas, A. and Fraiman, R. (1997) A Plug-in Approach to Support Estimation. The Annals of Statistics, 25, 2300-2312. https://doi.org/10.1214/aos/1030741073
Febrero, M., Galeano, P. and González-Manteiga, W. (2008) Outlier Detection in Functional Data by Depth Measures, with Application to Identify Abnormal NOx Levels. Environmetrics: The Official Journal of the International Environmetrics Society, 19, 331-345. https://doi.org/10.1002/env.878
Cuevas, A., Febrero, M. and Fraiman, R. (2006) On the Use of the Bootstrap for Estimating Functions with Functional Data. Computational Statistics & Data Analysis, 51, 1063-1074. https://doi.org/10.1016/j.csda.2005.10.012
Febrero, M., Galeano, P. and González-Manteiga, W. (2007) A Functional Analysis of NOx Levels: Location and Scale Estimation and Outlier Detection. Computational Statistics, 22, 411-427. https://doi.org/10.1007/s00180-007-0048-x
Peng, L. and Qi, Y. (2008) Bootstrap Approximation of Tail Dependence Function. Journal of Multivariate Analysis, 99, 1807-1824. https://doi.org/10.1016/j.jmva.2008.01.018