Challenges in Big Data analysis arise due to the way the data are recorded, maintained, processed and stored. We demonstrate that a hierarchical, multivariate, statistical machine learning algorithm, namely Boosted Regression Tree (BRT) can address Big Data challenges to drive decision making. The challenge of this study is lack of interoperability since the data, a collection of GIS shapefiles, remotely sensed imagery, and aggregated and interpolated spatio-temporal information, are stored in monolithic hardware components. For the modelling process, it was necessary to create one common input file. By merging the data sources together, a structured but noisy input file, showing inconsistencies and redundancies, was created. Here, it is shown that BRT can process different data granularities, heterogeneous data and missingness. In particular, BRT ha s the advantage of dealing with missing data by default by allowing a split on whether or not a value is missing as well as what the value is. Most importantly, the BRT offers a wide range of possibilities regarding the interpretation of results and variable selection is automatically performed by considering how frequently a variable is used to define a split in the tree. A comparison with two similar regression models (Random Forests and Least Absolute Shrinkage and Selection Operator, LASSO) show s that BRT outperforms these in this instance. BRT can also be a starting point for sophisticated hierarchical modelling in real world scenarios. For example, a single or ensemble approach of BRT could be tested with existing models in order to improve results for a wide range of data-driven decisions and applications.
KeywordsBoosted Regression TreesRemotely Sensed DataBig Data Modelling ApproachMissing Data
Schmidt, M., Thamm, H.P. and Menz, G. (2003) Long Term Vegetation Change Detection in an Arid Environment Using Landsat Data. Geoinformation for European-Wide Integration, Millpress, Rotterdam.
Marsett, R.C., Qi, J., Heilman, P., Biedenbender, S., Watson, M.C., Amer, S., Weltz, M., Goodrich, D. and Marsett, R.C. (2006) Remote Sensing for Grassland Management in the Arid Southwest. Rangeland Ecology & Management, 59, 530-540. https://doi.org/10.2111/05-201R.1
Huete, A., Ponce-Campos, G., Zhang, Y., Restrepo-Coupe, N., Ma, X. and Moran, M.S. (2015) Land Resources Monitoring, Modeling, and Mapping with Remote Sensing, Monitoring Photosynthesis from Space, CRC Press.
Jafari, A., Khademi, H., Finke, P.A., Van de Wauw, J. and Ayoubi, S. (2014) Spatial Prediction of Soil Great Groups by Boosted Regression Trees Using a Limited Point Dataset in an Arid Region, Southeastern Iran. Geoderma, 232-234, 148-163. https://doi.org/10.1016/j.geoderma.2014.04.029
Anderson, M.C., Allen, R.G., Morse, A. and Kustas, W.P. (2012) Use of Landsat Thermal Imagery in Monitoring Evapotranspiration and Managing Water Resources. Remote Sensing of Environment, 122, 50-65. https://doi.org/10.1016/j.rse.2011.08.025
Washington-Allen, R.A., Van Niel, T.G., Ramsey, R.D. and West, N.E. (2004) Remote Sensing Based Piosphere Analysis. GIScience and Remote Sensing, 41, 136-154. https://doi.org/10.2747/1548-1603.41.2.136
Stohlgren, T.J., Ma, P., Kumar, S., Rocca, M., Morisette, J.T., Jarnevich, C.S. and Benson, N. (2010) Ensemble Habitat Mapping of Invasive Plant Species. Risk Analysis, 30, 224-235. https://doi.org/10.1111/j.1539-6924.2009.01343.x
Sarker, C., Mejias Alvarez, L. and Woodley, A. (2016) Integrating Recursive Bayesian Estimation with Support Vector Machine to Map Probability of Flooding from Multispectral Landsat Data. International Conference on Digital Image Computing: Techniques and Applications. https://doi.org/10.1109/DICTA.2016.7797054
Australian Bureau of Meteorology (2016) Climate classification of Australia, http://www.bom.gov.au/climate/averages/climatology/gridded-data-info/metadata/md_koppen_classification.shtml
Scarth, P. (2017) Fractional Cover—Landsat, Joint Remote Sensing Research Program Algorithm, Australia Coverage. http://data.auscover.org.au/xwiki/bin/view/Product+pages/Landsat+Fractional+Cover
Scarth, P.F., Roder, A. and Schmidt, M. (2010) Fractional Cover. Proceedings of the 15th Australasian Remote Sensing and Photogrammetry Conference.
Bastin, G., Denham, R., Scarth, P., Sparrow, A. and Chewings, V. (2014) Remotely-Sensed Analysis of Ground-Cover Change in Queensland’s Rangelands, 1988-2005. Rangeland Journal, 36, 191-204. https://doi.org/10.1071/RJ13127
Leathwick, J.R., Elith, J., Francis, M.P., Hastie, T. and Taylor, P. (2006) Variation in Demersal Fish Species Richness in the Oceans Surrounding New Zealand: An Analysis Using Boosted Regression Trees. Marine Ecology-Progress Series, 321, 267-281. https://doi.org/10.3354/meps321267
Hastie, T., Tibshirani, R. and Friedman, J. (2009) The Elements of Statistical Learning. Springer Series in Statistics, New York. https://doi.org/10.1007/978-0-387-84858-7
Tarling, R. (2009) Statistical Modelling for Social Researchers: Principles and Practice. Taylor & Francis Group, Abingdon.
De’ath, G. and Fabricius, K.E. (2000) Classification and Regression Trees: A Powerful yet Simple Technique for Ecological Data Analysis. Ecology, 81, 3178-3192. https://doi.org/10.1890/0012-9658(2000)081[3178:CARTAP]2.0.CO;2
Friedman, J.H. (2001) Greedy Function Approximation: A Gradient Boosting Machine. Institute of Mathematical Statistics, 29, 1189-1232. http://www.jstor.org/stable/2699986
Robinzonov, N. (2013) Advances in Boosting of Temporal and Spatial Models. Ludwig-Maximilians-Universitat München. http://edoc.ub.uni-muenchen.de/15338/
James, G. and Witten, D. and Hastie, T. and Tibshirani, R. (2013) An Introduction to Statistical Learning. Springer Texts in Statistics, Springer-Verlag, New York, 856-875. https://doi.org/10.1007/978-1-4614-7138-7
Breiman, L. (1998) Arcing Classifiers. Annals of Statistics, 26, 801-849.
Freund, Y. and Schapire, R.E. (1996) Experiments with a New Boosting Algorithm. International Conference on Machine Learning, Bari, 3-6 July 1996, 148-156. http://dl.acm.org/citation.cfm?id=3091696.3091715
Friedman, J.H. (2002) Stochastic Gradient Boosting. Computational Statistics and Data Analysis, 28, 367-378. https://doi.org/10.1016/S0167-9473(01)00065-2
R Core Team (2017) R: A Language and Environment for Statistical Computing. https://www.R-project.org/
Elith, J., Leathwick, J.R. and Hastie, T. (2008) A Working Guide to Boosted Regression Trees. Journal of Animal Ecology, 77, 802-813. https://doi.org/10.1111/j.1365-2656.2008.01390.x
Tierney, N.J., Harden, F.A., Harden, M.J. and Mengersen, K.L. (2015) Using Decision Trees to Understand Structure in Missing Data. BMJ Open, 5, 1-12. https://doi.org/10.1136/bmjopen-2014-007450
Jansen, V., Kolden, C., Taylor, R. and Newingham, B. (2016) Quantifying Livestock Effects on Bunchgrass Vegetation with Landsat ETM+ Data across a Single Growing Season. International Journal of Remote Sensing, 37, 150-175. https://doi.org/10.1080/01431161.2015.1117681
Derry, J.F. (2004) Piospheres in Semi-Arid Rangeland: Consequences of Spatially Constrained Plant-Herbivore Interactions. The University of Edinburgh, 1-305. http://hdl.handle.net/1842/600
Humphries, G.R.W. (2015) Estimating Regions of Oceanographic Importance for Seabirds Using A-Spatial Data. PLoS ONE, 10, 1-15. https://doi.org/10.1371/journal.pone.0137241
Schapire, R. (2003) The Boosting Approach to Machine Learning: An Overview. MSRI Workshop on Nonlinear Estimation and Classification, Springer, New York. https://doi.org/10.1007/978-0-387-21579-2_9
Chipman, H.A., George, E.I. and McCulloch, R.E. (2001) The Elements of Statistical Learning: Data Mining, Inference and Prediction. Springer, New York.
Breiman, L., Friedman, J., Olshen, R. and Stone, C. (1984) Classification and Regression Trees. Chapman and Hall, Wadsworth, New York.
Tsangaratos, P. and Ilia, I. (2016) Landslide Susceptibility Mapping Using a Modified Decision Tree Classifier in the Xanthi Perfection, Greece. Landslides, 13, 305-320. https://doi.org/10.1007/s10346-015-0565-6
Cormen, T.H., Leiserson, C.E., Rivest, R.L. and Stein, C. (2009) Introduction to Algorithms. The MIT Press, Cambridge, Massachusetts.
Chipman, H.A., George, E.I. and McCulloch, R.E. (2010) BART: Bayesian Additive Regression Trees. Annals of Applied Statistics, 4, 266-298. https://doi.org/10.1214/09-AOAS285
Hastie, T.J. and Tibshirani, R. (1986) Generalized Additive Models. Statistical Science, 1, 297-310. https://doi.org/10.1214/ss/1177013604
Wood, S.N. (2011) Fast Stable Restricted Maximum Likelihood and Marginal Likelihood Estimation of Semiparametric Generalized Linear Models. Journal of the Royal Statistical Society (B), 73, 3-36. https://doi.org/10.1111/j.1467-9868.2010.00749.x
Lary, D.J., Alavi, A.H., Gandomi, A.H. and Walker, A.L. (2016) Machine Learning in Geosciences and Remote Sensing. Geoscience Frontiers, 7, 3-10. https://doi.org/10.1016/j.gsf.2015.07.003