Literature review is an important component in any scientific research. In ecological and agricultural sciences, many studies have been conducted over years. With accumulation of scientific studies and published papers, it is critical to summarize and evaluate these previous research findings. Different literature review methods have been applied, including traditional qualitative literature review, quantitative meta-analysis, and more recently, mega-analysis, or meta-meta-analysis. Here we briefly describe these different approaches and draw attention to the recent development of data synthesis. Several case studies were used to illustrate the application of these methods in the ecological and agricultural sciences.
KeywordsSystematic ReviewQuantitative SynthesisMeta-Meta-AnalysisSecond Order Meta-Analysis
Gurevitch, J., Morrow, L.L., Wallace, A. and Walsh, J.S. (1992) A Meta-Analysis of Competition in Field Experiments. American Naturalist, 140, 539-572. https://doi.org/10.1086/285428
Luo, Y., Hui, D. and Zhang, D. (2006) Elevated CO 2 Stimulates Net Accumulations of Carbon and Nitrogen in Land Ecosystems: A Meta-Analysis. Ecology, 87, 53-63. https://doi.org/10.1890/04-1724
Drewry, J.J., Carrick, S., Penny, V., Houlbrooke, D.J., Laurenson, S. and Mesman, N.L. (2021) Effects of Irrigation on Soil Physical Properties in Predominantly Pastoral Farming Systems: A Review. New Zealand Journal of Agricultural Research, 64, 483-507. https://doi.org/10.1080/00288233.2020.1742745
Kaur, N., Kieffer, C., Ren, W. and Hui, D. (2023) How Much Is Soil Nitrous Oxide Emission Reduced with Biochar Application? An Evaluation of Meta-Analyses. GCB Bioenergy, 15, 24-37. https://doi.org/10.1111/gcbb.13003
Webster, J. and Watson, R.T. (2002) Analyzing the Past to Prepare for the Future: Writing a Literature Review. MIS Quarterly, 26, 13-23.
Tylianakis, J.M., Didham, R.K., Bascompte, J. and Wardle, D.A. (2008) Global Change and Species Interactions in Terrestrial Ecosystems. Ecology Letters, 11, 1351-1363. https://doi.org/10.1111/j.1461-0248.2008.01250.x
Forstmeier, W., Wagenmakers, E.J. and Parker, T.H. (2017) Detecting and Avoiding Likely False-Positive Findings—A Practical Guide. Biological Reviews, 92, 1941-1968. https://doi.org/10.1111/brv.12315
Efron, S.E. and Ravid, R. (2018) Writing the Literature Review: A Practical Guide.
Walther, G.R., Post, E., Convey, P., Menzel, A., Parmesan, C., Beebee, T.J., Fromentin, J.M., Hoegh-Guldberg, O. and Bairlein, F. (2002) Ecological Responses to Recent Climate Change. Nature, 416, 389-395. https://doi.org/10.1038/416389a
Jesson, J., Matheson, L. and Lacey, F.M. (2011) Doing Your Literature Review: Traditional and Systematic Techniques.
Juroszek, P. and Von Tiedemann, A. (2013) Plant Pathogens, Insect Pests and Weeds in a Changing Global Climate: A Review of Approaches, Challenges, Research Gaps, Key Studies and Concepts. The Journal of Agricultural Science, 151, 163-188. https://doi.org/10.1017/S0021859612000500
Siddaway, A.P., Wood, A.M. and Hedges, L.V. (2019) How to Do a Systematic Review: A Best Practice Guide for Conducting and Reporting Narrative Reviews, Meta-Analyses, and Meta-Syntheses. Annual Review of Psychology, 70, 747-770. https://doi.org/10.1146/annurev-psych-010418-102803
Bello, A.K., Wiebe, N., Garg, A.X. and Tonelli, M. (2011) Basics of Systematic Reviews and Meta-Analyses for the Nephrologist. Nephron Clinical Practice, 119, c50-c61. https://doi.org/10.1159/000324432
Gurevitch, J., Koricheva, J., Nakagawa, S. and Stewart, G. (2018) Meta-Analysis and the Science of Research Synthesis. Nature, 555, 175-182. https://doi.org/10.1038/nature25753
Glass, G.V. (1976) Primary, Secondary, and Meta-Analysis of Research. Educational Researcher, 5, 3-8. https://doi.org/10.3102/0013189X005010003
Wan, S., Hui, D. and Luo, Y. (2001) Fire Effects on Nitrogen Pools and Dynamics in Terrestrial Ecosystems: A Meta-Analysis. Ecological Applications, 11, 1349-1365. https://doi.org/10.1890/1051-0761(2001)011[1349:FEONPA]2.0.CO;2
Song, J., Wan, S., Piao, S., Knapp, A.K., Classen, A.T., Vicca, S., Ciais, P., Hovenden, M.J., Leuzinger, S., Beier, C. and Kardol, P. (2019) A Meta-Analysis of 1,119 Manipulative Experiments on Terrestrial Carbon-Cycling Responses to Global Change. Nature Ecology & Evolution, 3, 1309-1320. https://doi.org/10.1038/s41559-019-0958-3
Lei, X.D., Peng, C.H., Tian, D.L. and Sun, J.F. (2007) Meta-Analysis and Its Application in Global Change Research. Chinese Science Bulletin, 52, 289-302. https://doi.org/10.1007/s11434-007-0046-y
Curtis, P.S. (1996) A Meta-Analysis of Leaf Gas Exchange and Grown under Elevated Carbon Dioxide. Plant, Cell & Environment, 19, 127-137. https://doi.org/10.1111/j.1365-3040.1996.tb00234.x
Ainsworth, E.A., Rosenberg, M.S. and Wang, X. (2007) Meta-Analysis: The Past, Present and Future. New Phytologist, 176, 742-745. https://doi.org/10.1111/j.1469-8137.2007.02277.x
Hui, D., Deng, Q., Tian, H. and Luo, Y. (2022) Global Climate Change and Greenhouse Gases Emissions in Terrestrial Ecosystems. In: Handbook of Climate Change Mitigation and Adaptation, Springer International Publishing, Cham, 23-76. https://doi.org/10.1007/978-3-030-72579-2_13
Hedges, L.V., Gurevitch, J. and Curtis, P.S. (1999) The Meta-Analysis of Response Ratios in Experimental Ecology. Ecology, 80, 1150-1156. https://doi.org/10.1890/0012-9658(1999)080[1150:TMAORR]2.0.CO;2
Lu, M., Zhou, X., Yang, Q., Li, H., Luo, Y., Fang, C., Chen, J., Yang, X. and Li, B.O. (2013) Responses of Ecosystem Carbon Cycle to Experimental Warming: A Meta-Analysis. Ecology, 94, 726-738. https://doi.org/10.1890/12-0279.1
Wang, J., Defrenne, C., McCormack, M.L., Yang, L., Tian, D., Luo, Y., Hou, E., Yan, T., Li, Z., Bu, W. and Chen, Y. (2021) Fine-Root Functional Trait Responses to Experimental Warming: A Global Meta-Analysis. New Phytologist, 230, 1856-1867. https://doi.org/10.1111/nph.17279
Rustad, L.E.J.L., Campbell, J., Marion, G., Norby, R., Mitchell, M., Hartley, A., Cornelissen, J., Gurevitch, J. and Gcte-News (2001) A Meta-Analysis of the Response of Soil Respiration, Net Nitrogen Mineralization, and Aboveground Plant Growth to Experimental Ecosystem Warming. Oecologia, 126, 543-562. https://doi.org/10.1007/s004420000544
Deng, Q., Hui, D., Luo, Y., Elser, J., Wang, Y.P., Loladze, I., Zhang, Q. and Dennis, S. (2015) Down-Regulation of Tissue N:P Ratios in Terrestrial Plants by Elevated CO 2 . Ecology, 96, 3354-3362. https://doi.org/10.1890/15-0217.1
Huang, Y., Ren, W., Wang, L., Hui, D., Grove, J.H., Yang, X., Tao, B. and Goff, B. (2018) Greenhouse Gas Emissions and Crop Yield in No-Tillage Systems: A Meta-Analysis. Agriculture, Ecosystems & Environment, 268, 144-153. https://doi.org/10.1016/j.agee.2018.09.002
Guo, C., Liu, X. and He, X. (2022) A Global Meta-Analysis of Crop Yield and Agricultural Greenhouse Gas Emissions under Nitrogen Fertilizer Application. Science of the Total Environment, 831, Article ID: 154982. https://doi.org/10.1016/j.scitotenv.2022.154982
Egger, M. and Smith, G.D. (1997) Meta-Analysis: Potentials and Promise. BMJ, 315, 1371-1374. https://doi.org/10.1136/bmj.315.7119.1371
Englund, G., Sarnelle, O. and Cooper, S.D. (1999) The Importance of Data-Selection Criteria: Meta-Analyses of Stream Predation Experiments. Ecology, 80, 1132-1141. https://doi.org/10.1890/0012-9658(1999)080[1132:TIODSC]2.0.CO;2
Philibert, A., Loyce, C. and Makowski, D. (2012) Assessment of the Quality of Meta-Analysis in Agronomy. Agriculture, Ecosystems and Environment, 148, 72-82. https://doi.org/10.1016/j.agee.2011.12.003
Krupnik, T.J. andersson, J.A., Rusinamhodzi, L., Corbeels, M., Shennan, C. and Gérard, B. (2019) Does Size Matter? A Critical Review of Meta-Analysis in Agronomy. Experimental Agriculture, 55, 200-229. https://doi.org/10.1017/S0014479719000012
Young, M.D., Ros, G.H. and de Vries, W. (2021) Impacts of Agronomic Measures on Crop, Soil, and Environmental Indicators: A Review and Synthesis of Meta-Analysis. Agriculture, Ecosystems & Environment, 319, Article ID: 107551. https://doi.org/10.1016/j.agee.2021.107551
Hungate, B.A., Van Groenigen, K.J., Six, J., Jastrow, J.D., Luo, Y., De Graaff, M.A., van Kessel, C. and Osenberg, C.W. (2009) Assessing the Effect of Elevated Carbon Dioxide on Soil Carbon: A Comparison of Four Meta-Analyses. Global Change Biology, 15, 2020-2034. https://doi.org/10.1111/j.1365-2486.2009.01866.x
Grados, D., Butterbach-Bahl, K., Chen, J., van Groenigen, K.J., Olesen, J.E., van Groenigen, J.W. and Abalos, D. (2022) Synthesizing the Evidence of Nitrous Oxide Mitigation Practices in Agroecosystems. Environmental Research Letters, 17, Article ID: 114024. https://doi.org/10.1088/1748-9326/ac9b50