The amount of data that is traveling across the internet today, including very large and complex set of raw facts that are not only large, but also, complex, noisy, heterogeneous, and longitudinal data as well. Companies, institutions, healthcare system, mobile application capturing devices and sensors, traffic management, banking, retail, education etc., use piles of data which are further used for creating reports in order to ensure continuity regarding the services that they have to offer. Recently, Big data is one of the most important topics in IT industry. Managing Big data needs new techniques because traditional security and privacy mechanisms are inadequate and unable to manage complex distributed computing for different types of data. New types of data have different and new challenges also. A lot of researches treat with big data challenges starting from Doug Laney’s landmark paper , during the previous two decades; the big challenge is how to operate a huge volume of data that has to be securely delivered through the internet and reach its destination intact. The present paper highlights important concepts of Fifty - six Big Data V’s characteristics. This paper also highlights the security and privacy Challenges that Big Data faces and solving this problem by proposed technological solutions that help us avoiding these challenging problems.
KeywordsBig DataBig Data V’s CharacteristicsSecurityPrivacyChallengesTechnological Solutions
Hussien, A.A. (2020) How Many Old and New Big Data V’s Characteristics, Processing Technology, and Applications (BD1). International Journal of Application or Innovation in Engineering & Management, 9, 15-27. http://www.ijaiem.org/
Priyadarshy, S. (2015) The 7 Pillars of Big Data. Petrolium Review, 14 January.
Trifu, M.R. and Ivan, M.L. (2014) Big Data: Present and Future. Database Systems Journal, 1, No. 1.
Firican, G. (2017) The 10 V’S BIG DATA. Work Paper, 8 February.
Borne, K. (2014) Top 10 Big Data Challenges—A Serious Look at 10 Big Data V’s. Blog Post, 11 April.
Vorhies, W. (2014) How Many V’S in Big Data. View Blog Work Paper, 31 October. http://www.aimspress.com/journal/Math
Dhamodharavadhani, S. and Rajasekaran, G. (2018) Unlock Different V’s of Big Data for Analytics. International Journal of Computer Sciences and Engineering, 6, Special Issue-4.
Dr. Darrin (2016). https://educationalresearchtechniques.wordpress.com/2016/05/02/characteristics-of-big-data/
Laney, D. (2012) http://blogs.gartner.com/doug-laney/deja-vvvue-others-claiming-gartners-volume-velocity-variety-construct-for-big-data/
Cartledge, C. (2016) How Many vs Are There in Big Data? Working Paper, 18 February.
Borne, D. (2014). https://www.mapr.com/blog/top-10-big-data-challenges-serious-look-10-big-data-vs
Sivarajah, U., Kamal, M.M., Irani, Z. and Weerakkody, V. (2017) Critical Analysis of Big Data Challenges and Analytical Methods. Journal of Business Research, 70, 263-286. https://doi.org/10.1016/j.jbusres.2016.08.001
Boyd, D. and Crawford, K. (2012) Critical Questions for Big Data: Provocations for a Cultural, Technological, and Scholarly Phenomenon. Information, Communication & Society, 15, 662-679. https://doi.org/10.1080/1369118X.2012.678878
Venkatraman, S. and Venkatraman, R. (2019) Big Data Security Challenges and Strategies. AIMS Mathematics, 4, 860-879. https://doi.org/10.3934/math.2019.3.860
Hargittai, E. (2013) Is Bigger Always Better? Potential Biases of Big Data Derived from Social Network Sites. The ANNALS of the American Academy of Political and Social Science, 659, 63-76. https://doi.org/10.1177/0002716215570866
Mayer, K., et al. (2009) Computational Social Science. Schlüsselwerke der Netzwerkforschung ook.
Wang, Y.X. and Wiebe, V.J. (2014) Big Data Analytics on the Characteristic Equilibrium of Collective Opinions in Social Networks. International Journal of Cognitive informatics and Natural Intelligence, 8, Article No.: 3. https://doi.org/10.4018/IJCINI.2014070103
Akerkar, R. (2014) Big Data Computing. Taylor & Francis Group, CRC Press, New York. https://doi.org/10.1201/b16014
Zicari, R.V. (2014) Big Data: Challenges and Opportunities. Big Data Computing, 103-128.
Agrawal, R. and Nyamful, C. (2016) Challenges of Big Data Storage and Management. Global Journal of Information Technology, 6, 1-10. http://sproc.org/ojs/index.php/gjit https://doi.org/10.18844/gjit.v6i1.383
Tarekegn, G.B. and Munaye, Y.Y. (2016) Big Data: Security Issues, Challenges and Future Scope. International Journal of Computer Engineering & Technology, 7, 12-24.
Cavanillas, J.M., Curry, E. and Wahlster, W. (2017) New Horizons for a Data-Driven Economy: A Roadmap for Usage and Exploitation of Big Data in Europe. Library of Congress Control Number: 2015951834. https://doi.org/10.1007/978-3-319-21569-3
Kumar, N., Vasilakos, A.V. and Rodrigues, J.J.P. (2017) A Multi-Tenant Cloud-Based DC Nano Grid for Self-Sustained Smart Buildings in Smart Cities. IEEE Communications Magazine, 55, 14-21. https://doi.org/10.1109/MCOM.2017.1600228CM
Yao, Z., Mark, P. and Rabbat, M. (2012) Anomaly Detection Using Proximity Graph and PageRank Algorithm. IEEE Transactions on Information Forensics and Security, 7, 1288-1300. https://doi.org/10.1109/TIFS.2012.2191963
Yan, Z., Ding, W., Niemi, V. and Vasilakos, A.V. (2016) Two Schemes of Privacy-Preserving Trust Evaluation. Future Generation Computer Systems, 62, 175-189. https://doi.org/10.1016/j.future.2015.11.006
Rebecca Webb (2018) 12 Challenges of Data Analytics and How to Fix Them. Risk management Blog-Clearrisk. https://www.clearrisk.com/risk-management-blog/challenges-of-data-analytics
Puthal, D., Nepal, S., Ranjan, R. and Chen, J.J. (2017) A Dynamic Prime Number Based Efficient Security Mechanism for Big Sensing Data Streams. Journal of Computer and System Sciences, 83, 22-42. https://doi.org/10.1016/j.jcss.2016.02.005
Akoglu, L., Tong, H.H. and Koutra, D. (2015) Graph Based Anomaly Detection and Description: A Survey. Data Mining and Knowledge Discovery, 29, 626-688. https://doi.org/10.1007/s10618-014-0365-y
Hasani, Z. and Krrabaj, S. (2019) Survey and Proposal of an Adaptive Anomaly Detection Algorithm for Periodic Data Streams. Journal of Computer and Communications, 7, 33-55. https://doi.org/10.4236/jcc.2019.78004
Hasani, Z., Jakimovski, B., Velinov, G. and Kon-Popovska, M. (2018) An Adaptive Anomaly Detection Algorithm for Periodic Real Time Data Streams. In: International Conference on Intelligent Data Engineering and Automated Learning, Springer, Berlin, 385-397. https://doi.org/10.1007/978-3-030-03493-1_41
Shahin, A.A. (2016) Using Multiple Seasonal Holt-Winters Exponential Smoothing to Predict Cloud Resource Provisioning. International Journal of Advanced Computer Science and Applications, 7, 91-96. https://doi.org/10.14569/IJACSA.2016.071113
Cortez, P., Rocha, M. and Neves, J. (2001) Genetic and Evolutionary Algorithms for Time Series Fore-Casting. In: Monostori, L., Váncza, J. and Ali, M., Eds., Engineering of Intelligent Systems, Lecture Notes in Computer Science, Vol. 2070, Springer, Berlin, Heidelberg, 393-402. https://doi.org/10.1007/3-540-45517-5_44
de Assis, M.V.O., Carvalho, L.F., Rodrigues, J.J.P.C. and Proença, M.L. (2013) Holt-Winters Statistical Forecasting and ACO Metaheuristic for Traffic Characterization. IEEE International Conference on Communications, Budapest, 9-13 June 2013, 2524-2528. https://doi.org/10.1109/ICC.2013.6654913
Scrucca, L. (2013) GA: A Package for Genetic Algorithms. Journal of Statistical Software, 53, 1-37. https://doi.org/10.18637/jss.v053.i04
NUMENTA, Anomaly Benchmark with Labeled Anomalies. https://github.com/numenta/NAB/tree/master/data/artificialWithAnomaly
Yahoo: S5-dA, Anomaly Detection Dataset, Version 1.0(16M). https://webscope.sandbox.yahoo.com/catalog.php?datatype=s%5c&did=70
Zhou, G.M., Zhang, D.X., Liu, Y.J., et al. (2015) A Novel Image Encryption Algorithm Based on Chaos and Line Map. Neurocomputing, 169, 150-157. https://doi.org/10.1016/j.neucom.2014.11.095
Wang, Z.W., Cao, C., Yang, N.H. and Chang, V. (2017) ABE with Improved Auxiliary Input for Big Data Security. Journal of Computer and System Sciences, 89, 41-50. https://doi.org/10.1016/j.jcss.2016.12.006
Kshetri, N. (2014) The Emerging Role of Big Data in Key Development Issues: Opportunities, Challenges, and Concerns. Big Data & Society, 1, 1-20. https://doi.org/10.1177/2053951714564227
Hsu, C., Zeng, B. and Zhang, M. (2014) A Novel Group Key Transfers for Big Data Security. Applied Mathematics and Computation, 249, 436-443. https://doi.org/10.1016/j.amc.2014.10.051
Kapil, G., Agrawal, A., Attaallah, A., Algarni, A., Kumar, R. and Khan, R.A. (2020) Attribute Based Honey Encryption Algorithm for Securing Big Data: Hadoop Distributed File System Perspective. PeerJ Computer Science, 6, e259. https://doi.org/10.7717/peerj-cs.259
Wu, X.D., Zhu, X.Q., Wu, G.-Q. and Ding, W. (2014) Data Mining with Big Data. IEEE Transactions on Knowledge and Data Engineering, 26, 97-107. https://doi.org/10.1109/TKDE.2013.109
Xiao, H., Biggio, B., Brown, G., et al. (2015) Is Feature Selection Secure against Training Data Poisoning? Proceedings of the 32nd International Conference on Machine Learning, Lille, 1689-1698.
Fuchs, G., Stange, H., Hecker, D., et al. (2015) Constructing Semantic Interpretation of Routine and Anomalous Mobility Behaviors from Big Data. SIGSPATIAL Special, 7, 27-34. https://doi.org/10.1145/2782759.2782765
Miller, B.A., Beard, M.S. and Bliss, N.T. (2011) Eigen space Analysis for Threat Detection in Social Networks. Proceedings of the 14th International Conference on Information Fusion, Chicago, 5-8 July 2011, 1-7.
Hota, S. (2018) Big Data Analysis on YouTube Using Hadoop And Mapreduce. International Journal of Computer Engineering in Research Trends, 5, 98-104.
Remya, G. and Mohan, A. (2015) Distributed Computing Based Methods for Anomaly Analysis in Large Datasets. International Journal of Advanced Research in Computer and Communication Engineering, 4, 427-430.
Breier, J. and Branišová, J. (2015) Anomaly Detection from Log Files Using Data Mining Techniques. Lecture Notes in Electrical Engineering, 339, 449-457. https://www.researchgate.net/publication/282923954 https://doi.org/10.1007/978-3-662-46578-3_53
Restuccia, F., Salvatore d’oro, Kanhere, S.S. and Melodia, T. (2018) Blockchain for the Internet of Things: Present and Future. IEEE Internet of Things Journal, 1, 1-8.
Christidis, K. and Devetsiokiotis, M. (2016) Blockchains and Smart Contracts for the Internet of Things. IEEE Access, 4, 2292-2303. https://doi.org/10.1109/ACCESS.2016.2566339
Yaga, D., Mell, P., Roby, N. and Scarfone, K. (2018) Blockchain Technology Overview. National Institute of Standards and Technology, U.S. Department of Commerce, 1-27. https://doi.org/10.6028/NIST.IR.8202
Uchibeke, U.U., Schneider, K.A., Kassani, S.H. and Deters, R. (2018) Blockchain Access Control Ecosystem for Big Data Security. 2018 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData), Halifax, 30 July-3 August 2018, 1373-1378.
Ramos, L.F.M. and Silva, J.M.C. (2019) Privacy and Data Protection Concerns Regarding the Use of Blockchains in Smart Cities. ICEGOV2019, Melbourne, 3-5 April 2019, 342-347.
Maull, R., Godsiff, P., Mulligan, C., Brown, A. and Kewell, B. (2017) Distributed Ledger Technology: Applications and Implications. Strategic Change, 26, No. 5. https://doi.org/10.1002/jsc.2148
Tasca, P. and Tessone, C.J. (2017) Taxonomy of Blockchain Technologies. Principles of Identification and Classification. https://ssrn.com/abstract=2977811
CNIL (2018) Solutions for a Responsible Use of the Blockchain in the Context of Personal Data. Technical Report. Commission Nationale Informatique & Libertés. https://www.cnil.fr/sites/default/files/atoms/files/blockchain.pdf