Big Data: The Emerging Strategy in Data Management

Following is a little article I wrote up back in 2018 for my college magazine. I was 16/17 and stupid, today kids are busy raising millions for startup but I was just figuring out coding, ego-fighting with friends and trying to get a girl out of pure FOMO and status back in college.
So yeah this blog has a lot of grammar mistakes, but I intend to keep it as is because it would be fun to read this later and hey in todays world where everything is heavily moderated using AI tools, its good to have some raw unedited content too. hehe.

Big Data is an emerging strategy in data management. Big Data is collection of large sets of data. A lot of data is being collected by many devises used by us. This data is further used for improvements in different fields. There is a lot of scope for big data. Many companies are investing a lot of money in this evolving technology. Big data helps in growing of certain industries. Big Data is analyzing the collected data and creating better outputs. Big Data has been very useful in e-governance, media, education, banking sector and science. Big data is used in e-governance to know the people better and find solutions to their problems. YouTube and Netflix use big data to understand someone and provide the right content. With the use of big data in education we could analyze a student’s performance over many academic years. Financial condition and fraud transactions can be determined and we can understand the client much better with use of big data in banking sectors. Accurate discoveries are being done with the help of big data in the field of science. Big data is an evolving technology and there is a lot of job opportunities in this sector. With big data a lot of problems can be solved.

Full paper

Introduction

Big Data is an emerging strategy in data management. Big Data is all about user activity. In big data lots of data is collected, analyzed and used it in some efficient way. Big data is further formatted into two parts i.e. Structured and Unstructured. Structured data has pre-defined models. It mostly contains of relational databases, CRM system data, XML files etc. Unstructured data doesn’t have any predefined models. It contains of word documents, spreadsheets, audio files, movies, etc. which can be stored and analyzed to discover certain patterns (Smith, 2016)[1]. With these patterns we can learn the environment of that data. This data is collected from various devises which has become a part of this generation. It had estimated that by 2020 a person would be generating two megabytes per second. Big data holds the future. There are so many advancements in the lifestyle of people with big data.

Scope of big data

Nearly 32 million messages, 3 million videos and 50 billion photos were shared every minute over Facebook with one billion people using it in a single day in august 2015 (Smith, 2016) [2]. By the end of 2020, there will be 55 billion smart connected devices in the world to collect analyze, and share data for various activities. The Hadoop market arena is expected to grow at an annual growth rate of 585 surpassing $1billion by 2020 (Smith, 2016) [3]

Use of Big Data in E-Governance

Even the Government uses big data to analyze problems faced by many people and find a perfect solution for it. In the field of e-governance a lot of data is created per hour such as, births and deaths of a country, details of each person with Aadhar, PAN, license and data from the web expressing certain problems faced by people and suggestions and complaints over a certain issue. With this data many upcoming problems can be solved. Weather conditions are recorded and using certain climate patterns the weather of the next day can be determined. Road traffic details are recorded, analyzed and processed. This processed big data is used by different mapping applications (Pani, 2008; Kamarck, 2001; Martin, 2014).

Use of big data in media

A lot of user data is collected by different social media like Facebook, Skype, Twitter, WhatsApp, Instagram, Google+, Myspace, Viber, LinkedIn and Pinterest. Exabyte’s of data is collected which is analyzed to understand the nature, behavior or the way of usage. This data is also used to give a better search accuracy. There are more than billions of videos on YouTube. Even different News sites and applications use these big data to know your interest and provide you with the preferred content.

Use of big data in education

Big data is used in educational fields to analyze and score a student’s performance. With the performance results we suggest some ideas or ways to increase the performance of a student. With this technology student’s problem can be solved in a better way.

Use of big data in banking

In the banking sector big data has been very useful. With its help managers can understand their clients better. They can interact in a way the client likes. This is better customer services. Trillions of transactions are done in a year as it is rightly said ‘No man can live without money’. And in this greed evolve the hackers and frauds those who want stuff for free. Here with the help of big data we can find the fraud transactions, failed transactions and hackers who are exploiting the internet.

Use of big data in the field of science

Here big data is used by AI (artificial intelligence) like Siri, Cortana, Google Now and Alexa. Big data is used by scientists to get appropriate results during their experiments. This huge chunks of data which is compressed and stored somewhere, in different ways of compression are used, most of them where studied from the big data itself. Different online multiplayer games create a lot of data which is again used to study the strategies, tricks, and pattern of the opponent. Now many technologies like wearables like smart watches and smart bands are used to monitor our health. These wearable technology creates a lot of data per day from our footsteps to our heartbeats, calories burned, fats and a lot more. Big data is also used in agriculture to analyze crops yield every year.

Careers in big data

In addition to programming languages like Java, C, Ruby, Python and Scala, some skills can help us to get into big data. They are Apache Hadoop, Cassandra, Spark, Pig, Map Reduce, Microsoft Azure, Oracle, NoSQL, MySQL, MongoDB, Microsoft SQL server, Machine Learning, Data Mining, Statistical Analysis, Data visualization, Warehousing, Operation Research, Semantic Web, Data Science, Artificial Intelligence (Smith, 2016)[4].

Big data can also be used in security segment. The fact is that nearly 15,000 CCTV cameras were installed during the visit of ex-US president Barak Obama instead of employing 15,000 personnel to monitor. The technology captures the unstructured data of video streams and run pattern matching algorithm to identify potential problems based on certain pre-defined parameters (Smith, 2016)[5].

Conclusion

Big data is a fast growing industry in this digital era. More than hundreds of exabytes are produced every year. It is also a very important technology for all types of fields.

References

1. Smith, Robert Sovereign (Ed.), Digit FastTrack, Vol. 11, Issue 04, 9.9 Mediaworx, 2016, p. 7
2. Smith, Robert Sovereign (Ed.), Digit FastTrack, Vol. 11, Issue 04, 9.9 Mediaworx, 2016, p.17
3. Smith, Robert Sovereign (Ed.), Digit FastTrack, Vol. 11, Issue 04, 9.9 Mediaworx, 2016, p.20
4. Smith, Robert Sovereign (Ed.), Digit FastTrack, Vol. 11, Issue 04, 9.9 Mediaworx, 2016, p.89
5. Smith, Robert Sovereign (Ed.), Digit FastTrack, Vol. 11, Issue 04, 9.9 Mediaworx, 2016, p.90
6. Pani Niranjan and Mishra S. Santap, ‘E-Governance’, Himalaya Publishing House, Global Media, 2008. Retrieved from inflibnet-ebooks on September 14, 2017 at10:08:43.
7. Kamarck, Elaine C., and Nye, Joseph S., eds. Governance.com : Democracy in the Information Age. Washington: Brookings Institution Press. 2001. Accessed on September 14, 2017 from inflibnet-ebooks at 10:45:09.
8. Martin J. Eppler, Information Quality in Electronic Government: Toward the Systematic Management of High-Quality Information in Electronic Government-to Citizen Relationships in Mayer-Schanberger, Viktor, and David Lazer (eds.). Governance and Information Technology: From Electronic Government to Information Government, MIT Press, 2014. Retrieved from http://ebookcentral.proquest.com/lib/inflibnet-ebooks/detail.action?docID=3338694. on September 14, 2017 at10:33:5.