Skip to main content icon/video/no-internet

Our current age is often referred to as the era of big data. While the term has become increasingly popular in the last 10 years, the concept is now used in a wide variety of ways, often without referring to an acknowledged technical definition of the concept. In fact, an agreed-upon and technical definition can be argued not to exist, and the term big data is mainly used to refer to broad and general tendencies related to a rapid increase in the data collected in various domains and the accompanying need to develop and employ new methods of analysis in order to make sense of such data. These methods of analysis connect big data intimately to data mining, artificial intelligence (AI), and machine learning.

Big data has become a ubiquitous phenomenon, and it is applied to domains such as research, business intelligence, social networks, health care, crime prevention, and anti-terrorism. Data is routinely described as the “new oil,” and in parallel with the historical discovery of other precious resources, the quest to drill, mine, and refine it is both intense and characterized by competition, rapid development, and private sector innovation. Big data carries a number of actual and potential benefits, but it is also related to a number of ethical challenges. Many are related to the nature of the data employed, some relate to a purported blind and dangerous faith in quantitative data and algorithms as the solution to and source of insight in all aspects of human lives, and some are mainly related to the use of algorithmic decision-making in general. The next section of this entry presents an expanded definition of big data, followed by an exploration of the philosophical basis of the concept and its roots in the quantitative and empiricist approach to knowledge. Before concluding, the entry offers a discussion of the ethical considerations surrounding the growing applications of big data.

Definition

Big data refers to a development toward generating and gathering increasing amounts of data at increasing speeds, while the data is structured in heterogenous data sets. The data in question can, for example, be social and personal, or related to industrial processes or scientific measurements, and several sources and types of data are often connected in large data sets.

Although data is of course a key component of big data, the tools and techniques used to store, manage, and analyze the data are also integral parts of the concept. The problem with the data sets handled in big data is that traditional methods of storage and analysis are insufficient. Distributed storage systems and cloud computing are used for storing and managing the data. Data mining and machine-learning-based AI have become terms intimately associated with the analysis of the large data sets. The entire chain of generating, gathering, storing, and analyzing data is included as part of what is referred to as big data.

Data in isolation—gathered and stored—has limited potential for positive or negative consequences. It is through the quest to derive value from the data that, for example, benefits in business intelligence and concerns over discriminatory practices arise. The term big data is now used by both data and computer scientists, social scientists, and the general public, and the latter two groups often refer to a general and nonspecified concept without referring to particular forms of database management or specific machine learning techniques.

...

  • Loading...
locked icon

Sign in to access this content

Get a 30 day FREE TRIAL

  • Watch videos from a variety of sources bringing classroom topics to life
  • Read modern, diverse business cases
  • Explore hundreds of books and reference titles

Sage Recommends

We found other relevant content for you on other Sage platforms.

Loading