If you’re relatively new to Big Data, you might find this snapshot of the last 20 years of big data history helpful. Hopefully, you can build your understanding and figure out where you reside in the journey of Big Data development, adoption and optimization.
Gentlemen Start Your Spreadsheets (1995) The world wide web explodes and business intelligence data began piling up – in Excel documents.
Data Storage and BI (1996) The influx of huge quantities of information brought about a new challenge. Digital storage quickly became more cost-effective for storing data than paper – and BI platforms began to emerge.
Houston, We have A Problem (1997) The term Big Data was used for the first time when researchers at NASA wrote an article identifying that the rise of data was becoming an issue for current computer systems.
Yes, Big Data was first considered a problem.
Ask Nicely (1998) By the point that enough data was able to be stored, IT departments were responsible for 80% of the business intelligence access. At this time, "predictive analysis" forecasting was starting to also change how organizations do business.
A Lotta Data (2000) The quantification of new information creation began being studied on an annual bases. In 2000, 1.5 exabytes of unique information is documented per year.
Control Freaks (2001)Papers were being written about controlling the big data problem. To describe it, they had to define it and they did so with the three V’s....data volume, velocity and variety as coined by Doug Laney, now a Gartner analyst. Work begins on capabilities like language processing, predictive modeling and data-gathering.
It Was A BIG Year (2003) The amount of digital information created by computers and other data systems in 2003 blows past the amount of information created in all of human (or big data) history prior to 2003.
Problem Child Becomes Prodigy (2005) Web 2.0 companies are assessed by their database management abilities. The issue becomes a given or core competency. Big Data begins to emerge as an opportunity.Apache Hadoop, soon to become a foundation of government big data efforts, is created.
Not Your Dad’s Oracle (2005) Alternatives (to Oracle) that are more focused on the usability of the end-user emerge. Big Data solutions that work the way people work collaboratively, on the fly and in real-time are the gold standard.
Taming the Big Data Explosion (2006) A solution to handle the explosion of big data from the web is more prevalent...Hadoop. Free to download, use, enhance and improve...like Java in the 80s. Hadoop is a 100% open source way of storing and processing data – that enables distributed parallel processing of huge amounts of data.
Can I Interest You In A Flood? (2008) The BIG part of big data starts to show itself. The number of devices connected to the Internet exceeds the world’s population.
Real questions: In 2015, will the internet be 500x larger than it is now? Will IP traffic reach one zettabyte?
How Big is Big? (2008) The term “Big Data” begins catching on among techies. Wired magazine mentions the “data deluge.” “Petabyte” age is coined...too technical to be understood...it doesn’t matter...as it is soon replaced by bigger measures like exabytes, zettabytes and yottabytes.
No They Didn’t (2008) Yes, they said it. Big Data computing is perhaps the biggest innovation in computing in the last decade. We have only begun to see its potential.
Business Intelligence became a top priority for CIO's in 2009.
BI this....BI that (2010) Recognition and use of Business Intelligence (BI) becomes common as 35% of the rank and file enterprises began to readily employ “pervasive” business intelligence. Look at best-in-class organizations, and you find an adoption of 67% – and it’s moving to self-service.
Moving On Up (2011) Business Intelligence matures with trends emerging in cloud computing, data visualization, predictive analytics and big data is on the horizon.
Big Government and Big Data (2012) The Obama administration announces the Big Data Research and Development Initiative – 84 separate programs. The National Science Foundation publishes “Core Techniques and Technologies for Advancing Big Data Science & Engineering.”
Even Better Than a Rewards Program (2013) (Big) Data as “a real business asset used to gain competitive advantage in the market” becomes accepted. The widespread drive to understand and make use of big data – to remain relevant – is well underway.
Want to leverage big data analytics for better and more efficient business? Learn more about Teradata’s big data solutions.