The growth in data volumes

Success with bringing fact-based decision-making to the masses depends
on many factors, including access to, potentially, all the data in
the organisation in near-real-time and the amount of data in commercial
organisations (as well as in government departments) is increasing
rapidly. John Bernard, Product Line Manager for DataRush, has likened
data collection to a tsunami: “it’s happening so fast that both public
and private sector organisations simply aren’t prepared to deal with
the wave”.

In practice, of course, most organisations will only use a fraction of this
potential data resource, at least for now; and near enough real-time
may involve latencies of minutes or even hours or days. Nevertheless,
it is important that these compromises are driven by business requirements,
not the limitations of technology.