Unlike traditional batch-based data flows, where data is loaded in sets on a regular basis (i.e. hourly, daily or monthly), real-time or streaming data flows are often more time-sensitive to analyze, of larger volume and may or may not be of long-term value to persist or store within a company’s data landscape after processing.
WhereScape automation with Streaming helps IT teams address the added complexity of managing a hybrid of streaming real-time and traditional batch-based data as they design, develop, deploy and operate their data infrastructure, speeding up data delivery and providing new analytical opportunities.
“Being able to strengthen our organization’s capabilities to leverage real-time data will enable us to better serve our customers by providing streaming operational measures against historical performance data and key performance indicators, improving transit service in real-time,” said Gadi Glogowski, product line manager at Clever Devices. “WhereScape automation with Streaming will help us to automate the management of real-time dataflows, reducing time to market, R&D investment, our customers’ total cost of ownership and better matching the speed of our business.”
Real-time data flows, or “streaming” data sources, can come from many areas in an organization’s data landscape including from in-field units sharing sensor-based data, from social media feeds to support sentiment analysis, and from internal systems feeds. Utilizing industry-leading dataflow management technology developed by StreamSets and the proven efficiencies of WhereScape automation solutions WhereScape RED or WhereScape Data Vault Express, WhereScape automation with Streaming minimizes the learning curve for IT teams working with these new data sources and ensures best practice integration of streaming data.
“With its unique approach to automation, WhereScape is making it far easier for established organizations to leverage both real-time streaming data and traditional batch-based data at scale,” said Jobi George, VP of business development at StreamSets. “StreamSets’ proven streaming dataflow management technology is used by hundreds of companies worldwide so we’re excited to support the delivery of this solution and make streaming data possible for everyone.”
"We, at 451 Research, are seeing increasing interest in stream-based processing from mainstream companies, but many companies are lacking the internal resources and skillsets to know how to pursue the integration of these new technologies effectively and efficiently," explained Matt Aslett, research director at 451 Research. "Streaming data automation can fill that gap for organizations, ensuring best practice integration, and enabling them to make the most of the opportunity real-time data provides within their existing data infrastructures."
“Businesses understand the significant potential that being able to take advantage of real-time data offers to their organizations. However, IT teams – already stretched for time – now face the added challenge of understanding and incorporating these new data sources and streaming-related technologies into their analytics environments,” said Mark Budzinski, CEO at WhereScape. “WhereScape automation can ease the learning curve and process of integrating this new data paradigm.”
