Tuesday, September 27, 2016
Search
  
Submit your own News for
inclusion in our Site.
Click here...
Breaking News
USB-IF Announces USB Audio Over USB Type-C Specifications
Roxio Creator NXT 5 Supports Disc Burning With Multi-Camera Video Editing
ARM Unveiled New On-chip Interconnect Technology
AMD Brings The Power Of Polaris To Embedded With New Radeon E9260 and E9550 GPUs
Toshiba Introduces the Value-oriented OCZ TL100 SATA SSD Series
Xiaomi Mi 5S Plus Guns for Apple
Samsung Says Global Replacement Program for Galaxy Note7 Has Made Progress
NXP Says New ARM Cortex-A7 Processor Is The Industry's Lowest Power
Active Discussions
Which of these DVD media are the best, most durable?
How to back up a PS2 DL game
Copy a protected DVD?
roxio issues with xp pro
Help make DVDInfoPro better with dvdinfomantis!!!
menu making
Optiarc AD-7260S review
cdrw trouble
 Home > News > General Computing > Researc...
Last 7 Days News : SU MO TU WE TH FR SA All News

Friday, July 22, 2011
Researchers Demonstrate Breakthrough Storage Performance for Big Data Applications


Researchers from IBM today demonstrated the future of large-scale storage systems by successfully scanning 10 billion files on a single system in just 43 minutes, shattering the previous record of one billion files in three hours by a factor of 37.

Growing at unprecedented scales, this advance unifies data environments on a single platform, instead of being distributed across several systems that must be separately managed. It also reduces and simplifies data management tasks, allowing more information to be stored in the same technology, rather than continuing to buy more and more storage.

In 1998, IBM Researchers unveiled a highly scalable, clustered parallel file system called General Parallel File System (GPFS), which was furthered tuned to make this breakthrough possible. GPFS represents an advance of scaling for storage performance and capacity, while keeping management costs flat. This innovation could help organizations cope with the exploding growth of data, transactions and digitally-aware sensors and other devices that comprise Smarter Planet systems. It is suited for applications requiring high-speed access to large volumes of data such as data mining to determine customer buying behaviors across massive data sets, seismic data processing, risk management and financial analysis, weather modeling and scientific research.

Today's breakthrough was achieved using GPFS running on a cluster of 10 eight core systems and solid state storage, taking 43 minutes to perform this selection. The GPFS management rules engine provides the comprehensive capabilities to service any data management task.

GPFS's algorithm makes possible the full use of all processor cores on all of these machines in all phases of the task (data read, sorting and rules evaluation). GPFS exploits the solid state storage appliances with only 6.8 terabytes of capacity for excellent random performance and high data transfer rates for containing the metadata storage. The appliances sustainably perform hundreds of millions of data input-output operations, while GPFS continuously identifies, selects and sorts the right set of files among the 10 billion on the system.

"Today's demonstration of GPFS scalability will pave the way for new products that address the challenges of a rapidly growing, multi-zettabyte world," said Doug Balog, vice president, storage platforms, IBM. "This has the potential to enable much larger data environments to be unified on a single platform and dramatically reduce and simplify data management tasks such as data placement, aging, backup and migration of individual files."

The previous record was also set by IBM researchers at the Supercomputing 2007 conference in Reno, NV, where they demonstrated the ability to scan one billion files in three hours.


Previous
Next
New Sony Cyber-shot Cameras offer Up To 10x Clear Image Zoom in Maximum Resolution        All News        Nintendo Video Download Brings 3D Content To Nintento 3DS
Google Buys Pittsburgh Pattern Recognition     General Computing News      Wolfram Launches Computable Document Format

Get RSS feed Easy Print E-Mail this Message

Related News
New IBM Linux Servers Feature POWER8 Chips And NVIDIA NVLink Interconnect Technology
Scientists Imitate the Functionality of Neurons with a Phase-Change Device
IBM's Strategy Seems To Pay Off, Latest Results Show
AT&T and IBM Team to Bring Internet of Things Capabilities to Developers on IBM Cloud
IBM Scientists Discover New Recycling Process to Convert Old Smartphones and CDs into Non-Toxic Plastics
IBM Watson Will Be Trained To Tackle Cybercrime
IBM and SK Holdings C&C Alliance Brings Watson To South Korea
IBM Makes Quantum Computing Available on IBM Cloud
OpenPOWER Foundation Reveals New Servers
IBM, VMWare, To Accelerate Enterprise Hybrid Cloud Adoption
IBM To Buy Truven Health Analytics for $2.6 Billion
Western Digital Buys Storage And Memory Patents From IBM

Most Popular News
 
Home | News | All News | Reviews | Articles | Guides | Download | Expert Area | Forum | Site Info
Site best viewed at 1024x768+ - CDRINFO.COM 1998-2016 - All rights reserved -
Privacy policy - Contact Us .