Sunday, November 23, 2014
Search
  
Submit your own News for
inclusion in our Site.
Click here...
Breaking News
ASTC Says 100 TB HDDs Coming in 2025
Alienware Alpha PC Gaming Console Now Shipping
Samsung Files ITC Complaint Against Nvidia
Europe To Ask Google Unlink Its Commercial And Search Services
Streaming TV Service Aereo Files for Bankruptcy
Square Launches Cash Register Service
Call of Duty: Advanced Warfare is the Biggest Entertainment Launch of 2014
Intel-Micron 3D NAND To Have 32 Layers, 256Gb Per Die
Active Discussions
cdrw trouble
CDR for car Sat Nav
DVD/DL for Optiarc 7191S at 8X
Copied dvd's say blank in computer only
Made video, won't play back easily
New Features In Firefox 33
updated tests for dvd and cd burners
How to generate lots of different CDs quickly
 Home > News > General Computing > Fujitsu...
Last 7 Days News : SU MO TU WE TH FR SA All News

Monday, April 01, 2013
Fujitsu Develops High-Speed Processing Technology For Big Data


Fujitsu Laboratories has tackled the problem of conducting real-time analysis of huge volumes of data with the develoopment of a high-speed data processing technology.

Social media is generating enormous volumes of data, and real-world time-series data from sensors and locational information is continuously increasing. More than just data storage, it is important that big data undergo a variety of analyses to quickly extract any valuable information. A typical example of big data use is recommendation analysis that estimates a person's next action based on social-media data or purchasing history. The process of tracing the connection between data elements contained in the flood of incoming messages, however, is hampered by the fact that the volume of data results and intermediate data of ongoing analysis is too large to be stored in memory.

To handle a volume of data that cannot be contained in memory, a hard drive needs to be used as a storage device. The best way to make the most of the hard drive's performance is to continuously record large units of data, but if the unit is too big, performance declines and processing times lengthen. Conversely, when recording small units of data, there is an increase in disk access as data arrives with a higher frequency which diminishes performance. The ideal read/write unit is dictated by the frequency with which data arrives, so different conditions will result in different levels of efficiency and performance.

Fujitsu claims that its new technology increases overall system performance by creating a close link between the data-analysis software running on the server and the data-management software that handles the data-storage process, then varying the volume of data being processed at any one time in response to the frequency of processing requests from the data-analysis side. Even when there is a sharp increase in people accessing the server, high-speed analyses can still be performed.

Here is how it works:

When reading data, the data-management software reads not only the data requested by the data-analysis side but also other data that is laid out nearby on the hard drive. The data-analysis software then selects and uses the necessary parts of this data. Likewise, when writing data, the data-analysis software specifies data that is not necessary and passes it to the data-management side, which then takes the bulk of data it receives and deploys it on the disk as near as the physical layout makes possible.

Performing read/write operations in larger bulks reduces the number of disk accesses and increases the system's overall throughput.



To process as much as possible at one time, the data-analysis software reads more data than is needed, then the needed data is selected for processing. The ideal size for a bulk read will vary depending on conditions, so the system monitors the volume of arriving data and the pace of analysis to decide the size for bulk read/writes, making automatic adjustments for the best performance.

Fujitsu says that the new technology results in throughput five times faster than previously possible.

This technology can be used to distribute information to multiple users on a moving train based on the train's location, such as updated information on nearby sites or events of interest or trendy restaurants. In e-commerce, were a website to experience a sharp increase in the number of users accessing it before Christmas, it could still remain highly responsive. Performing big data analysis in real-time opens up new potential applications and business uses.

Fujitsu plans to bring the technology it into commercial use in fiscal 2014.


Previous
Next
Nvidia Adds New GPUs to GeForce 700M Line-up        All News        Sony Unveils Animalia Line of Tech Products Designed For Pets
NAND Flash Sees Growth in Final Quarter Last Year     General Computing News      Japan Display's Subsidiaries Merged

Get RSS feed Easy Print E-Mail this Message

Related News
Fujitsu Develops LED Lighting Technology that "Shines" Data on Objects
Fujitsu Develops Design Technology for Allocating LTE-Advanced Base Stations
Fujitsu Launches Petabyte-scale New Hyper-scale Storage ETERNUS CD10000
Fujitsu Boosts Lineup of Smartphones and Tablets for the Enterprise
Fujitsu Develops Fast Recovery Process for Multiple Disk Failures
Fujitsu Relases New Extreme Series SSDs
Fujitsu, NTT, and NEC To Commercialize 400Gbps-class Optical Transmission Technology
Fujitsu, Panasonic Announce New Direction for Their Semiconductor Businesses
Fujitsu To Phase Out Chip Production
Fujitsu Technology Reduces Network Switches in Cluster Supercomputers
New Fujitsu ARROWS Tab Q335/K Tablet Coming In October
Fujitsu Buys Shares of Panasonic Information Technology Solutions

Most Popular News
 
Home | News | All News | Reviews | Articles | Guides | Download | Expert Area | Forum | Site Info
Site best viewed at 1024x768+ - CDRINFO.COM 1998-2014 - All rights reserved -
Privacy policy - Contact Us .