MIT Develops Cheaper Supercomputer Clusters By Nixing Costly RAM In Favor Of Flash
Researchers at MIT have come up with a new network design that exploits cheap, power-efficient flash memory without sacrificing the speed that supercomputing applications enjoy from Random Access Memory (RAM). What's appealing about the development is that flash memory is about ten times less expensive than RAM and consumes about a tenth as much power.
The downside is that flash memory is only about a tenth as fast, though by utilizing MIT's new system, several common big data applications could use flash memory just as efficiently as conventional RAM. Not only that, the researchers presented evidence at the International Symposium on Computer Architecture that if servers executing a distributed computation go to disk for data even just 5 percent of the time, performance takes a hit to where it's comparable with flash memory anyway.
Put into real world terms, the researchers claim that even without their new network design, 40 servers with 10 terabytes of RAM wouldn't chew through a 10.5TB computation any better than 20 servers with 20TB of flash memory, though they would consume a lot more power.
"This is not a replacement for DRAM or anything like that," says Arvind, the Johnson Professor of Computer Science and Engineering at MIT, whose group performed the new work. "But there may be many applications that can take advantage of this new style of architecture. Which companies recognize: Everybody’s experimenting with different aspects of flash. We’re just trying to establish another point in the design space."
What's involved here is moving a little computational power off of the servers and onto the chips that control the flash drives. This allows the system to pre-process some of the data on flash drives before passing back to the servers. As a bonus, the pre-processing algorithms are wired into the chips, so there's no computational overhead on the server.
The researchers tested three different algorithms. One is an image search (trying to find matches for a sample image in a large database). The second is an implementation of Google's PageRank algorithm. And the third is a popular application called Memcached. In all three cases, the network of flash-based servers performed competitively with a network of RAM-based servers.
The downside is that flash memory is only about a tenth as fast, though by utilizing MIT's new system, several common big data applications could use flash memory just as efficiently as conventional RAM. Not only that, the researchers presented evidence at the International Symposium on Computer Architecture that if servers executing a distributed computation go to disk for data even just 5 percent of the time, performance takes a hit to where it's comparable with flash memory anyway.
Put into real world terms, the researchers claim that even without their new network design, 40 servers with 10 terabytes of RAM wouldn't chew through a 10.5TB computation any better than 20 servers with 20TB of flash memory, though they would consume a lot more power.
"This is not a replacement for DRAM or anything like that," says Arvind, the Johnson Professor of Computer Science and Engineering at MIT, whose group performed the new work. "But there may be many applications that can take advantage of this new style of architecture. Which companies recognize: Everybody’s experimenting with different aspects of flash. We’re just trying to establish another point in the design space."
What's involved here is moving a little computational power off of the servers and onto the chips that control the flash drives. This allows the system to pre-process some of the data on flash drives before passing back to the servers. As a bonus, the pre-processing algorithms are wired into the chips, so there's no computational overhead on the server.
The researchers tested three different algorithms. One is an image search (trying to find matches for a sample image in a large database). The second is an implementation of Google's PageRank algorithm. And the third is a popular application called Memcached. In all three cases, the network of flash-based servers performed competitively with a network of RAM-based servers.
