Intel's Investment In FPGAs Could Pay Dividends In Microsoft Data Centers And Mark The Advent Of AI Accelerators
In June of last year, Intel announced a $16.7B acquisition of chip designer Altera, a Silicon Valley bellwether known for producing FPGAs (Field Programmable Gate Arrays), PLDs (Programmable Logic Devices), Embedded Processors, and ASICs (Application Specific Integrated Circuits). At the time of the announcement, Intel CEO Bryan Krzanich said, “Intel’s growth strategy is to expand our core assets into profitable, complementary market segments. With this acquisition, we will harness the power of Moore’s Law to make the next generation of solutions not just better, but able to do more.” That’s a nebulous way of saying Intel had plans to leverage Altera technology to boost its own profits, which is typically the point of acquisitions such as this. How Altera’s technology would be used, however, wasn’t fully explained at the time, but it is becoming more clear by the day.
For the past few years, Project Catapult has been evolving within Microsoft. At first, FPGAs were used to accelerate Bing’s Indexserve engine. A number of servers – over 1600 – were initially outfitted with FPGAs that were connected via a secondary network. The FPGAs were programmed to accelerate specific search-related algorithms, and the end result was in improvement in latency and a 50% reduction in the number of servers required to process workloads. Subsequently, Microsoft decided to put Project Catapult into production. A v2 architecture that enabled configurable clouds was eventually laid out and last year Microsoft ramped-up to large-scale production in
We’re speculating a bit, but with Intel putting FPGAs on Xeon processors, it should be able to reduce latency even further, since off-chip communications will be minimized due to the coherently attached in-socket FPGA adjacent to the central host processor. Density should be increased as well, and there may be power and efficiency benefits too. Should Microsoft’s Configurable Cloud architecture be adopted by others, and Intel’s future Xeons address the needs of Project Catapult, it could mean very good things for Intel in the lucrative, high-margin enterprise server platform space.