While most computer-chip makers over the past decades have touted the benefits of an ever-shrinking product, a well-funded Silicon Valley company has built what it says is the largest and fastest-ever computer chip, dedicated to AI. <\/p>\n
When the five friends who formed Cerebras Systems Inc. decided to start a company, they wanted to build a new computer to address a big problem. They had previously worked on compact, low-power servers for data centers at SeaMicro, later acquired by Advanced Micro Devices Also read:<\/strong> As AI matures, Nvidia won\u2019t be the only pick-and-shovel company to thrive, BofA analysts say<\/p>\n \u201cWe built the largest part ever made, the fastest ever made,\u201d Cerebras co-founder and Chief Executive Andrew Feldman said. \u201cWe made a set of trade-offs. It is 100% for AI.\u201d <\/p>\n After starting up in downtown Los Altos, Calif., Cerebras is now in Sunnyvale, Calif., just minutes away from data-center partner Colovore in nearby Santa Clara, Calif. It now has more than five times the office space, along with a loading dock that a hardware company needs. <\/p>\n Cerebras has developed what it calls a wafer-scale engine with 2.6 trillion transistors and 850,000 cores, all on a silicon wafer about 8.5 inches wide. The wafers have been shipping since 2020, and are part of a total system designed specifically to process queries and training for artificial intelligence. And they are making inroads as an alternative to Nvidia in the high-performance computing market for AI systems.<\/p>\n \u201cNo one has built a chip this big in the history of compute,\u201d Feldman told MarketWatch, as he held up the dinner-plate-sized wafer. \u201cThis replaces the CPU and the GPU. This is the compute engine. This replaces everything made by Nvdia and Intel and AMD.\u201d Last year, Cerebras\u2019 invention was inducted into Silicon Valley\u2019s Computer History Museum, as the largest computer chip in the world.<\/p>\n Cerebras is still private, but with $720 million in venture funding, it is one of the better funded hardware\/semiconductor startups. Several analysts believe it will be one of a handful of AI chip startups to succeed. In its last Series F funding round in 2021, the company said it had a valuation of $4 billion.<\/p>\n \u201cThey have come up with a very unique architecture,\u201d said Jim McGregor, an analyst with Tirias Research. \u201cBecause of the way their system is architected, they can handle enormous amounts of data. It\u2019s not the best solution for every application, because it is obviously not cheap,. But it is an incredible solution for high-end data sets.\u201d McGregor, quoting Nvidia CEO Jensen Huang, said there will be both multi-purpose data centers running AI, and specialized AI factories. \u201cI would put [Cerebras] in that second category of AI factory,\u201d he said.<\/p>\n Cerebras\u2019 systems are designed for dedicated AI workloads, because AI is so incredibly processing-intensive, with its system designed to keep all the processing on the same giant chip. Feldman gave a simple analogy of watching a football game at home with the beer already on hand, compared with having to go to a store to buy some during the game. \u201cAll the communication is here, you are doing very small, short movements,\u201d he said. Just as you don\u2019t need to get into your car to buy more beer in the football game scenario, \u201cyou don\u2019t have to go off-chip, you don\u2019t have to wait for all the elements to be in place.\u201d<\/p>\n Feldman declined to say what the company\u2019s revenue is so far, but said it has doubled this year. This summer, Cerebras got a big boost, with a major contract valued initially at $100 million for the first of nine AI supercomputers to G42, a tech conglomerate in the United Arab Emirates. The first of those systems is running live in the Colovore data center in Santa Clara, Calif., which has a white-glove service for customers behind an unassuming office entrance on a back street lined with RV campers, located a block from a Silicon Valley Power station. The proximity to the power station has now become an important feature for data centers.<\/p>\n \u201cThis is the cloud,\u201d Feldman said, standing amid the loud, humming racks and water-cooled servers in a vast windowless room at Colovore. \u201cIt\u2019s anything but serene.\u201d <\/p>\n <\/p>\n Before the recent deal with G42, Cerebras\u2019 customer list was already an impressive collection of high-performance computing customers, including pharmaceutical companies GlaxoSmithKline \u201cIf they can keep their trajectory going, they could be one of the companies that survives,\u201d said Pat Moorhead, founder and chief analyst at Moor Insights and Strategy. \u201cNinety out of 100 companies will go out of business. But for the sole fact that they are driving some pretty impressive revenue, they can establish a niche. They have an architectural advantage.\u201d<\/p>\n As large corporations and small businesses alike rush to adopt AI to save on labor costs with (hopefully) better chatbots, conduct faster research or help do mundane tasks, many have been ramping up spending on their data centers to add the extra computing power that\u2019s needed. Nvidia has been one of the biggest beneficiaries of that trend, with its graphics processing units (GPUs) in huge demand. Analysts estimate Nvidia currently has between 80% and 90% of the market for AI-related chips.<\/p>\n \u201cI like our odds,\u201d said Eric Vishria, a general partner at Benchmark Capital, one of the earliest investors in Cerebras, when asked about Cerebras\u2019 potential to survive and succeed in an environment where some AI chip startups are said to be struggling. \u201cI am not an investor in any of the others. I have no idea how well they are doing, in terms of revenue and actual customer traction,\u201d he said. \u201cCerebras is well ahead of the bunch as far as I understand it. It\u2019s not easy, and one of the challenges has been that AI is moving and changing so fast.\u201d <\/p>\n Feldman said that, of course, the next milestone for the company would be an initial public offering, but he declined to give any kind of timeframe. <\/p>\n \u201cWe have raised a huge amount of money and our investors need a return,\u201d he said when asked if the company plans to go public. \u201cWe don\u2019t see that as a goal but as a by-product of a successful company. You build a company on enduring technology that changes an industry. That is why you get up every morning and start companies, to build cool things to move the industry.\u201d<\/p>\n<\/p><\/div>\n
\n AMD,
\n
\n Cerebras was officially formed in 2016, six years before the debut of ChatGPT 3, but the founders decided back then to focus on the tough computing problem of AI, where it now competes with the industry leader, Nvidia Corp.
\n NVDA,
\n
\n as well as other chip giants and startups.<\/p>\n
\n GSK,
\n
\n for making better predictions in drug discovery, and AstraZeneca
\n AZN,
\n
\n for running queries on hundreds of thousands of abstracts and research papers. National laboratories including Argonne National Labs, Lawrence Livermore National Laboratory, the Pittsburgh Supercomputing Center and several others, are using the systems to accelerate research, simulate workloads and develop and test new research ideas.<\/p>\n