THE SCOOP Customers have asked to run OpenAI models on non-Microsoft cloud services or on their own local servers, but OpenAI has no immediate plans to offer such options, according to people familiar with the matter. That means there’s one area where rivals of the ChatGPT creator have an edge: flexibility. To use OpenAI’s technology, paying customers have two choices: They can go directly through OpenAI or through investment partner Microsoft, which has inked a deal to be the exclusive cloud service for OpenAI. Microsoft will not allow OpenAI’s models to be available on other cloud providers, according to a person briefed on the matter. Companies that exclusively use rivals, such as Amazon Web Services, Google Cloud or Oracle, can’t be OpenAI customers. But Microsoft would allow OpenAI models to be offered “on premises” in which customers build their own servers. Creating such solutions would pose some challenges, particularly around OpenAI’s intellectual property. But it is technically feasible, this person said. Spokespeople from OpenAI and Microsoft declined to comment. Right now, every time customers access OpenAI models, they are sending data to Sam Altman’s company or Microsoft. They are also paying for the cloud computing costs for each query. For companies with sensitive data or that can’t send data to the cloud because of regulatory reasons, OpenAI isn’t an option. And companies that would rather build their own servers instead of paying cloud computing costs might opt for alternatives. Microsoft does offer a “hybrid cloud” option to customers, where companies can take advantage of the cloud while storing sensitive data on local servers. But even with that solution, companies would still be required to send some data to Microsoft in order to utilize OpenAI models. Reuters/Issei KatoREED’S VIEW The AI landscape is increasingly competitive. Claude 2, a competing model developed by Anthropic, a company founded by former OpenAI employees, is available on multiple cloud providers, including AWS, the industry leader. By some measures, Claude 2 is a higher performing model. And rivals are becoming widely available. AWS, Google and Oracle are intent on offering customers a plethora of AI options, both open source and closed source. The ace up OpenAI’s sleeve is that it may be able race ahead of competitors. GPT-4, the most advanced model available to consumers, was released to the public in March, but it was in use over a year ago, a person close to the company said. And GPT-4, this person said, is not the most advanced technology OpenAI has developed. The idea is that future models from OpenAI will leapfrog competitors, thanks in large part to ever-growing datasets that improve accuracy and sophistication, this person said. But even assuming OpenAI can keep improving its models and stay ahead of the competition, there’s still a question of how much better they are. There are a myriad of benchmarks that assess the abilities of these foundational models and rank them — such as how well they do on medical and legal exams. But the real question is whether the average consumer can tell the difference. If they’re all good enough, then businesses will gravitate toward the cheapest and most convenient options and some will go for the most secure or private. OpenAI wouldn’t be the top choice by any of those measures. But if large language models like GPT are about to see an exponential increase in abilities that’s noticeable to consumers, then OpenAI will still be the industry leader, regardless of whether it’s only available on some cloud providers. Exponential improvements are not a given. Some AI researchers believe that in order to make big advances beyond where we are today, a whole new architecture is needed. There’s no guarantee OpenAI will make such a discovery. For the Room for Disagreement and the rest of the story, read here. |