Are you looking for a way to take your use of OpenAI’s large language models to the next level? Then you need to check out OpenAI’s new Foundry platform. Foundry is a platform for running OpenAI models on dedicated server space. It’s designed for companies that want to scale up their use of LLMs and have more control over customizing the data used to train the model. In this blog post, we’ll take a closer look at Foundry and why it’s a great option for businesses that want to get on the cutting edge of generative AI.
What is Foundry?
Foundry is OpenAI’s platform for running its large language models on dedicated server space. It’s designed for customers who have larger workloads and want to be able to monitor the functioning of the OpenAI LLM they use. When you pay for Foundry, you get more flexibility in how you upgrade the model and fine-tune the data used to train it. The package also includes support from OpenAI, with the price varying depending on how long and how many compute units the company wants.
What Does Foundry Offer?
Foundry offers customers a “static allocation” of processing power, referred to as “compute capacity.” This gives customers the same observation and analytics tools as OpenAI within that area, allowing them to monitor the functioning of the OpenAI LLM they use. Paying for Foundry also gives customers more flexibility in how they upgrade the model and fine-tune the data used to train it. The leasing package also includes support from OpenAI, with the price varying depending on how long and how many compute units the company wants.
What Does Foundry Cost?
Foundry isn’t for small firms. The service is for scaling up a corporation’s generative AI capacity to match it’s size. Even the minimal variation on GPT-3.5 costs $78,000 for three months and $264,000 for a year. That’s a lot more potential revenue than the $20 a month for ChatGPT Pro available to consumers. Still, companies might see Foundry as a way to get on the leading edge of generative AI if their pockets are deep enough.
What Does the Future Hold for Foundry?
The text-generating models in the Foundry price list mention a 32,000 max context window. GPT-3.5, the model serving as the basis for ChatGPT and Microsoft’s Bing AI chatbot, has a max context window of 4,000. The bigger number hints that OpenAI is getting close to releasing GPT-4, or maybe something more. Foundry is a great option for companies that want to get on the leading edge of generative AI, and it looks like OpenAI is committed to making sure Foundry is the best it can be.
If you’re a business looking for a way to get on the cutting edge of generative AI, Foundry is a great option. It’s designed for companies that want to scale up their use of LLMs and have more control over customizing the data used to train the model. The package also includes support from OpenAI, with the price varying depending on how long and how many compute units the company wants. Foundry looks to be the future of generative AI, and OpenAI is committed to making sure it’s the best it can be.