diff --git a/docs/marketplace-docs/guides/mistral7b-instruct-with-openwebui/index.md b/docs/marketplace-docs/guides/mistral7b-instruct-with-openwebui/index.md new file mode 100644 index 00000000000..27f2e9281f9 --- /dev/null +++ b/docs/marketplace-docs/guides/mistral7b-instruct-with-openwebui/index.md @@ -0,0 +1,85 @@ +--- +title: "Deploy Mistral 7B Instruct with Open WebUI" +description: "This guide helps deploy Open WebUI with Mistral 7B Instruct self-hosted LLM." +published: 2025-12-23 +modified: 2025-12-23 +keywords: ['mistral', 'mistral-7b-instruct', 'open-webui', 'vllm', 'ai', 'llm', 'llm-inference', 'mistral-7b] +tags: ["marketplace", "linode platform", "cloud manager", "ai", "llm-inference", "llm"] +aliases: ['/products/tools/marketplace/guides/mistral7b-instruct-with-openwebui/'] +external_resources: +- '[Open WebUI Documentation](https://docs.openwebui.com/getting-started/)' +- '[Minstral Documentation](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3)' +authors: ["Akamai"] +contributors: ["Akamai"] +license: '[CC BY-ND 4.0](https://creativecommons.org/licenses/by-nd/4.0)' +marketplace_app_id: 1980062 +marketplace_app_name: "Mistral 7B Instruct with Open WebUI" +--- + +Open WebUI is an open-source, self-hosted web interface for interacting with and managing Large Language models. It supports multiple AI backends, multi-user access, and extensible integrations, enabling secure and customizable deployment for local or remote model inference. + +Our Marketplace applcation deploys Mistral-7B-Instruct-v0.3 as an instruction-tuned, open-weight LLM model optimized for prompt following, reasoning, and conversational tasks. It is designed for efficient inference and integrates well with self-hosted platforms like Open WebUI for general-purpose assistance, coding, and knowledge-based workflows. + +## Deploying a Marketplace App + +{{% content "deploy-marketplace-apps-shortguide" %}} + +{{% content "marketplace-verify-standard-shortguide" %}} + +{{< note title="Estimated deployment time" >}} +Open WebUI with Mistral 7B Instruct should be fully installed within 5-10 minutes after the Compute Instance has finished provisioning. +{{< /note >}} + +## Configuration Options + +- **Recommended plan:** RTX4000 Ada x1 Small + +{{< note type="warning" >}} +This Marketplace App will ONLY work with GPU instances. If you choose the wrong instance, the provisioning will fail and a notice will appear in the LISH console. +{{< /note >}} + +### Open WebUI Options + +- **Linode API Token** *(required)*: Your API token is used to deploy additional Compute Instances as part of this cluster. At a minimum, this token must have Read/Write access to *Linodes*. If you do not yet have an API token, see [Get an API Access Token](/docs/products/platform/accounts/guides/manage-api-tokens/) to create one. + +- **Email address (for the Let's Encrypt SSL certificate)** *(required)*: Your email is used for Let's Encrypt renewal notices This allows you to visit Open WebUI securely through a browser. + +- **Open WebUI admin name.** *(required)*: This is the name that will be associated with your login and required by Open WebUI during the initial enrollment. + +- **Open WebUI admin email.** *(required)*: This is the email that you will use to login into Open WebUI. + +{{% content "marketplace-required-limited-user-fields-shortguide" %}} + +{{% content "marketplace-special-character-limitations-shortguide" %}} + +## Getting Started After Deployment + +### Accessing Open WebUI Frontend + +Once your app has finished deplying, you can log into Open WebUI using your browser. + +1. Log into the instance as your limited sudo user, replacing `{{< placeholder "USER" >}}` with the sudo username you created, and `{{< placeholder "IP_ADDRESS" >}}` with the instance's IPv4 address: + + ```command + ssh {{< placeholder "USER" >}}@{{< placeholder "IP_ADDRESS" >}} + ``` + +2. Upon logging into the instance you will notice that a banner will appear and will contain the **App URL**. Open your browser and paste the link which will direct you to the login for Open WebUI. + + + !["Open WebUI Login Page"](openwebui-login.png "Open WebUI Login Page") + +3. Go back to your terminal and open the `.credentials` file with the following command. Replace `{{< placeholder "USER" >}}` with your sudo username: + + ```command + sudo cat /home/{{< placeholder "USER" >}}/.credentials + ``` + +4. In the `.credentials` file, locate the Open WebUI login email and password. Go back to the Open WebUI login page and paste the credentials to log in. When you successfully login, you will be created by the following page. + + + !["Open WebUI Welcome 1"](openwebui-w1.png "Open WebUI Welcome 1") + +Once you hit the "Okay, Let's Go!" button, you will be able to use the chat feature in Open WebUI. + +!["Open WebUI Welcome 2"](openwebui-w2.png "Open WebUI Welcome 2") diff --git a/docs/marketplace-docs/guides/mistral7b-instruct-with-openwebui/openwebui-login.png b/docs/marketplace-docs/guides/mistral7b-instruct-with-openwebui/openwebui-login.png new file mode 100644 index 00000000000..60be8ff706d Binary files /dev/null and b/docs/marketplace-docs/guides/mistral7b-instruct-with-openwebui/openwebui-login.png differ diff --git a/docs/marketplace-docs/guides/mistral7b-instruct-with-openwebui/openwebui-w1.png b/docs/marketplace-docs/guides/mistral7b-instruct-with-openwebui/openwebui-w1.png new file mode 100644 index 00000000000..b98e159ea76 Binary files /dev/null and b/docs/marketplace-docs/guides/mistral7b-instruct-with-openwebui/openwebui-w1.png differ diff --git a/docs/marketplace-docs/guides/mistral7b-instruct-with-openwebui/openwebui-w2.png b/docs/marketplace-docs/guides/mistral7b-instruct-with-openwebui/openwebui-w2.png new file mode 100644 index 00000000000..70e65a24673 Binary files /dev/null and b/docs/marketplace-docs/guides/mistral7b-instruct-with-openwebui/openwebui-w2.png differ