> Source: https://meetrix.io/store/mistral/
> Markdown copy of that page. Cite the URL above, not this file.

[Store](https://meetrix.io/store/)  Mistral 7B

Open-source LLM bundle

# Self-hosted Mistral 7B LLM bundle on AWS

Run seven Mistral 7B-based models behind an OpenAI-compatible API on a GPU instance in your own AWS account. Point existing OpenAI tooling at your own endpoint and keep your prompts private.

 [Launch on AWS](https://aws.amazon.com/marketplace/pp/prodview-43olwea5uqpzu)

-   Seven models in one bundle
-   OpenAI-compatible API
-   Runs in your own account

![Mistral 7B LLM bundle deployed on AWS by Meetrix](https://meetrix.io/assets/store/mistral/mistral.webp)

## What is Mistral 7B?

Mistral 7B is an open-source large language model with 7 billion parameters, built for efficiency without giving up quality. Its compact size makes it practical to self-host for coding help, content generation and custom AI features.

-   ### OpenAI-compatible API

    Use existing OpenAI SDKs and tools with a new base URL.

-   ### Chat and completions

    /v1/chat/completions and /v1/completions endpoints.

-   ### Embeddings

    /v1/embeddings for search and retrieval.

-   ### Model listing

    /v1/models shows every model in the bundle.

-   ### Interactive docs

    API documentation at /docs on your server.

-   ### Open weights

    Customise and run the models on your own terms.

## What's in the Meetrix Mistral bundle

The AMI ships seven Mistral-based models behind one OpenAI-compatible API on Ubuntu 22.04.

-   mistral-7b-v0.1, mistral-7b-instruct-v0.1 and v0.2
-   dolphin-2.6-mistral-7b and openhermes-2.5-mistral-7b
-   yarn-mistral-7b-128k and mistral-7b-openorca
-   Automatic SSL when your domain is hosted on Route 53
-   A CloudFormation template for your own AWS account
-   Email support from Meetrix at aws@meetrix.io

## How to set up a self-hosted Mistral API

1.  ### Check your GPU quota

    Make sure your account has enough vCPU quota for a g4dn instance in your region.

2.  ### Launch the stack

    Subscribe on AWS Marketplace and launch the CloudFormation stack with your domain and admin email.

3.  ### Point your domain at it

    Update the Route 53 record with the PublicIp from the stack outputs.

4.  ### Call the API

    Open /docs on your domain, then point your OpenAI client at your server's /v1 endpoint.

## Deploy on AWS

### Mistral 7B on AWS

An x86 AMI on AWS Marketplace, launched on a g4dn GPU instance in your own AWS account with a CloudFormation stack.

Deploys with

CloudFormation

Instance family

g4dn (GPU)

OS

Ubuntu 22.04

#### Setup guides

-   [**Developer guide** Launch, SSL, API endpoints, testing](https://meetrix.io/blogs/mistral-developer-guide/)
-   [**Set up Mistral 7B on AWS** Capabilities and model comparison](https://meetrix.io/blogs/mistral-ai-7b-developer-guide/)
-   [**Video walkthrough** Watch the installation on YouTube](https://www.youtube.com/watch?v=oEYFEKOXfAY)

 [Launch on AWS](https://aws.amazon.com/marketplace/pp/prodview-43olwea5uqpzu)

## Mistral API endpoints

The server implements the OpenAI request and response shapes, so clients only need a new base URL.

| Endpoint | Purpose |
| --- | --- |
| /v1/chat/completions | Chat-style requests with a messages array |
| /v1/completions | Single-prompt text completion |
| /v1/embeddings | Vector embeddings for search and retrieval |
| /v1/models | List the models in the bundle |
| /docs | Interactive API documentation |

Want to compare serving stacks? [Read how to self-host an OpenAI-compatible API →](https://meetrix.io/blogs/openai-compatible-api-self-hosted/)

## Video: Mistral AI installation on AWS

## Mistral 7B FAQ

What is Mistral 7B?

An efficient, open-source large language model with 7 billion parameters, suited to coding help, content generation and custom AI features.

Which models are in the bundle?

mistral-7b-v0.1, mistral-7b-instruct-v0.1, mistral-7b-instruct-v0.2, dolphin-2.6-mistral-7b, openhermes-2.5-mistral-7b, yarn-mistral-7b-128k and mistral-7b-openorca.

Is it compatible with the OpenAI API?

Yes. Point your OpenAI SDK or tools at your server's /v1 endpoint and they work with minimal changes.

Which instance can I use?

The x86 listing runs on g4dn GPU instances, from g4dn.xlarge upward.

Is there an ARM64 version?

Only the x86 bundle is publicly listed on AWS Marketplace at the moment.

What if SSL does not set up automatically?

Check that the domain is on Route 53, then SSH in and run sudo /root/certificate\_generate\_standalone.sh.

How do I upgrade?

Back up your server data, remove the old stack and launch the new version from AWS Marketplace.

## Mistral guides and articles

### [Self-Host an OpenAI-Compatible LLM API on AWS](https://meetrix.io/blogs/openai-compatible-api-self-hosted/)

Ollama, vLLM or a pre-built AMI, without rewriting app code.

### [Best Open Source LLMs to Self-Host in 2026](https://meetrix.io/blogs/best-open-source-llms-self-hosted-2026/)

How Mistral compares with other open models.

### [How to Set Up Mistral AI 7B on AWS](https://meetrix.io/blogs/mistral-ai-7b-developer-guide/)

Capabilities, deployment steps and API integration.

## Need a hand with your LLM API?

We build and run self-hosted AI infrastructure every day, from model selection to GPU sizing. Tell us what you need.

[Contact us](https://meetrix.io/contact-us/)