Perimattic
19 applications

Managed AI & ML Infrastructure

Deploy and manage open-source AI and ML tools like Ollama, Dify, Open WebUI, LiteLLM, Label Studio, and Langfuse on AWS, Azure, or GCP. Run LLMs and ML pipelines without DevOps.

Glowing green chip marked AI on a computer circuit board
Overview

What does the AI & ML category cover?

ManageStacks deploys and manages nine open-source AI and ML tools: Ollama and LocalAI for serving models, Open WebUI for private chat, Dify, FlowiseAI and Typebot for building LLM apps and chatbots, LiteLLM for provider routing, Langfuse for LLM observability and Label Studio for data labelling. Each runs on a dedicated instance in your AWS, Azure or GCP region.

This category covers the infrastructure behind AI applications, from running a model to watching how it behaves. Ollama and LocalAI serve open-weight language models behind an OpenAI-compatible API. Open WebUI gives your team a private chat interface on top of them. LiteLLM routes requests across 100+ model providers and tracks spend. Dify and FlowiseAI build LLM applications visually, and Typebot builds conversational forms and chatbots. Label Studio prepares training data, and Langfuse traces and analyses LLM calls in production.

The main reason to self-host here is data: prompts, documents and chat history stay in your own cloud region instead of passing through a third-party API. ManageStacks provisions what these tools need to run: GPU drivers and persistent model storage for the model servers, with Ollama on L4, L40S or H100 GPUs depending on plan, and PostgreSQL, Redis, SSL and backups for the application layer.

AI & ML applications on ManageStacks

Each application runs unmodified on a dedicated instance in your chosen AWS, Azure, or GCP region — from $11 per app per month.

OpenClaw logo

OpenClaw

Personal AI assistant that runs on any OS and platform, formerly known as Clawdbot

From $16/moChatGPT alternativeClaude alternative
Zep logo

Zep

Long-term memory store for AI assistants that recalls and extracts facts from chats

From $11/moMem0 alternativePinecone alternative
LobeChat logo

LobeChat

Open-source chat framework for running a private ChatGPT-style app with many LLM providers

From $11/moChatGPT Team alternativeClaude Team alternative
Hermes logo

Hermes

Self-improving AI agent from Nous Research with a built-in learning loop

From $16/moChatGPT alternativeClaude alternative
AnythingLLM logo

AnythingLLM

All-in-one AI application with document chat, RAG, and configurable AI agents

From $16/moChatGPT Enterprise alternativeMicrosoft Copilot alternative
Jupyter Notebook logo

Jupyter Notebook

Web-based notebook environment for interactive computing, data analysis, and visualization

From $16/moGoogle Colab alternativeDatabricks alternative
RAGFlow logo

RAGFlow

Retrieval-augmented generation engine for building document-grounded AI assistants

From $55/moAzure AI Search alternativeAmazon Kendra alternative
Botpress logo

Botpress

Open-source chatbot builder with a visual flow editor and OpenAI-powered bots

From $16/moDialogflow alternativeLandbot alternative
Langflow logo

Langflow

Visual framework for building multi-agent and RAG applications with drag-and-drop flows

From $16/moFlowise alternativeDify alternative
LibreChat logo

LibreChat

ChatGPT-style chat interface supporting many AI providers, agents, and plugins

From $16/moChatGPT Team alternativeClaude Team alternative
Dify logo

Dify

LLM app development platform

From $16/moOpenAI Platform alternativeLangChain Cloud alternative
FlowiseAI logo

FlowiseAI

Drag-and-drop LLM flow builder

From $16/moOpenAI Platform alternative
Ollama logo

Ollama

Run large language models locally

From $30/moOpenAI API alternativeAnthropic API alternative
Open WebUI logo

Open WebUI

Web interface for Ollama and local LLMs

From $30/moChatGPT alternativeClaude alternative
LocalAI logo

LocalAI

OpenAI-compatible local AI inference API

From $30/moOpenAI API alternative
LiteLLM logo

LiteLLM

LLM proxy gateway for 100+ providers

From $16/moOpenAI API alternative
Label Studio logo

Label Studio

Data labeling platform for machine learning

From $16/moLabelbox alternativeScale AI alternative
Langfuse logo

Langfuse

LLM observability, tracing, and analytics

From $16/moLangSmith alternativeWeights & Biases alternative
Typebot logo

Typebot

Open-source conversational form and chatbot builder

From $11/moTypeform alternativeLandbot alternative
Choosing an application

How to choose AI and ML tools

Serving models: Ollama or LocalAI

Both run models on your own GPU instance behind an OpenAI-compatible endpoint, so existing OpenAI client code can point at them. Ollama is the common choice for running large language models; LocalAI offers a private OpenAI-compatible inference API.

See: Ollama, LocalAI

A private chat assistant: Open WebUI

Open WebUI is a web interface for Ollama and other local models, deployed alongside Ollama with persistent storage and daily backups, a private alternative to ChatGPT for internal use.

See: Open WebUI

Building LLM applications

Dify is an LLM app development platform with dataset storage and a vector database backend. FlowiseAI is a drag-and-drop flow builder for LLM chains. Typebot builds conversational forms and AI chatbots you embed on a website.

See: Dify, FlowiseAI, Typebot

Running LLMs in production

LiteLLM is a proxy gateway in front of 100+ providers that centralises routing and spend tracking. Langfuse adds observability, tracing and analytics, so you can see how each call performs. Label Studio covers the data side, with labelling for machine-learning datasets.

See: LiteLLM, Langfuse, Label Studio

Glowing blue key labelled AI on a black laptop keyboard
FAQ

Questions about managed AI & ML applications

What do I need for a private ChatGPT-style assistant?

The usual pairing is Ollama plus Open WebUI. Ollama serves open-weight models on a GPU instance through an OpenAI-compatible endpoint, and Open WebUI gives your team a chat interface with persistent history. Add LiteLLM if you also want to route some requests to hosted providers and track spend in one place.

Do the AI applications run on GPUs?

The model servers do. Ollama runs on GPU-enabled infrastructure with L4, L40S or H100 GPUs depending on plan, with CUDA drivers and persistent model storage managed for you, and LocalAI is deployed with pre-configured GPU drivers. Dify, LiteLLM, Langfuse and Label Studio run as web applications with PostgreSQL and supporting services.

How much does managed AI infrastructure cost?

From $11 to $30 a month per application. Ollama, Open WebUI and LocalAI start at $30; Dify, FlowiseAI, LiteLLM, Label Studio and Langfuse start at $16; and Typebot starts at $11. Each price is for a dedicated instance in your chosen region, and ManageStacks charges no per-token fees.

Does my data leave my cloud when I self-host an LLM?

Not when the model runs on Ollama or LocalAI. Prompts, documents and responses stay on your instance in the AWS, Azure or GCP region you choose. If you route some requests through LiteLLM to an external provider such as OpenAI, those requests do leave, so decide per use case which models are allowed.

What is the difference between Dify and FlowiseAI?

Dify is a fuller platform; FlowiseAI is a focused builder. Dify is an LLM app development platform with dataset storage and a vector database backend, which ManageStacks pairs with Qdrant. FlowiseAI is a drag-and-drop flow builder that stores flows and chat history. Choose Dify for production apps with knowledge bases, FlowiseAI for quick visual chains.

How do I monitor LLM quality and cost in production?

Use Langfuse and LiteLLM together. Langfuse provides LLM observability, tracing and analytics, so you can inspect individual calls and spot where quality drops. LiteLLM sits in front of 100+ providers as a proxy gateway and centralises spend tracking and routing. Both run with PostgreSQL and Redis on ManageStacks.

Run AI & ML applications without the operations work

Pick an application, choose your AWS, Azure or GCP region, and ManageStacks deploys it on a dedicated instance with SSL, monitoring, daily backups and updates handled. Live in under 30 minutes, with a full data export on every plan.