Skip to main content

AnythingLLM

Overview​

AnythingLLM is a self-hosted app that, unlike general-purpose AIs served through public endpoints, you can configure it so that they data remains your own.

Why Use NodeOps Cloud for AnythingLLM?​

  • The NodeOps AnythingLLM template makes setup easy and scalable
  • NodeOps provides the cost-effective Compute your LLM model's needs (4–32 GB RAM is typical)
  • You can leverage your own Machine as the server or those of trusted allies
  • You earn gNODE when you participate in the NodeOps ecosystem
warning

The guide provides an LLM frontend hosted on NodeOps DePIN Cloud that sends request to the LLM provider's servers. Your data security depends upon your key's settings and that of the NodeOps Machine. A forthcoming guide will explain how to connect that frontend to a LLM instance also hosted by you on NodeOps infrastructure.

Deploy AnythingLLM​

Use the video or walkthrough to understand how to deploy a frontend for AnythingLLM at-a-click with no setup overhead.

Prerequisites​

  1. Use the Cloud Compute Marketplace AnythingLLM link, or log in, navigate to Template Marketplace, and search for AnythingLLM.
  2. Click Deploy Template, and select which Machine to run the workload on, or Auto assign.
  3. Enter the API key, decide whether to leave CPU values as default or customize them, click Next.
  4. Pay for the template deployment.

You are now ready to chat with the LLM, upload documents, or customize the LLM.

Use AnythingLLM​

  1. Logged into the Cloud Marketplace, navigate to My Deployments.
  2. Click on the AnythingLLM card and click Endpoints for your instance's URL.
  3. Click Get Started and choose the LLM model for which you provided the key.
  4. Follow the rest of the prompts.

You can now customize your LLM settings, upload documents, and start interacting with the AI.

Troubleshooting​

  • If your app crashes, consider increasing CPU/memory values
  • For delayed deployments, contact the NodeOps support team with your workload name

What next?​

  • Access your app
  • Monitor your deployment
  • Manage your instance