Offline AI LLM System (TrueNAS Hosted)

 

TrueNAS Hosted Offline LLM:
Dolphin, Ollama and AnythingLLM

Introduction

Running AI models on your TrueNAS server provides centralized access to powerful language models for your entire network. This guide walks through deploying Ollama with Dolphin models and AnythingLLM on TrueNAS, making AI assistance available to all your devices while maintaining complete data privacy.

By the end of this guide, you'll have:

• Ollama running as a Docker container on TrueNAS
• Dolphin models stored efficiently on your ZFS pool
• AnythingLLM accessible via web browser from any device on your network
• Persistent storage that survives container restarts
• Optional GPU passthrough for accelerated inference

Offline AI LLM System

Create a Completely Offline LLM:
Using Dolphin, Ollama, and AnythingLLM

Running a Large Language Model (LLM) completely offline gives you privacy, control, and independence from cloud services. In this comprehensive guide, I'll walk you through setting up a fully functional offline AI assistant using three powerful tools:

• Dolphin - Uncensored, instruction-tuned language models
• Ollama - Simple, efficient local LLM runtime
• AnythingLLM - User-friendly web interface for interacting with local models

By the end of this guide, you'll have a ChatGPT-like experience running entirely on your own hardware, with no internet connection required!!

The Computer, IT & Cybersecurity Guide & Manual(s) Trifecta

 

Announcing Three "IT Guide" Projects!

I am thrilled to announce the launch of three new, powerful resources on GitHub designed to help you navigate, understand, and master the world of technology, from fundamental computing to advanced cybersecurity. Whether you're a complete beginner, an aspiring IT professional, or a seasoned enthusiast, this new collection has something crucial for you.

ProxMox VE: Installation & Free Edition Configuration

Setting Up ProxMox VE:

Installation and Free Edition Configuration

ProxMox Virtual Environment (VE) is a powerful open-source virtualization platform that combines KVM virtualization and LXC containers on a single platform. Whether you're building a homelab or deploying enterprise infrastructure, ProxMox offers enterprise-grade features without the enterprise price tag.

In this guide, we'll walk through the essential steps for installing ProxMox and configuring it for the free edition, including the crucial repository fixes that every non-subscription user needs to know.

Automated System-Wide Debloating & Basic Software Installation for Windows 10/11

Introducing "DeployWorkstation"

A System-Wide/All-Users Debloating & Basic Application Installation
PowerShell Script For Windows 10 & Windows 11 Systems

IT Advocacy Services - We Can Be Your Technology Advocate!

What Is an IT Advocate?

An IT advocate is an individual who supports and advises clients with their IT product/service needs, as well as any other technology-related needs. Not everyone has, needs, or can afford a CTO or a dedicated System Administrator to help with, and represent, their business. But now, you can hire Pacific Northwest Computers to represent your company in those roles, if and when that need ever arises! 

The IT Advocating Services that Pacific Northwest Computers Provides, Include:

• Liaison Responsibilities

• Investigate, Document & Resolve Product or Service Issues With Vendors/Providers

• Refer & Consult Clients on Recommended & Needed Technology Products/Services

• Conflict Resolution & Mediation with Vendors/Suppliers/Etc.

• Crisis Management & Crisis Prevention/Response

• Malware Attack Investigation, Documentation & System Improvements

• Data Breach Investigation, Documentation & System Improvements

• Data Loss Disaster Assistance, Policy Development & Data Loss Prevention System Development

• Information Technology Professional Witness for Legal/Court Cases

• Help Set Up Appointments for Needed Services or Support From Vendors/Providers

• Warranty Exchange/RMA Support

• Termination of Service(s) Support (Software Vendors, Services, Etc)

• General IT/Technical Advising

• HIPPA Consultation

• Technical Documentation Services

• Reading & Understanding Technical Documentation 

• Reading & Understanding Service/Setup Material & Instructions

• Implementing Needed Technical Procedures for Products & Services

• "On-Demand" IT Administrator/CTO Services: 

• Develop policies and procedures

• Recommend the use of technology to enhance products and services for a client's internal operations, as well as their customer's experience.

Jon Pienkowski

Pacific Northwest Computers

www.linktr.ee/pnwcomputers

360.624.7379