# Tools & Ecosystem

## 🚀 Open Source Goldmine (Must-Know Projects)

| Project                     | Description                                               |
| --------------------------- | --------------------------------------------------------- |
| 🦙 **Unsloth**              | Fast & memory-efficient LLM fine-tuning                   |
| 🔧 **ConfiUI**              | UI for managing LLM prompts/configs                       |
| 🎨 **Automatic1111**        | Popular UI for Stable Diffusion                           |
| 🌐 **Gradio**               | Web UI for ML demos and interactive apps                  |
| ⚡️ **VLLM**                 | High-performance LLM inference engine                     |
| 📦 **ONNX**                 | Interoperable model format across frameworks              |
| 🧠 **LangChain**            | Agentic workflows with LLMs                               |
| 🔁 **N8N**                  | Visual automation, perfect for AI pipelines               |
| 🧪 **Langflow**             | Visual LangChain builder                                  |
| 🔍 **Vector DBs**           | Pinecone, Weaviate, Redis, ElasticSearch                  |
| 🧠 **Nomic AI**             | Atlas platform for embedding visualization                |
| 🔥 **PyTorch**              | Flexible, research-friendly deep learning framework       |
| 📉 **TensorFlow**           | Industry-grade deep learning framework                    |
| 🚅 **xformers**             | Facebook transformer optimizations                        |
| 📸 **flash-attention**      | Fast & memory-efficient exact attention with IO-awareness |
| 🧱 **pytorch-image-models** | Hugging Face repo with research encoders for vision       |

***

## 📦 Containerization & Deployment

| Tool            | Use Case                                        |
| --------------- | ----------------------------------------------- |
| **Docker**      | Standard for AI model packaging and deployment  |
| **Podman**      | Rootless, daemonless alternative to Docker      |
| **LXC**         | Lightweight virtualization for AI tasks         |
| **Singularity** | HPC-friendly container system, used in academia |

***

## ☁️ Kubernetes & Distributed Training

| Tool                | Use Case                                              |
| ------------------- | ----------------------------------------------------- |
| **Kubeflow**        | Full ML pipelines on Kubernetes                       |
| **Talos Linux**     | Secure, immutable OS for GPU-focused k8s clusters     |
| **VirtIO / vGPU**   | Virtual GPU support for containerized environments    |
| **NVIDIA Operator** | Seamless GPU passthrough and monitoring in Kubernetes |
| **Helm**            | Helm charts for deploying AI/ML stacks efficiently    |

> **Note:** Running a GPU-enabled Kubernetes cluster requires deep infrastructure knowledge.\
> For most users, **cloud-managed Kubernetes services** like **GKE**, **EKS**, or **AKS** significantly simplify this process.

***


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://doc.guidry-cloud.com/04-tools-and-platforms.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.