llama.cpp_omega_matrix

<div align="center"> <img src="./capa.png" alt="llama.cpp_omega_matrix Banner" width="100%" /> # ⚡ llama.cpp_omega_matrix ``` ██████╗ ███╗ ███╗███████╗ ██████╗ █████╗ ██████╗ ██████╗ ██████╗ ██╔═══██╗████╗ ████║██╔════╝██╔════╝ ██╔══██╗ ██╔════╝██╔══██╗██╔══██╗ ██║ ██║██╔████╔██║█████╗ ██║ ███╗███████║ ██║ ██████╔╝██████╔╝ ██║ ██║██║╚██╔╝██║██╔══╝ ██║ ██║██╔══██║ ██║ ██╔═══╝ ██╔═══╝ ╚██████╔╝██║ ╚═╝ ██║███████╗╚██████╔╝██║ ██║ ╚██████╗██║ ██║ ╚═════╝ ╚═╝ ╚═╝╚══════╝ ╚═════╝ ╚═╝ ╚═╝ ╚═════╝╚═╝ ╚═╝ [ S Y M P L E C T I C • M A T R I X E D I T I O N ]``` <b>Next-Generation Symplectic LLM Inference Engine & Cybernetic Matrix Web UI</b><br><i>Equipped with Real-time Voice (Gemini Live Mode), Symplectic SO(2) Cayley Flow & Complete 42+ Native C++ & Helical3D 3D Parametric Tool Suite</i> <br> [](https://opensource.org/licenses/MIT)[](https://github.com/ggml-org/llama.cpp)[](https://www.khronos.org/vulkan/)[%20PBR-00ff66.svg?style=for-the-badge&logo=blender&logoColor=black)](#-helical3d-universal-3d-generative-suite)[](https://svelte.dev/)[](#-matrix-ui--pulsing-omega-brand) </div> --- ## 🌟 Overview & Highlights **`llama.cpp_omega_matrix`** is an advanced, high-performance fork of `llama.cpp` engineered for extreme inference stability, deep mathematical fidelity, and an immersive, cyberpunk 386 CRT Matrix user experience. ### 🌌 Key Innovations: * **⚡ Symplectic Flow Engine:** Geometric integration preserving phase-space volume ($\det(J) = 1.000000$, Liouville theorem invariant) with Cayley-transformed $\mathrm{SO}(2)$ flows for ultra-stable, long-context generation without attention degradation.* **🌀 Helical3D Universal 3D Parametric & PBR Engine ($O(1)$):** Natively integrated AI 3D modeling and game architecture suite based on the *Teoria Helicoidal Universal dos Números Primos* (Bruno Becker / ISBN 978-65-01-54204-1). Allows the LLM to design, parameterize, synthesize 4D toroidal seamless PBR maps, compute analytical $O(1)$ physics, and export `.obj`, `.mtl`, `.stl`, `.glb`, standalone offline WebGL `.html` viewers, and playable 3D games directly to local disk on demand.* **🟢 Matrix Phosphor 386 CRT UI:** Authentic retro-futuristic terminal styling with monochrome phosphor green (`#00ff66` / `#33ff77`) typography on deep cyberspace black (`#040905`), subtle CRT glow, and tonal variations for crisp readability.* **✨ Pulsating Phosphor Animations:** Breathing ambient phosphor glow (`@keyframes matrix-pulse-glow`), pulsating text status indicators (`@keyframes matrix-text-pulse`), and radar beacon signal pings across the interface.* **💠 Pulsing Greek Omega ($\Omega$) Logo:** Cybernetic SVG brand mark with breathing ambient phosphor glow animation.* **📊 Live Matrix Telemetry HUD:** Real-time top bar displaying active ports, active CPU cores (e.g. 6/12), Liouville invariants, decoding token rate (`t/s`), and per-token latency in milliseconds.* **🎙️ Gemini Live Real-time Voice Mode:** Continuous client-side speech-to-text with animated audio visualizer waves and instant real-time transcript streaming directly into the chat input, with optional text-to-speech audio feedback.* **🛠️ 42+ Native C++ & Helical3D Tools (100% Active Out-of-the-box):** * All 42+ tools are natively compiled into the C++ `llama-server` binary and served automatically on `/tools` across **all ports and hosts**. * Complete coverage: 7 Helical3D parametric 3D tools, file I/O, search, shell execution, in-memory SQLite, vector similarity rankings, symbolic calculus, Mermaid compiler, Three.js 3D geometry generator, Graphviz DOT formatter, crypto hasher, JWT claims inspector, password analyzer, cron parser, and geodesic distance calculator. * 4 pre-configured MCP Servers (Exa, Hugging Face, Context7, GitHub Copilot) with native CORS proxy. --- ## 🎛️ Feature Matrix | Feature Category | Description | Status ||---|---|:---:|| **Symplectic Inference** | $\mathrm{SO}(2)$ Cayley flow rotation with Liouville phase-space preservation | ✅ **Active** || **Helical3D Generative Suite** | 7 parametric 3D tools, PBR maps, $O(1)$ physics, OBJ/STL/GLB & WebGL viewers | ✅ **Built-in & Active** || **Matrix 386 CRT Theme** | Deep cyber black (`oklch(0.08 0.035 145)`) + Phosphor green letters (`#00ff66`) | ✅ **Default Everywhere** || **Pulsating Glow FX** | Breathing phosphor glows, radar beacons, and animated CRT status pulses | ✅ **Built-in** || **Brand Identity** | Greek Letter Omega ($\Omega$) vector logo with CSS breathing glow | ✅ **Built-in** || **Telemetry HUD** | Dynamic status beacon, port auto-detection, live token/s & ms/tok stats | ✅ **Built-in** || **Voice Mode (Live)** | Gemini-style real-time continuous Speech-to-Text & TTS feedback | ✅ **Built-in** || **PWA Verification** | Completely decoupled from Service Worker locks, allowing uninhibited multi-port access | ✅ **Removed** || **42+ Native Server Tools** | 100% C++ built-in tools active by default on `/tools` and `/v1/chat/completions` | ✅ **Enabled by Default** || **MCP Integration** | Exa Web Search, Hugging Face, Context7, GitHub + Custom STDIO/SSE/HTTP MCPs | ✅ **Enabled by Default** | --- ## 🛠️ Complete Suite of 42+ Native C++ & Helical3D Tools All 42 tools are built natively into `llama-server` ([`tools/server/server-tools.cpp`](file:///home/userk21/%C3%81rea%20de%20trabalho/userk21/llama.cpp_omega_matrix/tools/server/server-tools.cpp)), discovered dynamically via `GET /tools`, and executable via `POST /tools`: ```├── 🌀 Helical3D Universal 3D Parametric & Generative Suite (7 Tools)│ ├── helical3d_model_creator (Universal AI 3D Architect: prompt to OBJ, MTL, STL, GLB, HTML & PNG)│ ├── helical3d_core_math (Golden Ratio φ, mod 42/420 harmonics, F(t)=sin²(2πφt) & twin invariance)│ ├── helical3d_generate_geometry (Parametric filaments, tokamak torus, fractal terrain & vortex towers)│ ├── helical3d_generate_pbr_textures (Seamless 4D toroidal PBR maps: Albedo, Normal, Roughness, Metallic, Height, AO)│ ├── helical3d_export_model (Multi-format 3D exporter to local disk: Wavefront OBJ, STL & GLB)│ ├── helical3d_render_preview (100% offline standalone WebGL 3D HTML viewer & 2D shaded PNG preview)│ └── helical3d_game_level_builder (Playable standalone 3D WebGL games: Helical Runner FPS & Hellixen 3D)│├── 🖥️ Core Server Tools (C++ Native)│ ├── read_file (Line-sliced safe local file reader & base64 decoder)│ ├── file_glob_search (Recursive glob search with file/dir filters)│ ├── grep_search (Fast regex and text search across files)│ ├── exec_shell_command (Shell executor with live stdout/stderr streaming)│ ├── write_file (Safe file creation with parent directory creation)│ ├── edit_file (Precise block replacement code editor)│ └── get_info (System telemetry, CPU cores, memory & platform info)│├── 🧠 Extended Native Matrix Tool Suite (C++ Native)│ ├── symbolic_calculus (Analytical derivatives, integrals, limits & equation solve)│ ├── sqlite_query (In-memory relational SQL engine with joins & aggregates)│ ├── vector_similarity (Cosine similarity, dot product & Euclidean distance ranking)│ ├── quickjs_evaluate (Deterministic mathematical & logical evaluator)│ ├── chart_data_renderer (Generates bar, line, pie, radar & candlestick specs)│ ├── mermaid_diagram (Mermaid.js flowchart, sequence & Gantt validator)│ ├── threejs_geometry_gen (3D mesh geometry vertices & parametric shapes generator)│ ├── graphviz_dot_gen (Graphviz DOT syntax validator & digraph formatter)│ ├── pdf_text_extractor (PDF structure, text & metadata extractor)│ ├── image_metadata_ocr (EXIF metadata & text region bounding box simulator)│ ├── media_transcode_helper (FFmpeg transcode command & bitrate parameter calculator)│ ├── csv_data_parser (CSV/TSV table to structured JSON converter with stats)│ ├── speech_text_formatter (WebVTT / SRT subtitle generator with timestamp alignment)│ ├── html_to_markdown (Raw HTML to clean GitHub-flavored Markdown converter)│ ├── diff_patch_analyzer (Unified Git diff patch generator with +/- metrics)│ ├── openapi_validator (OpenAPI 3.0 / Swagger specification validator)│ ├── json_schema_validate (Strict JSON Schema draft-07/2020-12 validator)│ ├── regex_tester (Regex matcher with capture groups and index offsets)│ ├── crypto_hasher (SHA-256, SHA-512, SHA-384, SHA-1 cryptographic engine)│ ├── jwt_inspector (JWT decoder, signature & claim validator)│ ├── crypto_key_generator (Cryptographically secure UUID v4, hex & API key generator)│ ├── password_analyzer (Entropy in bits, character pool & crack time estimator)│ ├── base_converter (Universal converter: Base64, Hex, Binary, Decimal, URL)│ ├── cron_parser (5/6-part cron schedule parser with upcoming run times)│ ├── color_palette_tools (HEX/RGB/HSL/OKLCH converter, WCAG contrast & harmonies)│ ├── audio_tone_synthesizer (Web Audio frequency calculator, chords & DTMF tones)│ ├── geo_distance_calc (Geodesic distance via Haversine formula & bearing calculator)│ └── qr_barcode_builder (QR code matrix & Code 128 / EAN-13 SVG generator)│└── 🌐 MCP Servers (Model Context Protocol) ├── Exa Web Search (Live real-time search & clean markdown extraction) ├── Hugging Face Hub (Browse models, spaces, datasets and papers) ├── Context7 Docs (Up-to-date documentation for modern libraries) └── GitHub Copilot MCP (Repository exploration, issues, and PR inspection)``` --- ## 🌀 Helical3D Universal 3D Parametric Engine & LLM Architecture The **`llama.cpp_omega_matrix`** fork features native integration with the **Helical3D (`helical3d`)** computational geometry and procedural rendering engine. ### 📐 Epistemology & Scientific Foundation:* **Analytical $O(1)$ Evaluation:** Rather than relying on heavy pre-computed polygonal caches or heuristic noise (Perlin/Simplex), geometries and surface elevations are calculated via exact closed formulas $F(t) = \sin^2(2\pi\phi t)$.* **Intrinsic Anti-Aliasing (Hurwitz Theorem):** The maximal irrationality of the Golden Ratio $\phi = \frac{1+\sqrt{5}}{2}$ prevents periodic phase collisions and moiré artifacts.* **Semi-Binary Bimodal Polarity:** The arcsine probability density $f(y) = \frac{1}{\pi\sqrt{y(1-y)}}$ concentrates $41.44\%$ of samples in the extreme poles $[0, 0.1] \cup [0.9, 1.0]$, generating natural transitions between dielectric base and metallic veins.* **4D Toroidal Seamless PBR Mapping:** Surfaces UV $(u, v) \in [0, 1)^2$ are embedded into 4D tori $\mathbf{X}(u,v) = (\cos 2\pi u, \sin 2\pi u, \cos 2\pi v, \sin 2\pi v)$, guaranteeing zero visible seams across all 6 PBR channels (*Albedo, Normal, Roughness, Metallic, Height, AO*). ### 🛠️ Helical3D Tools Breakdown: 1. **`helical3d_model_creator` (Universal AI 3D Architect):** * Translates any natural language prompt into a complete 3D production package on local disk. * Auto-infers category (`torus`, `vortex_tower`, `filaments`, `terrain`, `portal`, `bridge`, `game_runner`, `game_fighter`) and material preset (`golden_damascus`, `cyber_runes`, `obsidian_crystal`, `quasicrystal_marble`). * Automatically exports `.obj` + `.mtl`, `.stl` (3D print ready), `.glb` (glTF 2.0), standalone offline WebGL `.html` viewer, and shaded 2D `.png` preview.2. **`helical3d_core_math`:** Evaluates exact $\phi$, $(\mathbb{Z}/42\mathbb{Z})^\times$ Cayley tables, 16 collapse angles, twin succession invariance energy, and multi-octave fractal synthesis.3. **`helical3d_generate_geometry`:** Synthesizes 3D parametric meshes with area-weighted smooth vertex normals, cylindrical/planar UVs, and vertex colors.4. **`helical3d_generate_pbr_textures`:** Generates high-resolution 1024x1024 / 2048x2048 seamless 4D PBR maps.5. **`helical3d_export_model`:** Exports models into standard formats for Blender, Maya, Unreal Engine 5, Unity, Godot, and 3D printers.6. **`helical3d_render_preview`:** Generates 100% offline standalone WebGL 3D HTML viewers (embedded Three.js/OrbitControls) and headless 2D shaded PNG previews.7. **`helical3d_game_level_builder`:** Compiles standalone 3D WebGL games into self-contained HTML files (*Helical Runner 3D* FPS or *Hellixen 3D* Tekken-style fighting arena). ### 💬 Example Prompts for the LLM:* *"Crie um reator tokamak futurista com anel de energia dourado e salve em `/home/userk21/meu_reator/`"** *"Build a 12-level cyberpunk vortex tower with glowing cyan runes in `/home/userk21/models/cyber_tower/`"** *"Generate an alien fractal mountain terrain map with PBR textures in `/home/userk21/models/alien_world/`"** *"Compile a standalone 3D fighting arena HTML game with Offellia vs Marcus in `/home/userk21/games/hellixen_arena/`"* ### ⚙️ Enabling / Disabling Tools:* **Via CLI:** Start the server with `--tools all` or specific tools like `--tools helical3d_model_creator,helical3d_core_math`.* **Via Web UI:** Go to **Settings ⚙️ -> Tools** to toggle any tool with a single click.* **Via API:** Call `GET /tools` or `POST /tools` on any port. --- ## 🎙️ Gemini Live Real-time Voice Mode The chat interface includes a **`LIVE VOZ`** button that operates continuously in real time: * **Instant Transcription:** Words appear in the chat prompt simultaneously as you speak, with zero cloud reliance.* **Animated Waveform:** Cybernetic visualizer displaying dynamic phosphor audio bars responding to speech input.* **Universal Model Compatibility:** Operates on client-side Web Speech and audio streams, functioning with any text or multimodal model (Qwen, Llama 3, DeepSeek, Mistral).* **Text-to-Speech (TTS):** Integrated speech synthesis for voice responses from the assistant. --- ## 🚀 Building & Running ### Prerequisites* **C++ Compiler:** GCC $\ge 11$, Clang $\ge 14$, or MSVC $\ge 2022$* **Build System:** CMake $\ge 3.16$ & Ninja / Make* **Node.js (for UI Assets):** Node $\ge 18$ & npm* **Hardware Acceleration:** Vulkan SDK (recommended), CUDA, or Metal ### Compilation ```bash# 1. Navigate to the repositorycd /path/to/llama.cpp_omega_matrix # 2. Configure with Vulkan GPU accelerationcmake -B build -DGGML_VULKAN=ON -DCMAKE_BUILD_TYPE=Release # 3. Build llama-server with all 35+ native tools and embedded Matrix UIcmake --build build --target llama-server -j$(nproc)``` ### Launching the Server ```bash# Start llama-server (all 35+ tools and Matrix UI are active out-of-the-box on every port):./build/bin/llama-server \ -m /path/to/your/model.gguf \ --host 0.0.0.0 \ --port 8080 \ -ngl 99 \ -c 8192``` Open your browser at **`http://localhost:8080`** to access the Matrix 386 CRT Web UI with the full native tool suite and live telemetry. --- ## 🌐 Development & Frontend Workflow If modifying the SvelteKit frontend in live development mode with Vite hot module replacement (HMR): ```bashcd tools/uinpm installnpm run dev -- --port 5173``` The frontend will run on `http://localhost:5173` with full Matrix 386 CRT styling, live telemetry, and proxy routing to the backend `llama-server` on port `8080`. --- ## 📜 License & Credits * **Core Engine:** Based on [llama.cpp](https://github.com/ggml-org/llama.cpp) by Georgi Gerganov and contributors.* **Symplectic & Matrix Edition:** `llama.cpp_omega_matrix` by userk21.* **License:** [MIT License](LICENSE).