Instructions to use remiai3/RemiAI_Framework with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use remiai3/RemiAI_Framework with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="remiai3/RemiAI_Framework", filename="engine/model.gguf", )
llm.create_chat_completion( messages = [ { "role": "user", "content": "What is the capital of France?" } ] ) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use remiai3/RemiAI_Framework with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf remiai3/RemiAI_Framework # Run inference directly in the terminal: llama-cli -hf remiai3/RemiAI_Framework
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf remiai3/RemiAI_Framework # Run inference directly in the terminal: llama-cli -hf remiai3/RemiAI_Framework
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf remiai3/RemiAI_Framework # Run inference directly in the terminal: ./llama-cli -hf remiai3/RemiAI_Framework
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf remiai3/RemiAI_Framework # Run inference directly in the terminal: ./build/bin/llama-cli -hf remiai3/RemiAI_Framework
Use Docker
docker model run hf.co/remiai3/RemiAI_Framework
- LM Studio
- Jan
- vLLM
How to use remiai3/RemiAI_Framework with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "remiai3/RemiAI_Framework" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "remiai3/RemiAI_Framework", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/remiai3/RemiAI_Framework
- Ollama
How to use remiai3/RemiAI_Framework with Ollama:
ollama run hf.co/remiai3/RemiAI_Framework
- Unsloth Studio new
How to use remiai3/RemiAI_Framework with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for remiai3/RemiAI_Framework to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for remiai3/RemiAI_Framework to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for remiai3/RemiAI_Framework to start chatting
- Docker Model Runner
How to use remiai3/RemiAI_Framework with Docker Model Runner:
docker model run hf.co/remiai3/RemiAI_Framework
- Lemonade
How to use remiai3/RemiAI_Framework with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull remiai3/RemiAI_Framework
Run and chat with the model
lemonade run user.RemiAI_Framework-{{QUANT_TAG}}List all available models
lemonade list
| /* --- VARIABLES --- */ | |
| :root { | |
| --bg-color: #ffffff; | |
| --text-color: #333333; | |
| --sidebar-bg: #f5f5f5; | |
| --accent: #2563eb; | |
| --card-bg: #f9fafb; | |
| --border-color: #e5e7eb; | |
| --input-bg: #f3f4f6; | |
| --hover-color: #eef0f3; | |
| --user-avatar-bg: #000000; | |
| --user-avatar-text: #ffffff; | |
| --ai-avatar-text: #333333; | |
| --code-bg: #f4f4f4; | |
| } | |
| body.dark-mode { | |
| --bg-color: #121212; | |
| --text-color: #e0e0e0; | |
| --sidebar-bg: #1e1e1e; | |
| --accent: #60a5fa; | |
| --card-bg: #252525; | |
| --border-color: #333333; | |
| --input-bg: #2d2d2d; | |
| --hover-color: #333333; | |
| --user-avatar-bg: #ffffff; | |
| --user-avatar-text: #000000; | |
| --ai-avatar-text: #ffffff; | |
| --code-bg: #1a1a1a; | |
| } | |
| body { margin: 0; font-family: 'Segoe UI', sans-serif; background-color: var(--bg-color); color: var(--text-color); overflow: hidden; transition: 0.3s; } | |
| .app-container { display: flex; height: 100vh; width: 100vw; } | |
| /* SIDEBAR & NAV GRID */ | |
| .sidebar { width: 240px; background-color: var(--sidebar-bg); padding: 15px; display: flex; flex-direction: column; border-right: 1px solid var(--border-color); flex-shrink: 0; } | |
| .brand { display: flex; align-items: center; gap: 10px; font-size: 18px; font-weight: bold; margin-bottom: 15px; padding-left: 5px; } | |
| .brand-logo { width: 28px; height: 28px; filter: grayscale(100%); opacity: 0.8; } | |
| .new-chat-btn { display: flex; align-items: center; gap: 10px; padding: 10px; background: var(--card-bg); border: 1px solid var(--border-color); color: var(--text-color); border-radius: 8px; cursor: pointer; transition: 0.2s; font-weight: 600; width: 100%; justify-content: center; margin-bottom: 5px; } | |
| .new-chat-btn:hover { background-color: var(--hover-color); } | |
| .secondary-btn { display: flex; align-items: center; gap: 10px; padding: 8px; background: transparent; border: 1px solid var(--border-color); color: var(--text-color); border-radius: 8px; cursor: pointer; font-size: 12px; width: 100%; justify-content: center; } | |
| .secondary-btn:hover { background-color: var(--hover-color); } | |
| .nav-section { margin-top: 15px; border-bottom: 1px solid var(--border-color); padding-bottom: 15px; } | |
| .nav-label { font-size: 10px; text-transform: uppercase; opacity: 0.5; font-weight: bold; margin-bottom: 8px; letter-spacing: 1px; } | |
| .nav-grid { display: grid; grid-template-columns: repeat(4, 1fr); gap: 5px; } | |
| .nav-icon-btn { aspect-ratio: 1; display: flex; align-items: center; justify-content: center; background: transparent; border: 1px solid transparent; border-radius: 6px; color: var(--text-color); cursor: pointer; opacity: 0.6; transition: 0.2s; } | |
| .nav-icon-btn:hover { background: var(--hover-color); opacity: 1; } | |
| .nav-icon-btn.active { background: var(--hover-color); color: var(--accent); opacity: 1; border-color: var(--border-color); } | |
| .nav-icon-btn i { width: 18px; height: 18px; } | |
| /* MAIN CONTENT */ | |
| .main-content { flex: 1; display: flex; flex-direction: column; position: relative; background-color: var(--bg-color); overflow: hidden; } | |
| .view-section { height: 100%; display: flex; flex-direction: column; background-color: var(--bg-color); } | |
| /* CHAT ELEMENTS */ | |
| .chat-header { padding: 0 20px; border-bottom: 1px solid var(--border-color); display: flex; justify-content: center; align-items: center; height: 50px; flex-shrink: 0; } | |
| .header-info { display: flex; align-items: center; gap: 10px; font-size: 13px; opacity: 0.9; } | |
| .header-avatar { width: 28px; height: 28px; border-radius: 50%; object-fit: cover; border: 2px solid var(--accent); } | |
| .header-dropdown { background: var(--input-bg); border: 1px solid var(--border-color); color: var(--text-color); padding: 4px 8px; border-radius: 6px; outline: none; cursor: pointer; font-size: 13px; font-weight: bold; } | |
| .chat-area { flex: 1; overflow-y: auto; padding: 20px 40px; display: flex; flex-direction: column; gap: 15px; scroll-behavior: smooth; } | |
| .message-row { display: flex; gap: 15px; align-items: flex-start; line-height: 1.6; font-size: 15px; animation: fadeIn 0.3s ease; position: relative; } | |
| .message-row:hover .message-actions { opacity: 1; } | |
| .message-content-wrapper { flex: 1; max-width: 850px; } | |
| .message-actions { display: flex; gap: 5px; margin-top: 5px; opacity: 0; transition: 0.2s; } | |
| .action-btn { background: transparent; border: none; cursor: pointer; color: var(--text-color); opacity: 0.4; padding: 4px; border-radius: 4px; } | |
| .action-btn:hover { opacity: 1; background-color: var(--hover-color); } | |
| @keyframes fadeIn { from { opacity: 0; transform: translateY(5px); } to { opacity: 1; transform: translateY(0); } } | |
| .avatar { width: 28px; height: 28px; border-radius: 6px; display: flex; justify-content: center; align-items: center; font-weight: 700; font-size: 12px; flex-shrink: 0; } | |
| .avatar.user { background-color: var(--user-avatar-bg); color: var(--user-avatar-text); } | |
| .avatar.ai { background: transparent; color: var(--ai-avatar-text); border: 1px solid var(--border-color); } | |
| .avatar-sticker { width: 25px; height: 25px; border-radius: 8px; object-fit: cover; border: 1px solid var(--border-color); flex-shrink: 0; } | |
| .message-text { padding-top: 2px; overflow-wrap: break-word; } | |
| .message-text p { margin-bottom: 8px; } | |
| .message-text code { background-color: var(--code-bg); padding: 2px 5px; border-radius: 4px; font-family: 'Consolas', monospace; font-size: 0.9em; } | |
| .typing-indicator { display: flex; gap: 5px; padding: 5px 0; } | |
| .typing-indicator span { width: 5px; height: 5px; background-color: var(--text-color); border-radius: 50%; opacity: 0.6; animation: bounce 1.4s infinite ease-in-out both; } | |
| .typing-indicator span:nth-child(1) { animation-delay: -0.32s; } | |
| .typing-indicator span:nth-child(2) { animation-delay: -0.16s; } | |
| @keyframes bounce { 0%, 80%, 100% { transform: scale(0); } 40% { transform: scale(1); } } | |
| .input-container { padding: 20px 40px; background: transparent; flex-shrink: 0; } | |
| .input-box-wrapper { display: flex; background-color: var(--input-bg); border: 1px solid transparent; border-radius: 14px; padding: 10px 15px; align-items: flex-end; transition: 0.2s; } | |
| .input-box-wrapper:focus-within { border-color: var(--border-color); box-shadow: 0 4px 15px rgba(0,0,0,0.05); } | |
| textarea { flex: 1; background: transparent; border: none; padding: 5px 0; color: var(--text-color); font-size: 15px; outline: none; resize: none; font-family: inherit; line-height: 1.5; max-height: 120px; } | |
| #send-btn { background: transparent; border: none; color: var(--text-color); cursor: pointer; padding: 8px; opacity: 0.6; } | |
| #send-btn:hover { opacity: 1; color: var(--accent); } | |
| #send-btn.stop-mode { color: #ef4444; opacity: 1; } | |
| .centered-view { align-items: center; justify-content: center; text-align: center; padding: 40px; } | |
| /* MODALS */ | |
| .modal-overlay { position: fixed; top: 0; left: 0; width: 100%; height: 100%; background: rgba(0,0,0,0.6); display: flex; justify-content: center; align-items: center; z-index: 1000; backdrop-filter: blur(2px); } | |
| .modal-content { background: var(--bg-color); border: 1px solid var(--border-color); padding: 25px; border-radius: 12px; width: 350px; color: var(--text-color); box-shadow: 0 20px 50px rgba(0,0,0,0.2); } | |
| .modal-content.large { width: 650px; max-height: 85vh; overflow-y: auto; display: flex; flex-direction: column; } | |
| .modal-actions { display: flex; justify-content: flex-end; gap: 10px; margin-top: 20px; } | |
| .persona-form { display: grid; grid-template-columns: 1fr 1fr; gap: 15px; } | |
| .form-group label { display: block; font-size: 12px; margin-bottom: 5px; opacity: 0.8; font-weight: 600; } | |
| .modal-input { width: 100%; padding: 8px; border-radius: 6px; border: 1px solid var(--border-color); background: var(--input-bg); color: var(--text-color); box-sizing: border-box; } | |
| .full-width { grid-column: span 2; } | |
| .btn-primary { background: var(--accent); color: white; border: none; padding: 8px 16px; border-radius: 6px; cursor: pointer; font-size: 13px; font-weight: 600; } | |
| .btn-cancel { background: transparent; border: 1px solid var(--border-color); color: var(--text-color); padding: 8px 16px; border-radius: 6px; cursor: pointer; font-size: 13px; } | |
| .btn-delete { background: #ef4444; color: white; border: none; padding: 8px 16px; border-radius: 6px; cursor: pointer; font-size: 13px; } | |
| .persona-list-display { margin-top: 15px; max-height: 150px; overflow-y: auto; border-top: 1px solid var(--border-color); padding-top: 10px; } | |
| .persona-item { display: flex; justify-content: space-between; align-items: center; padding: 8px; border-bottom: 1px solid var(--border-color); font-size: 13px; cursor: pointer; } | |
| .persona-item:hover { background-color: var(--hover-color); } | |
| /* HISTORY LIST */ | |
| .history-list { flex: 1; overflow-y: auto; margin-top: 15px; padding-right: 5px; min-height: 0; } | |
| .history-list::-webkit-scrollbar { width: 4px; } | |
| .history-list::-webkit-scrollbar-thumb { background: var(--border-color); border-radius: 4px; } | |
| .history-item { padding: 10px; border-radius: 6px; cursor: pointer; font-size: 13px; margin-bottom: 2px; color: var(--text-color); opacity: 0.8; transition: 0.2s; display: flex; justify-content: space-between; align-items: center; white-space: nowrap; overflow: hidden; text-overflow: ellipsis; } | |
| .history-item:hover, .history-item.active { background-color: var(--hover-color); opacity: 1; } | |
| .history-item span { overflow: hidden; text-overflow: ellipsis; } | |
| .delete-btn-wrapper { display: flex; align-items: center; justify-content: center; padding: 4px; border-radius: 4px; opacity: 0; transition: 0.2s; margin-left: 5px; } | |
| .history-item:hover .delete-btn-wrapper { opacity: 1; } | |
| .delete-btn-wrapper:hover { background-color: rgba(255, 50, 50, 0.1); color: #ff4444; } | |
| .delete-icon { width: 12px; height: 12px; } | |
| .sidebar-footer { margin-top: auto; padding-top: 10px; border-top: 1px solid var(--border-color); } | |
| .credits-text { font-size: 10px; margin-bottom: 10px; opacity: 0.6; text-align: left; line-height: 1.4; } | |
| .status-loading { color: #f59e0b; animation: pulse 1.5s infinite; font-weight: 600; } | |
| .status-online { color: #10b981; font-weight: 600; } | |
| .welcome-screen { position: absolute; top: 50%; left: 50%; transform: translate(-50%, -50%); text-align: center; opacity: 0.6; } | |
| .large-logo { width: 72px; height: 72px; margin-bottom: 20px; filter: grayscale(100%); opacity: 0.3; } | |
| .hidden { display: none ; } |