Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
gary-boon
Claude Opus 4.5
commited on
Commit
·
543454f
1
Parent(s):
62525b2
Update .env.spark.example: TORCH_DTYPE now auto-detected
Browse filesTORCH_DTYPE is automatically set from model config:
- codegen-350m → fp16
- devstral-small → bf16
Only uncomment to override the default.
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude Opus 4.5 <[email protected]>
- .env.spark.example +4 -2
.env.spark.example
CHANGED
|
@@ -17,8 +17,10 @@ HF_TOKEN=<your-hf-token>
|
|
| 17 |
# Model Settings
|
| 18 |
MAX_CONTEXT=8192
|
| 19 |
BATCH_SIZE=1
|
| 20 |
-
TORCH_DTYPE
|
| 21 |
-
#
|
|
|
|
|
|
|
| 22 |
|
| 23 |
# Device Override (set to 'cpu' if GPU not supported yet)
|
| 24 |
# DEVICE=cuda # Default: auto-detect
|
|
|
|
| 17 |
# Model Settings
|
| 18 |
MAX_CONTEXT=8192
|
| 19 |
BATCH_SIZE=1
|
| 20 |
+
# TORCH_DTYPE is auto-detected from model config (codegen→fp16, devstral→bf16)
|
| 21 |
+
# Uncomment to override:
|
| 22 |
+
# TORCH_DTYPE=fp16
|
| 23 |
+
# TORCH_DTYPE=bf16
|
| 24 |
|
| 25 |
# Device Override (set to 'cpu' if GPU not supported yet)
|
| 26 |
# DEVICE=cuda # Default: auto-detect
|