gary-boon Claude Opus 4.5 commited on
Commit
543454f
·
1 Parent(s): 62525b2

Update .env.spark.example: TORCH_DTYPE now auto-detected

Browse files

TORCH_DTYPE is automatically set from model config:
- codegen-350m → fp16
- devstral-small → bf16

Only uncomment to override the default.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <[email protected]>

Files changed (1) hide show
  1. .env.spark.example +4 -2
.env.spark.example CHANGED
@@ -17,8 +17,10 @@ HF_TOKEN=<your-hf-token>
17
  # Model Settings
18
  MAX_CONTEXT=8192
19
  BATCH_SIZE=1
20
- TORCH_DTYPE=fp16
21
- # TORCH_DTYPE=bf16 # Use bf16 for Devstral (Phase 3)
 
 
22
 
23
  # Device Override (set to 'cpu' if GPU not supported yet)
24
  # DEVICE=cuda # Default: auto-detect
 
17
  # Model Settings
18
  MAX_CONTEXT=8192
19
  BATCH_SIZE=1
20
+ # TORCH_DTYPE is auto-detected from model config (codegen→fp16, devstral→bf16)
21
+ # Uncomment to override:
22
+ # TORCH_DTYPE=fp16
23
+ # TORCH_DTYPE=bf16
24
 
25
  # Device Override (set to 'cpu' if GPU not supported yet)
26
  # DEVICE=cuda # Default: auto-detect