lamm-mit/graph-reasoning-messages-11K
Viewer • Updated • 11k • 10
How to use lamm-mit/LlaDA-8B-EditFlow-graph-v510 with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("lamm-mit/LlaDA-8B-EditFlow-graph-v510", trust_remote_code=True, dtype="auto")python3 -m venv ~/venvs/dllm
source ~/venvs/dllm/bin/activate
python -m pip install -U pip setuptools wheel
git clone https://github.com/lamm-mit/DiscoverydLLM.git
cd DiscoverydLLM
pip install -e .
export PYTHONPATH="$PYTHONPATH:/home/ubuntu/dllm"
python examples/editflow/sample.py \
--model_name_or_path lamm-mit/LlaDA-8B-EditFlow-graph-v510 \
--tau 0.02 --mask_length 128 --seed 7070 \
--prompt ‘Define materiomics.’
python examples/editflow/sample_advanced.py \
--model_name_or_path "lamm-mit/LlaDA-8B-EditFlow-graph-v510" \
--prompt "Define materiomics and relate with flowers." \
--mask_length 128 \
--max_refinement_iterations 3 \
--confidence_method margin \
--temperature_start 0.8 \
--temperature_end 0.3 \
--scheduler linear \
--verbose --tau 0.002
With CFG:
python examples/editflow/sample_advanced.py \
--model_name_or_path "lamm-mit/LlaDA-8B-EditFlow-graph-v510" \
--prompt "Define materiomics." \
--mask_length 128 \
--cfg_scale 1.5 \
--scheduler cosine
Base model
GSAI-ML/LLaDA-8B-Instruct