BVendeville/bbscore-wiki-dim8

BBScore encoder — wiki_dim8

BBScore encoder checkpoint (latent_dim=8) trained on Wikisection, used for the Brownian Bridge coherence score in the simpsy text simplification evaluation library.

Usage

from simpsy import evaluate

df = evaluate(
    ["The cat sat on the mat. It watched the mouse. Then it pounced."],
    families=["bbscore"],
    # simpsy reads the checkpoint from SIMPSY_BBSCORE_HF_REPO, defaulting
    # to this repo once wired in as the simpsy default.
)

Or point simpsy at this repo explicitly:

export SIMPSY_BBSCORE_HF_REPO=BVendeville/bbscore-wiki-dim8

Citation

Sheng et al. (2024), "BBScore: A Brownian Bridge Based Metric for Assessing Text Coherence" — https://arxiv.org/abs/2312.16893.