Fix TypeError in make_perturbation_batch_special

#567
by so298 - opened

Summary:

make_perturbation_batch_special failed with

TypeError: unsupported operand type(s) for *: 'Column' and 'int'

because example_cell["input_ids"] was a Hugging Face Column.
This is a bug for datasets>=4.0.0

Fix:
Convert example_cell to a Python dict (same as in make_perturbation_batch) and explicitly build the repeated input list instead of multiplying the column.

Thank you so much for your contribution to resolve this!

ctheodoris changed pull request status to merged

Sign up or log in to comment