Fix TypeError in make_perturbation_batch_special
#567
by
so298
- opened
Summary:
make_perturbation_batch_special failed with
TypeError: unsupported operand type(s) for *: 'Column' and 'int'
because example_cell["input_ids"] was a Hugging Face Column.
This is a bug for datasets>=4.0.0
Fix:
Convert example_cell to a Python dict (same as in make_perturbation_batch) and explicitly build the repeated input list instead of multiplying the column.
Thank you so much for your contribution to resolve this!
ctheodoris
changed pull request status to
merged