language:-itlicense:apache-2.0base_model:yikuan8/Clinical-Longformertags:-token-classification-ner-pii-pii-detection-de-identification-privacy-healthcare-medical-clinical-phi-italian-pytorch-transformers-openmedpipeline_tag:token-classificationlibrary_name:transformersmetrics:-f1-precision-recallmodel-index:-name:OpenMed-PII-Italian-ClinicalLongformer-149M-v1results:-task:type:token-classificationname:NamedEntityRecognitiondataset:name:AI4Privacy(Italiansubset)type:ai4privacy/pii-masking-400ksplit:testmetrics:-type:f1value:0.9514name:F1(micro)-type:precisionvalue:0.9489name:Precision-type:recallvalue:0.954name:Recallwidget:-text:>- Dr. Marco Rossi (Codice Fiscale: RSSMRC85C15H501Z) può essere contattato a marco.rossi@ospedale.it o al +39 333 123 4567. Abita in Via Roma 25, 00184 Roma.example_title:ClinicalNotewithPII(Italian)
OpenMed-PII-Italian-ClinicalLongformer-149M-v1
Italian PII Detection Model | 149M Parameters | Open Source
Model Description
OpenMed-PII-Italian-ClinicalLongformer-149M-v1 is a transformer-based token classification model fine-tuned for Personally Identifiable Information (PII) detection in Italian text. This model identifies and classifies 54 types of sensitive information including names, addresses, social security numbers, medical record numbers, and more.
Key Features
Italian-Optimized: Specifically trained on Italian text for optimal performance
High Accuracy: Achieves strong F1 scores across diverse PII categories
Comprehensive Coverage: Detects 55+ entity types spanning personal, financial, medical, and contact information
Privacy-Focused: Designed for de-identification and compliance with GDPR and other privacy regulations
Production-Ready: Optimized for real-world text processing pipelines
Performance
Evaluated on the Italian subset of AI4Privacy dataset:
This model detects 54 PII entity types organized into categories:
Identifiers (22 types)
Entity
Description
ACCOUNTNAME
Accountname
BANKACCOUNT
Bankaccount
BIC
Bic
BITCOINADDRESS
Bitcoinaddress
CREDITCARD
Creditcard
CREDITCARDISSUER
Creditcardissuer
CVV
Cvv
ETHEREUMADDRESS
Ethereumaddress
IBAN
Iban
IMEI
Imei
...
and 12 more
Personal Info (11 types)
Entity
Description
AGE
Age
DATEOFBIRTH
Dateofbirth
EYECOLOR
Eyecolor
FIRSTNAME
Firstname
GENDER
Gender
HEIGHT
Height
LASTNAME
Lastname
MIDDLENAME
Middlename
OCCUPATION
Occupation
PREFIX
Prefix
...
and 1 more
Contact Info (2 types)
Entity
Description
EMAIL
Email
PHONE
Phone
Location (9 types)
Entity
Description
BUILDINGNUMBER
Buildingnumber
CITY
City
COUNTY
County
GPSCOORDINATES
Gpscoordinates
ORDINALDIRECTION
Ordinaldirection
SECONDARYADDRESS
Secondaryaddress
STATE
State
STREET
Street
ZIPCODE
Zipcode
Organization (3 types)
Entity
Description
JOBDEPARTMENT
Jobdepartment
JOBTITLE
Jobtitle
ORGANIZATION
Organization
Financial (5 types)
Entity
Description
AMOUNT
Amount
CURRENCY
Currency
CURRENCYCODE
Currencycode
CURRENCYNAME
Currencyname
CURRENCYSYMBOL
Currencysymbol
Temporal (2 types)
Entity
Description
DATE
Date
TIME
Time
Usage
Quick Start
from transformers import pipeline
# Load the PII detection pipeline
ner = pipeline("ner", model="OpenMed/OpenMed-PII-Italian-ClinicalLongformer-149M-v1", aggregation_strategy="simple")
text = """Paziente Marco Bianchi (nato il 15/03/1985, CF: BNCMRC85C15H501Z) è stato visitato oggi.Contatto: marco.bianchi@email.it, Telefono: +39 333 123 4567.Indirizzo: Via Garibaldi 42, 20121 Milano."""
entities = ner(text)
for entity in entities:
print(f"{entity['entity_group']}: {entity['word']} (score: {entity['score']:.3f})")
De-identification Example
defredact_pii(text, entities, placeholder='[REDACTED]'):
"""Replace detected PII with placeholders."""# Sort entities by start position (descending) to preserve offsets
sorted_entities = sorted(entities, key=lambda x: x['start'], reverse=True)
redacted = text
for ent in sorted_entities:
redacted = redacted[:ent['start']] + f"[{ent['entity_group']}]" + redacted[ent['end']:]
return redacted
# Apply de-identification
redacted_text = redact_pii(text, entities)
print(redacted_text)
Batch Processing
from transformers import AutoModelForTokenClassification, AutoTokenizer
import torch
model_name = "OpenMed/OpenMed-PII-Italian-ClinicalLongformer-149M-v1"
model = AutoModelForTokenClassification.from_pretrained(model_name)
tokenizer = AutoTokenizer.from_pretrained(model_name)
texts = [
"Paziente Marco Bianchi (nato il 15/03/1985, CF: BNCMRC85C15H501Z) è stato visitato oggi.",
"Contatto: marco.bianchi@email.it, Telefono: +39 333 123 4567.",
]
inputs = tokenizer(texts, return_tensors='pt', padding=True, truncation=True)
with torch.no_grad():
outputs = model(**inputs)
predictions = torch.argmax(outputs.logits, dim=-1)
