Multilingual Knowledge Transfer under Data Constraints via Lexical Interventions

Researchers introduced LINK, a method that enhances cross-lingual knowledge transfer by substituting words in English pretraining data with their translations using bilingual vocabularies. This approach requires no extra model training and improves performance on downstream tasks for low-resource languages, speeding up training by up to twice.