How is language/multilinguality represented in Byte Latent Transformer?
Ruochen Zhang
· Brown University
Frederikus Hudi
· NAIST
Probing what latent patches in Byte Latent Transformers encode, and whether byte-level models build more language-agnostic linguistic hierarchies.