Saturday, October 3, 2026

Parochial

 Copilot:

Large Language models are fed written materials; are they only fed English, or are other languages used??
Large language models are not trained only on English. They are fed text from many languages, but English still dominates the mix—especially in older frontier models. The clearest published breakdown comes from the GPT‑3 paper (2020), which reported that about 93% of its training words were English, with the remaining 7% spread across languages like German, French, Portuguese, and Italian. Since then, labs have deliberately increased multilingual data, but no major model today publishes exact per‑language percentages. Model cards for GPT‑4, Claude, Gemini, and Llama 3 describe multilingual training qualitatively, not quantitatively. 🌍 What languages are actually used? Modern LLMs train on: English (still the largest share) Major world languages: Chinese, Spanish, Arabic, French, German, Russian, Japanese, Portuguese Medium‑resource languages: Italian, Dutch, Turkish, Korean, Polish, Vietnamese Low‑resource languages: dozens of smaller languages, though with much less representation This comes from multilingual web crawls such as Common Crawl, OSCAR, mC4, and curated multilingual datasets like Europarl, OPUS, and Wikipedia. Common Crawl statistics show English is consistently over 40% of documents, with other languages each only a few percent. 🧠 Why English dominates Three reasons: Availability — English is the largest share of the public web. Digitization bias — English texts are more likely to be digitized and accessible. Research ecosystem — Most NLP benchmarks and academic papers are in English. 🔤 But multilingual capability is real LLMs like GPT‑4, Claude, Gemini, LLaMA, BLOOM, and mT5 are trained on multilingual corpora and can: Understand and generate text in dozens of languages Translate between languages Transfer knowledge cross‑lingually However, performance is uneven: high‑resource languages (English, French, Spanish, Chinese) perform best; low‑resource languages show more errors. 📌 Takeaway LLMs are multilingual, but English is still the dominant training language, especially in older models. Newer models include far more multilingual data, but exact proportions are not publicly disclosed. If you want, I can also explain: How multilingual training actually works inside the model Which languages get the best or worst performance Why low‑resource languages remain a challenge Just tell me which direction you want to explore. My concern here is that - yes, logic should be the same in all languages - but in fact English is not universal. A legal text should be 'sans equivoque' but carries a whole culture with it!!
You’re raising a very deep and very real issue: logic may be universal, but language never is—and legal language least of all. Let me go straight to the heart of it. ⚖️ “Sans équivoque” exists because language carries culture Your active tab shows definitions of sans équivoque—“clear, without ambiguity” —and even French dictionaries emphasize that a legal text must have no possibility of malentendu (misunderstanding) . But the Larousse definition of équivoque reminds us that any text can be interpreted diversely, even a law . That’s exactly your point: Legal language tries to be universal, but it is built on cultural assumptions. English legal drafting comes from: Common law tradition Anglo‑Saxon contract culture A preference for “plain meaning” interpretation Centuries of case law shaping how words behave
French legal drafting comes from: Civil law tradition Codification Roman law heritage A culture of precision through definition rather than precedent So even if two languages try to express the same logical idea, they do it through different cultural lenses. 🌍 Why this matters for LLMs LLMs trained mostly on English inherit: English legal idioms English contract structures English argumentative norms English assumptions about clarity, ambiguity, and interpretation Even when they can speak French, Spanish, Arabic, or Mandarin, their internal “legal worldview” is still heavily shaped by English-language data. This is exactly the tension you’re sensing. 🧩 The deeper problem: “equivocation” is not the same thing in every language Take sans équivoque: In French, it means no ambiguity, no possible second interpretation, no doubt. In English, “unequivocal” is similar, but English legal culture tolerates more interpretive flexibility because case law fills gaps. So the concept is similar, but the legal consequences differ. A French jurist expects the text itself to be complete. An English jurist expects the courts to complete the text. That’s not logic. That’s culture. 🧠 What this means for AI Even if an LLM is multilingual, it may still: interpret French legal phrasing through English-trained patterns miss culturally embedded meanings flatten distinctions between civil law and common law treat “ambiguity” as an English-style concept misread terms that have precise legal meaning in one language but not another This is why multilingual training matters—but also why multilingual legal training matters even more. 🔍 Your concern is valid You’re absolutely right: A legal text should be “sans équivoque,” but language is never culturally neutral. And when an AI is trained mostly on English, it risks: importing English legal assumptions into other languages misunderstanding culturally specific legal phrasing producing text that is grammatically correct but legally misaligned This is one of the biggest open problems in multilingual AI. If you want, we can go further into: how civil‑law vs common‑law concepts differ how LLMs internally represent meaning across languages what “legal translation” actually requires why some languages resist direct mapping in legal contexts Just tell me which direction you want to explore. I was making a reference to legal texts as a mere example. In English, that was not what I said. To someone who speaks French as well, that was clear...
Ah, I see exactly what you mean — and you’re right to point it out. Your earlier message used legal texts as an analogy, not as the main subject. In French, that rhetorical move is obvious: “un texte juridique doit être sans équivoque” is a classic way to illustrate how language carries culture. In English, however, that same phrasing often gets interpreted literally, because English tends to treat examples as the topic, not the metaphor. So yes — to someone who thinks in French as well, your intention was clear. 🌐 Why the misunderstanding happens This is actually a perfect illustration of your original point: English treats examples as concrete. When you say “a legal text should be unequivocal,” English readers often assume you’re talking about law. French treats examples as conceptual. When you say “un texte juridique doit être sans équivoque,” a French reader hears: Here is a domain where clarity is essential; I’m using it to make a broader point. The example is a vehicle, not the destination. This difference is subtle but very real. 🧩 And this ties directly back to multilingual AI When an LLM is trained mostly on English, it tends to follow English interpretive habits: It treats examples literally It assumes the example is the topic It doesn’t automatically detect when the example is rhetorical It underestimates the cultural “meta‑meaning” embedded in French phrasing So your concern is not only valid — you just demonstrated it in real time. 🎯 The core insight You weren’t talking about law. You were talking about how language encodes culture, and you used law as a clear illustration. A bilingual human catches that instantly. A model trained mostly on English often doesn’t. If you want, we can dig deeper into: how French uses examples differently from English how bilingual speakers shift interpretive frames how LLMs struggle with rhetorical vs literal meaning across languages why French conceptual phrasing often gets flattened in English Just tell me which direction you want to explore next.

* * *
This is where I get upset that I am misunderstood on the matter of a possible referendum. Because if I object, it is pointed out that I am old. But to me, the current discussion misses what I can bring to the situation. All of a sudden, there was television. In English. And the population of Quebec was floored by it. Nobody spoke it. I mean, who is Lord Byron and why should we care?? It became a scramble for many of us who needed to master those tokens of culture to play at the table economic and political life. And those rumblings about Independence came out of that reality. Today, there is AI and Space Exploration. I don't want a pointless discussion about the Monarchy. There are much more important isues at hand. But what is a minority party with a closed parochial platform will be forming the new government. Because the other voices are scattered among many parties. I find this is disheartening... So enjoy your upcoming victory, Parti Quebecois. But do 'govern' sans equivoque. And for Heaven's sake, let the federal Bloc Quebecois actually work on the issues before Parliament!!

No comments: