← Latent Space Cartography

arXiv submission

Everything needed to upload this paper to arXiv: the ready-to-submit source bundle, the compiled PDF, and the copy-ready metadata. The bundle is rebuilt automatically on every change to the paper, so the link below always serves the current source.

Download

Both files are built fresh in CI and served from this site (never committed to the repo). If a download 404s, the Pages build is still running — give it a minute and refresh.

Metadata to paste into the arXiv form

Each field below is click-to-select. These are the exact values for the arXiv submission form.

Title

A Silent Diacritic-Collapse Regression in the Ollama Runtime (mxbai-embed-large), Surfaced by Latent Space Cartography of Wikidata

Authors

Emma Leonhart (emma@topazcomputing.com)

Primary category

cs.CL — Computation and Language

Cross-list categories

cs.LG (Machine Learning), cs.IR (Information Retrieval)

Comments

AI language models were used for literature exploration and drafting assistance; experiments, results, and final text are the author's own.

License

CC BY 4.0 (recommended) — or arXiv's default non-exclusive license to distribute. Emma's call at submission time.

Abstract (ASCII, 1828 chars — fits arXiv's 1920-char limit; the PDF abstract keeps the real diacritics)

We report a previously undocumented defect in how the Ollama runtime serves mxbai-embed-large, a widely used open-source embedding model: on every release from v0.14.0 (2026-01-10) onward, diacritic-bearing input collapses into a single [UNK]-dominated attractor region, producing 147,687 cross-entity embedding pairs at cosine similarity >= 0.95. A short diacritic-bearing name has cosine 1.0 with unrelated diacritic words in other languages, but only 0.45 with its own plain-ASCII form. The failure is silent (the runtime returns a confident-looking vector, no error) and benchmark-invisible (MTEB and similar suites do not probe diacritic-rich input at scale), so any RAG, semantic search, or knowledge-graph system serving this model via an affected Ollama version has silently degraded on non-ASCII text since then. Crucially, the defect is not in the model: the identical registry blob is healthy on Ollama <= v0.13.4 (collision rate near 0, like an ASCII control), and a bisection over 21 Ollama releases localizes the regression to the v0.13.4 -> v0.14.0 runtime boundary. We found this defect not by targeted fuzzing but as a byproduct of latent space cartography: standard TransE-style relational displacement analysis applied to frozen (non-KGE) embeddings, sweeping over all predicates in a Wikidata knowledge graph reached by breadth-first traversal. Seeding from a Japanese historical text (the Engishiki) naturally reaches the romanized, diacritic-rich terminology that standard benchmarks never touch. Across three models (mxbai-embed-large, nomic-embed-text, all-minilm) the procedure identifies 30 relations that encode as consistent vector displacements in all three, and a consistency-vs-accuracy correlation (r = 0.861) reproduces across them. All code, data, and the version-bisection harness are public.

How to submit

1. Download latent-space-arxiv-source.tar.gz above.
2. On arXiv's submission form, choose "Start a new submission" and, on the file step, the "upload a single .tar.gz / .zip" option. Upload the tarball.
3. On the Select Compiler screen, keep the auto-selection: compiler pdflatex, TeX Live 2025, top-level paper.tex. All three files (paper.tex, paper.tex.body, neurips_2026.sty) should be marked Keep.
4. arXiv runs pdflatex (not pandoc — pandoc already ran when the bundle was built) and produces the public PDF. Compare it against the paper.pdf above; they should match.
5. Fill the metadata fields from the section above: Title, Authors, Abstract, primary category cs.CL, cross-lists cs.LG/cs.IR, and paste the AI-disclosure line into Comments.
6. Pick the license, then submit.

What's inside, and how it builds

The full build chain is:

paper.md  ─pandoc→  paper.tex.body  ─\input→  paper.tex  ─pdflatex→  paper.pdf
                                                  ↑
                                       neurips_2026.sty

arXiv's side only runs the second half (pdflatex paper.tex against the three files in the tarball), so the bundle ships pandoc's output pre-generated. Three flat files, no nesting:

• paper.tex — the wrapper: documentclass, packages, hyperref config, the Unicode → glyph mapping (load-bearing here — the paper is about a diacritic-collapse defect, so the diacritical text must render exactly), the pandoc emission shims, title and author block, \input{paper.tex.body}.
• paper.tex.body — the entire paper body as LaTeX, produced by pandoc from paper.md on every CI run. Gitignored; generated, not committed.
• neurips_2026.sty — the official NeurIPS 2026 style file, loaded in preprint mode (named author block, no line numbers).

Reproducibility

The reproducibility artifact referenced in the paper is this repository itself (scripts under scripts/, full instructions in SKILL.md). The data is regenerable from Wikidata + Ollama (mxbai-embed-large); no model weights are vendored. You can rely on the in-paper GitHub URL, or attach a snapshot as an arXiv ancillary file.

The bundle is regenerated by the Deploy GitHub Pages workflow on every change to paper.md, paper.tex, neurips_2026.sty, or the site. The Paper PDF + arXiv source workflow builds the identical bundle as a retained Actions artifact.