DANTINOX: A Unified Framework for Multi-Paradigm Language Modeling

DANTINOX: A Unified Framework for Multi-Paradigm Language Modeling

DANTINOX:用于多范式语言建模的统一框架

Abstract: Language generation research increasingly spans three paradigms: autoregressive decoding, discrete masked diffusion, and continuous flow-matching. Comparing them is difficult because each lives in a separate codebase, so measured differences often reflect implementation details rather than the paradigms themselves.

摘要: 语言生成研究正日益涵盖三种范式:自回归解码(autoregressive decoding)、离散掩码扩散(discrete masked diffusion)以及连续流匹配(continuous flow-matching)。由于每种范式都存在于各自独立的代码库中,因此对其进行比较十分困难;所测得的差异往往反映的是实现细节,而非范式本身的特性。

We present DantinoX, an open-source JAX/Flax library in which a single modular Transformer backbone serves all three paradigms. Switching the generation paradigm, attention mechanism, or hardware topology requires only a configuration change, while the backbone architecture, tokenizer, initialization strategy, and training infrastructure remain consistent.

我们推出了 DantinoX,这是一个开源的 JAX/Flax 库,其中单一的模块化 Transformer 主干网络可支持上述所有三种范式。切换生成范式、注意力机制或硬件拓扑结构仅需更改配置,而主干架构、分词器(tokenizer)、初始化策略和训练基础设施则保持一致。

This enables controlled cross-paradigm comparisons within one API for training, streaming inference, and benchmarking.

这使得在单一 API 内进行受控的跨范式比较成为可能,涵盖了训练、流式推理和基准测试等环节。


Paper Details:

  • Authors: Marco Simoni, Aleksandar Fontana, Giulio Rossolini, Andrea Saracino
  • arXiv ID: 2609.17535
  • Subject: Computation and Language (cs.CL)
  • Submission Date: 11 Jul 2026

论文详情:

  • 作者: Marco Simoni, Aleksandar Fontana, Giulio Rossolini, Andrea Saracino
  • arXiv ID: 2609.17535
  • 学科: 计算与语言 (cs.CL)
  • 提交日期: 2026年7月11日