Why Powerful ML Is Deceptively Easy — Part 2

为什么强大的机器学习模型往往“虚假地”易于构建 — 第二部分

The next leakage problem is not only temporal. It is spatial, structural, and coverage-related. 下一个数据泄露问题不仅存在于时间维度，还存在于空间、结构和覆盖范围层面。

The first part of this discussion [1] examined how powerful machine learning can look deceptively convincing when the evaluation setup is flawed. However, in spatial prediction problems, such as real estate applications involving capital gains estimation, rent forecasting, or price prediction, the problem does not end with fixing temporal leakage. Even when time is handled correctly, models can still appear far better than they really are if spatial dependence, repeated-asset structures, and uneven regional coverage are ignored. 本系列的第一部分 [1] 探讨了当评估设置存在缺陷时，强大的机器学习模型如何显得具有欺骗性的说服力。然而，在空间预测问题中（例如涉及资本利得估算、租金预测或价格预测的房地产应用），问题并不会随着修复时间泄露而结束。即使时间维度处理得当，如果忽略了空间依赖性、重复资产结构和不均匀的区域覆盖，模型看起来仍然可能远比其实际表现要好。

In these settings, the hardest part is often not fitting a flexible model, but designing an evaluation framework that tells us whether the model truly generalizes beyond the neighborhoods, asset types, and market segments it has already seen. 在这些场景中，最困难的部分往往不是拟合一个灵活的模型，而是设计一个评估框架，以判断模型是否真正具备了超越其已见过的社区、资产类型和细分市场之外的泛化能力。

Spatial data increasingly plays an important role in guiding sustainable initiatives. Geographic information can be used not only to assess real estate values, but also to evaluate territorial vulnerability for urban planning and infrastructure investment, optimize logistics and mobility services, improve accessibility, and estimate insurance risk to help prevent major disaster losses, among other applications. In these contexts, geography is not just another feature, it shapes the operational and economic environment in which outcomes are generated. 空间数据在指导可持续发展倡议中发挥着越来越重要的作用。地理信息不仅可用于评估房地产价值，还可用于评估城市规划和基础设施投资中的区域脆弱性、优化物流和交通服务、改善可达性，以及估算保险风险以帮助预防重大灾害损失等。在这些背景下，地理位置不仅仅是另一个特征，它塑造了结果产生的运营和经济环境。

Spatial data it is not organized like ordinary independent rows. It comes with geometry, proximity, adjacency, and dependence. Nearby places often behave more similarly than distant ones, an idea commonly summarized by Tobler’s first law of geography: everything is related to everything else, but near things are more related than distant things [2]. 空间数据不像普通的独立行数据那样组织。它带有几何、邻近性、邻接性和依赖性。邻近的地方往往比遥远的地方表现出更强的相似性，这一观点通常被总结为托布勒地理学第一定律：万物皆相关，但近处的事物比远处的事物相关性更强 [2]。

So, in these cases the modeling problem changes. Training and test samples are no longer independent, repeated geographic units can make forecasting look easier than true generalization, and uneven coverage can make a model appear reliable only because it is being judged on dense, well-observed areas. Even though, in practice, AutoML and code agents [3, 4] can now automate most parts of the workflow, the hardest parts remain human: understanding how spatial dependence, panel structure, and coverage shape the credibility of the results. 因此，在这些情况下，建模问题发生了变化。训练样本和测试样本不再独立；重复的地理单元可能使预测看起来比真正的泛化更容易；而不均匀的覆盖范围可能使模型看起来可靠，仅仅是因为它是在数据密集、观测充分的区域上进行评估的。尽管在实践中，AutoML 和代码智能体 [3, 4] 现在可以自动化工作流程的大部分环节，但最困难的部分仍然在于人类：理解空间依赖性、面板结构和覆盖范围如何塑造结果的可信度。

The Spatial Traps

空间陷阱

In summary, the goal of this article is to offer practical guidance on the most common methodological problems that make models appear more generalizable than they really are: 总之，本文旨在就最常见的方法论问题提供实用指导，这些问题往往使模型看起来比实际更具泛化能力：

• The Proximity and Persistence Trap: a model may appear to perform well on new data when it is actually benefiting from spatial proximity, temporal persistence, or familiar market conditions already presented in the data. This affects training, cross-validation, and parameter tuning procedures that rely on the assumption of independence. 邻近与持久性陷阱： 当模型实际上受益于空间邻近性、时间持久性或数据中已有的熟悉市场条件时，它在处理新数据时可能表现良好。这会影响依赖于独立性假设的训练、交叉验证和参数调整过程。
• The Coverage Illusion: when overall performance is driven by large, dense, and well-observed areas, while sparsely covered regions remain poorly understood and weakly predicted. 覆盖幻觉： 当整体性能由大型、密集且观测充分的区域驱动，而稀疏覆盖的区域仍然难以理解且预测效果较差时。
• The Boundary Illusion: when model quality depends heavily on how geography is partitioned, grouped, or coded, even though those boundaries are often administrative conveniences rather than economic realities. 边界幻觉： 当模型质量严重依赖于地理位置的划分、分组或编码方式时，尽管这些边界往往只是行政上的便利，而非经济现实。
• Geographical bias: spatial variables may appear highly predictive while quietly encoding deprivation, unequal access to opportunity, or long-standing patterns of segregation, which can lead models to reinforce exclusionary outcomes even when protected attributes are not explicitly included. 地理偏见： 空间变量可能看起来具有很强的预测性，但却悄悄地编码了贫困、机会获取不平等或长期存在的隔离模式，这可能导致模型强化排他性结果，即使模型中并未明确包含受保护的属性。
• The Hedonic Oversimplification: when visible property attributes are treated as if they were enough to explain value. In housing valuation, features such as balconies, terraces, amenities, size, or accessibility may capture useful price signals, but they do not fully explain the market. Scarcity, regulation, credit conditions, income, employment, and supply limitations can dominate individual preferences, especially in constrained markets. 享乐主义过度简化： 当可见的房产属性被视为足以解释价值时。在住房估值中，阳台、露台、配套设施、面积或可达性等特征可能捕捉到有用的价格信号，但它们并不能完全解释市场。稀缺性、监管、信贷条件、收入、就业和供应限制可能主导个人偏好，尤其是在受限市场中。
• The Silent Maintenance Tax: when the excitement of a promising model hides the long-term burden of monitoring, validating, updating, evolving, and defending it once it faces real market conditions. 隐性维护税： 当一个有前景的模型带来的兴奋感掩盖了其在面对真实市场条件时，在监控、验证、更新、演进和维护方面所需的长期负担。

As spatial data becomes increasingly valuable in many applications, this article aims to list some of the problems that can arise in this type of setting. This is not intended to be an exhaustive list. For a more comprehensive review of ML pitfalls across different problem settings, see [5]; for a broader discussion of related modeling issues beyond this specific context, see a previous article [1]. 随着空间数据在许多应用中变得越来越有价值，本文旨在列出在此类环境中可能出现的一些问题。这并非详尽无遗的列表。有关不同问题设置中机器学习陷阱的更全面回顾，请参阅 [5]；有关超出此特定背景的相关建模问题的更广泛讨论，请参阅前一篇文章 [1]。

Proximity and persistence trap

邻近与持久性陷阱

A good model should not only perform well; it should improve on the structure that is already present in the data. In other words, it should beat the right baseline. In spatial problems, this means that a meaningful baseline should capture at least two basic mechanisms already suggested by Tobler’s argument: persistence, where the future tends to resemble the past, and spatial autocorrelation, where nearby places tend to behave more similarly than distant ones. 一个好的模型不仅应该表现良好，还应该在数据中已有的结构基础上有所改进。换句话说，它应该击败正确的基准。在空间问题中，这意味着一个有意义的基准至少应该捕捉到托布勒论点中提到的两个基本机制：持久性（未来往往与过去相似）和空间自相关（邻近的地方往往比遥远的地方表现出更强的相似性）。

For real estate, rent, or capital gain prediction, this means that a model can appear strong simply because expensive areas tend to remain expensive, dense markets remain dense, and nearby assets share similar economic and spatial conditions. In this case, a weak baseline, such as predicting the global mean, may make a model look impressive even when it is only exploiting basic spatial memory. More meaningful baselines should capture what is available, such as the previous value of the same area, the historical average of a neighborhood, the average value of nearby properties, a seasonal naive forecast. 对于房地产、租金或资本利得预测，这意味着模型可能仅仅因为昂贵的区域往往保持昂贵、密集市场保持密集、以及邻近资产共享相似的经济和空间条件而显得强大。在这种情况下，一个较弱的基准（例如预测全局平均值）可能会使模型看起来令人印象深刻，即使它只是在利用基本的空间记忆。更有意义的基准应该捕捉到可用的信息，例如同一区域的先前值、社区的历史平均值、附近房产的平均值或季节性朴素预测。