Patch-PODiff-ViT: Structured Latent Diffusion with Patchwise POD for Super-Resolution and Uncertainty Quantification
Abstract
Diffusion models enable probabilistic super-resolution and conditional generation, but pixel-space methods are computationally expensive and learned latent spaces often lack interpretable uncertainty quantification. We introduce Patch-PODiff-ViT, a structured latent diffusion framework in which the latent space is defined by patchwise Proper Orthogonal Decomposition (POD), a fixed linear orthonormal basis over local patches, rather than learned by a nonlinear autoencoder. This yields low-dimensional, variance-ordered tokens that preserve spatial structure and enable efficient diffusion in a structured low-dimensional latent space with a Vision Transformer. Because the decoder is fixed, linear, and orthonormal, latent coefficient uncertainty can be propagated directly to physical-space predictive variance, enabling analytic propagation of predictive variance through the linear decoder without Monte Carlo estimation in pixel space. Across sea surface temperature, medical imaging, and natural images, the method achieves strong reconstruction with fewer parameters and lower memory, while producing well-calibrated spatial uncertainty that closely matches empirical ensembles.
1 Introduction
High-resolution spatial fields arise across a wide range of applications, including climate modeling (Price et al., 2023; Watt and Mansfield, 2024; Jadhav et al., 2025), medical imaging (Moser et al., 2024), and natural image generation (Rombach et al., 2022). While modern pipelines provide coarse observations at scale, resolving fine-scale spatial structure remains computationally expensive. Super-resolution methods address this challenge (Leinonen et al., 2020; Stengel et al., 2020; Saharia et al., 2022; Leinonen et al., 2023), but accurate reconstruction alone is often insufficient. Reliable uncertainty quantification is essential for downstream decision-making, particularly in regimes with sharp gradients, localized extremes, and incomplete observations.
Diffusion-based models (Ho et al., 2020; Song et al., 2021b) provide a powerful framework for probabilistic super-resolution and conditional generation (Saharia et al., 2022), producing high-fidelity samples and enabling ensemble-based uncertainty estimation. However, operating in pixel space is computationally expensive at high resolutions, leading to large models, high memory usage, and slow sampling, which makes ensemble generation costly in practice (Ho et al., 2020).
Latent diffusion models mitigate this cost by operating in a lower-dimensional space learned via autoencoders (Rombach et al., 2022; Vahdat et al., 2021). While effective for natural images, these latent representations are typically nonlinear and lack a direct correspondence to spatial structure, making uncertainty propagation to physical-space predictive variance less interpretable (Böhm et al., 2019) and limiting their applicability in settings where structure and interpretability are important. In contrast, many spatial fields exhibit strong local structure that can be efficiently represented using linear reduced-order methods such as Proper Orthogonal Decomposition (POD) (Sirovich, 1987; Berkooz et al., 1993; Benner et al., 2015). POD yields an orthonormal, variance-ordered basis that captures dominant spatial patterns and defines a geometrically meaningful latent space, where coefficients correspond to progressively finer scales. Importantly, this structure is often more pronounced at the local level: individual patches can be represented using far fewer modes than the full field while retaining the same variance, enabling substantial compression. Such local structure is not limited to physical systems, and is often observed in medical and natural images, particularly at the patch level.
Despite its widespread use in scientific computing (Coscia et al., 2024; Du et al., 2024), POD remains underexplored as a structured latent space for diffusion-based generative modeling. Although it provides a linear and interpretable mapping between latent coefficients and spatial fields, this structure has not been fully leveraged for efficient and principled uncertainty propagation.
In this work, we introduce Patch-PODiff-ViT, an extension of PODiff (Jadhav et al., 2026), a conditional diffusion framework operating in a structured latent space defined by patchwise POD representations. Instead of learning a latent space, we construct a fixed, variance-ordered basis over local patches, yielding low-dimensional tokens that preserve spatial locality and scale separation. Diffusion is performed over these tokens using a Vision Transformer denoiser, enabling global spatial reasoning with improved efficiency. Crucially, the linear POD structure allows predictive uncertainty in latent space to be propagated analytically to the physical domain, providing a tractable and interpretable alternative to explicit full-resolution covariance estimation without additional learned components.
This formulation connects reduced-order and generative modeling, showing that structured linear representations combined with expressive denoisers enable efficient and interpretable probabilistic inference. Unlike pixel-space diffusion, it scales to high-resolution fields with lower computational cost, and unlike learned latent diffusion, it preserves a direct and tractable link between latent variables and spatial statistics.
We evaluate the method on three domains: sea surface temperature (SST) downscaling, medical image super-resolution, and natural image reconstruction. Across all datasets, Patch-PODiff-ViT achieves strong reconstruction performance with fewer parameters and lower memory than pixel-space diffusion, while producing well-calibrated, spatially meaningful uncertainty estimates that closely match empirical ensemble statistics.
Contributions.
This paper makes four contributions. (i) We introduce Patch-PODiff-ViT, a structured latent diffusion framework using patchwise POD and transformer-based denoising. (ii) We provide a theoretical foundation: Proposition 1 bounds reconstruction error under variance truncation, and Proposition 2 enables closed-form propagation of latent uncertainty to pixel space under a block-diagonal approximation. (iii) We show improved computational efficiency via a low-dimensional structured latent representation. (iv) We validate the method across geophysical, medical, and natural image datasets, achieving strong reconstruction and well-calibrated uncertainty.
2 Method
Patch-PODiff-ViT performs conditional generative modeling in a structured latent space defined by patchwise POD, reducing fields from pixels to latent tokens (Figure 1). Each image is decomposed into patches, projected onto a shared POD basis , and denoised by a Vision Transformer in token space. For super-resolution, conditioning and target fields are encoded in the same latent space. At inference, denoised coefficients are decoded linearly via and stitched to reconstruct the field, enabling analytic uncertainty propagation through the POD decoder.
2.1 Patchwise POD Representation
Let denote a set of high-resolution training fields with . Each field is decomposed into patches of size , extracted with stride , yielding
where denotes the number of patches per field. When , the patches are non-overlapping; when , they overlap. The patch size is treated as a hyperparameter, and its effect on reconstruction quality and spectral efficiency is studied in Appendix I. For single-channel datasets
We construct a global POD basis by pooling all training patches and computing the economy SVD of the centered patch matrix. The top- singular vectors form the orthonormal basis with singular values . We select the truncation level to satisfy the energy criterion
| (1) |
This choice is supported by Proposition 1, which shows that the expected reconstruction error is bounded by of the total patchwise variance. The shared patch basis keeps token dimensions fixed and improves statistical efficiency by pooling local patches.
Latent encoding.
Let denote the global patch mean. Each patch is encoded as
To normalize variance across modes, we standardize the coefficients per mode as
The POD encoder is fixed and parameter-free. In particular, no gradients pass through it during training.
2.2 Latent Diffusion over Patch Tokens
Token sequence.
We represent each field as a sequence of latent tokens
The total latent dimensionality is substantially smaller than the pixel-space dimensionality , enabling efficient diffusion over the full spatial extent of the field.
Forward process.
Training objective.
We train a denoising network to predict the injected noise:
| (3) |
where denotes the conditioning signal derived from the low-resolution input (Section 2.3), and .
2.3 Conditioning on Low-Resolution Input
For super-resolution, we upsample the low-resolution input via bicubic interpolation, , and encode it using the same patch-POD pipeline as the high-resolution fields, yielding a conditioning token sequence . Encoding both HR and LR fields in the same latent space enables the denoiser to learn a structured residual in coefficient space. Each token represents the POD coefficients of the upsampled LR patch at position , providing spatially aligned conditioning.
We apply token-wise additive conditioning by projecting noisy HR tokens and LR tokens to and combining them as
| (4) |
yielding fused tokens . Here and are learnable projection matrices in . Additive conditioning ensures token alignment and preserves locality.
2.4 Vision Transformer Denoising Architecture
The denoising network is a Vision Transformer operating on the token sequence . Tokens are augmented with 2D positional embeddings and processed by transformer blocks with multi-head self-attention, MLP layers, and timestep-conditioned Adaptive LayerNorm (Peebles and Xie, 2023). A linear head predicts noise .
2.5 Reconstruction and Uncertainty Quantification
At inference, latent tokens are sampled using DDIM (Song et al., 2021a) with steps and de-normalised to recover POD coefficients,
Each patch is then reconstructed by the linear decoder
| (5) |
The full field is assembled using a fixed linear stitching operator . We generate independent latent samples to estimate coefficient-level covariance, and then propagate this covariance through the fixed POD decoder to obtain pixel-space predictive variance. Thus, sampling is performed in the low-dimensional POD space, while spatial uncertainty is obtained through the known decoder geometry.
2.6 Theoretical Guarantees
The linear POD encoder-decoder yields two key results.
2.6.1 Proposition 1: Reconstruction Error Bound
Proposition 1 (Patchwise POD Reconstruction Error Bound).
Let random field be partitioned into non-overlapping patches . Let be the global patch mean and the POD basis retaining energy fraction . Define and let be the reconstructed field. Then
2.6.2 Proposition 2: Analytic Uncertainty Propagation
Proposition 2 (Analytic Uncertainty Propagation under Patchwise POD).
Let with . Then:
-
(i)
,
-
(ii)
for non-overlapping patches, assuming for , ,
-
(iii)
for overlapping patches, , where stacks the patch covariances.
The result follows from linearity; see Appendix B. In practice, we estimate from generated latent samples and obtain pixel-level predictive variance as at cost , without explicitly forming or storing a full pixel-space covariance matrix.
2.7 Computational Efficiency
Patch-PODiff-ViT is efficient due to (i) low-dimensional tokens (), (ii) resolution-independent tokenisation, and (iii) parameter-free POD encoding. See Section 4.5 for quantitative comparisons.
2.8 Limitations
Patch-PODiff-ViT is most effective when spatial fields exhibit low-rank local structure. For highly turbulent or discontinuous fields with slow singular value decay, more POD modes are required, increasing latent dimensionality and narrowing the efficiency gap relative to pixel-space methods. We observe this in Appendix J, where at , up to modes are needed to retain variance, compared to – in our main datasets. The POD basis is fixed after construction, so distribution shifts may require recomputation, with adaptive or online extensions left for future work. Proposition 2 uses a block-diagonal covariance approximation that neglects cross-patch terms, trading modeling fidelity for tractability. This affects only the covariance map, since the ViT still captures cross-patch dependencies during sampling, and overlapping aggregation via can partially mitigate boundary effects. Discarded-mode uncertainty is not modeled explicitly, but remains small under by Proposition 1.
3 Experimental Setup
3.1 Datasets
We evaluate on three domains: geophysical fields, medical images, and natural images. For SST, we use daily Western Australian coast fields at from ROMS (Shchepetkin and McWilliams, 2005), conditioned on ACCESS-S2 inputs at (Wedd et al., 2022) bicubically interpolated to the target grid. We train on 1998–2009 (4,000 fields), validate on 2010, and test on 2011, which includes the documented West Australian marine heatwave. Land pixels are masked and metrics are computed over ocean pixels only. For medical imaging, we use NIH ChestX-ray14 (Wang et al., 2017), resizing frontal radiographs to and following the official train/test split. For natural images, we use FFHQ (Karras et al., 2019) at with an 80/20 random split using seed 0. For X-ray and FFHQ, low-resolution inputs are produced by bicubic downsampling to followed by upsampling to before encoding.
3.2 Baselines and Implementation Details
We compare against five baselines covering deterministic, latent diffusion, pixel-space diffusion, transformer diffusion, and POD-based variants.
U-Net: A deterministic convolutional U-Net (Ronneberger et al., 2015) with a symmetric encoder–decoder, four resolution levels, base width , channel widths , skip connections, and an loss. The same architecture is used across all datasets.
VAE-LDM: A latent diffusion model following Rombach et al. (Rombach et al., 2022), with a convolutional VAE encoder of base width that compresses inputs to latent maps. The denoiser uses the same ViT configuration as Patch-PODiff-ViT, providing a controlled learned-latent baseline, although the latent dimensionalities are not identical. The VAE is trained on the same training split and selected using validation reconstruction quality before training the latent diffusion model.
DiT: A Diffusion Transformer (Peebles and Xie, 2023) operating directly on pixel patches without POD compression. It uses the same ViT configuration as Patch-PODiff-ViT, namely , , and , controlling for denoiser capacity; both methods use the same patch sequence length, while Patch-PODiff-ViT compresses each token to POD modes.
PixelDiff: A pixel-space diffusion model using the same U-Net backbone as the deterministic baseline, trained with a DDPM objective and conditioned on the bicubically upsampled LR input via channel concatenation, following the residual diffusion paradigm of CorrDiff Mardani et al. (2025).
Fullfield-PODiff: A non-patchwise POD baseline using a single full-field POD basis, with selected by the same criterion, isolating the contribution of patchwise structure.
All diffusion models use a cosine noise schedule with training timesteps, inference steps, and ensemble samples for uncertainty. Models are trained with AdamW at learning rate using identical preprocessing and hardware. Hyperparameters are selected on validation splits and fixed for test evaluation. Standard deviations are reported in Appendix D.
Patch-PODiff-ViT Implementation Details: The POD basis is computed from training patches at . The ViT denoiser uses , , heads, and MLP ratio (M parameters), and is trained for 1M steps with batch size 64, AdamW (lr, weight decay ), gradient clipping 1.0, and EMA 0.9995. We use a cosine schedule () and DDIM sampling () at inference. Uncertainty estimates use ensemble members unless stated otherwise. The default patch size and resulting values are reported alongside the main results. Patch size sensitivity is in Appendix I. All models trained on AMD Instinct MI250X GPUs.
3.3 Evaluation Metrics
We evaluate reconstruction using RMSE, PSNR, SSIM (Wang et al., 2004), LPIPS (Zhang et al., 2018), and FID (Heusel et al., 2017). Uncertainty is assessed with CRPS (Gneiting and Raftery, 2007), MACE, and empirical coverage at nominal levels using samples, with SST UQ computed over all 365 test days in 2011. Efficiency is measured by parameter count, peak GPU memory, training time, per-sample inference time, and ensemble inference time. All models use identical preprocessing: SST is min–max normalized over training ocean pixels with land masked out, while Chest X-ray and FFHQ are scaled to , with LPIPS and FID using the required pretrained-network input ranges.
4 Results
We evaluate Patch-PODiff-ViT using reconstruction accuracy, theoretical bound validation, uncertainty quantification, computational efficiency, and downstream SST ensemble forecasting. The experiments test three claims: patchwise POD provides a compact but spatially structured latent space; the fixed linear decoder enables accurate propagation of latent uncertainty to pixel-space variance; and the efficiency advantage is largest when local patch spectra decay rapidly. Unless stated otherwise, all results use patches, energy threshold, and ensemble members. Ensemble size sensitivity is examined in Appendix I.4.
4.1 Reconstruction Accuracy
| Metric | Patch-PODiff-ViT | VAE-LDM | DiT | PixelDiff | U-Net | Fullfield-PODiff |
|---|---|---|---|---|---|---|
| SST (Sea Surface Temperature) | ||||||
| RMSE | ||||||
| PSNR | ||||||
| SSIM | ||||||
| LPIPS | ||||||
| FID | ||||||
| Chest X-ray | ||||||
| RMSE | ||||||
| PSNR | ||||||
| SSIM | ||||||
| LPIPS | ||||||
| FID | ||||||
| FFHQ (Face Images) | ||||||
| RMSE | ||||||
| PSNR | ||||||
| SSIM | ||||||
| LPIPS | ||||||
| FID | ||||||
Table 1 shows that Patch-PODiff-ViT achieves consistently strong reconstruction performance across all datasets, with the best result on most reported metrics. Among diffusion baselines, DiT is the strongest competitor, suggesting that the gains arise not only from the transformer denoiser but also from the structured POD latent space. Appendix I.5 confirms that variance-ordered compression, not linear structure alone, drives these gains. Additionally, since VAE-LDM uses the same denoiser configuration, these gains suggest that the structured POD latent representation is advantageous in these settings, though the comparison does not fully equalize latent dimensionality. Figure 2 shows qualitative results across all three domains. Patch-PODiff-ViT consistently preserves large-scale structure and fine-scale detail, including fronts in SST, anatomical boundaries in Chest X-ray, and texture in FFHQ, while competing methods exhibit smoothing or local distortions near sharp gradients. This trend is reflected quantitatively in Table 1 and further supported by extended comparisons in Appendix E.
Fullfield-PODiff further ablates patchwise structure: despite using a POD latent space, its FID is consistently worse than Patch-PODiff-ViT. This suggests that local patchwise POD, rather than POD compression alone, drives the improvement. The U-Net underperforms all diffusion baselines across perceptual metrics, consistent with the known limitations of deterministic regression for high-frequency detail recovery.
4.2 Validation of the POD Reconstruction Bound
We empirically validate the retained-energy reconstruction bound in Appendix C. Across all datasets, mean empirical POD errors remain below the expected bound; the above-97% sample-wise satisfaction rates are only empirical diagnostics. This confirms that the retained-energy criterion in Eq. (1) provides reliable control of patchwise reconstruction error in the settings considered.
4.3 Uncertainty Quantification
Uncertainty quantification is a central component of the proposed method. We evaluate it along three axes: (i) validity of analytic propagation (Proposition 2), (ii) calibration of predictive intervals, and (iii) sharpness of the predictive distribution.
Analytic vs. empirical uncertainty:
Figure 3 evaluates the covariance propagation step in Proposition 2 by comparing pixel-wise standard deviation maps obtained from with empirical standard deviation maps computed from decoded samples. The two agree closely on SST (), with similar correlations on Chest X-ray () and FFHQ (). Additional maps are provided in Appendix G. Including covariance estimation, analytic propagation costs and avoids explicitly forming full pixel-space covariance estimates. Appendix H further supports the block-diagonal covariance approximation: off-diagonal cross-patch covariance is small for SST and Chest X-ray and moderate for FFHQ, consistent with the mild patch-boundary effects observed on natural images. Spatially, uncertainty concentrates near SST coastlines and thermal fronts, X-ray lung boundaries and rib edges, and FFHQ features such as eyes and hair.
Calibration and Sharpness: Figure 4 shows that Patch-PODiff-ViT closely follows the ideal calibration line across datasets and nominal levels. It achieves the lowest MACE, with on SST, on Chest X-ray, and on FFHQ, while DiT and VAE-LDM show larger deviations. For sharpness, Patch-PODiff-ViT obtains the lowest CRPS on SST and Chest X-ray. On FFHQ, VAE-LDM attains lower CRPS but higher MACE, indicating a sharper but less calibrated predictive distribution. Full coverage and CRPS values are provided in Appendix F.
Together, these results show that Patch-PODiff-ViT produces uncertainty estimates that are both accurate and well calibrated. The POD-based analytic propagation enables efficient uncertainty estimation, while maintaining competitive calibration and sharpness across diverse domains.
4.4 Downstream Application: Spatial Uncertainty for Ensemble Forecasting
Figure 5 illustrates Patch-PODiff-ViT on a representative day from the 2011 West Australian marine heatwave. The ensemble mean recovers the large-scale warm water mass, sharp meridional gradient, and coastal fine-scale structure, while the predictive standard deviation highlights higher uncertainty near coastlines and strong thermal gradients. From an application perspective, the model provides both a high-resolution estimate and a spatial confidence map, helping identify regions that require greater caution.
4.5 Computational Efficiency
| Model | Params (M) | Train (hrs) | GPU Mem (GB) | Inference (s) | (s) |
|---|---|---|---|---|---|
| Patch-PODiff-ViT | 70 | 8.7 | 8.6 | 0.109 | 11.036 |
| VAE-LDM | 220 | 30.6 | 16.1 | 0.255 | 26.038 |
| DiT | 75 | 10.2 | 9.2 | 0.112 | 11.855 |
| PixelDiff | 160 | 26.8 | 12.3 | 1.800 | 189.530 |
Table 2 compares computational cost. Patch-PODiff-ViT uses 70M parameters and trains in 8.7 h, compared with 220M and 30.6 h for VAE-LDM. It also reduces peak memory from 16.1 GB to 8.6 GB and generates an ensemble in 11.036 s, compared with 26.038 s for VAE-LDM and 189.530 s for PixelDiff. DiT has similar sampling time due to the matched transformer backbone, but Patch-PODiff-ViT achieves better reconstruction and calibration through POD-compressed tokens.
Additional ablations on patch size and denoiser architecture are provided in Appendix I, showing that performs best among the tested patch sizes and that ViT self-attention is critical, as replacing the ViT with a per-token MLP substantially degrades performance (FID 3.986 to 12.59).
References
- [1] (2015) A survey of projection-based model reduction methods for parametric dynamical systems. SIAM Review 57 (4), pp. 483–531. Cited by: §1.
- [2] (1993) The proper orthogonal decomposition in the analysis of turbulent flows. Annual review of fluid mechanics 25 (1), pp. 539–575. Cited by: §1.
- [3] (2019) Uncertainty quantification with generative models. arXiv preprint arXiv:1910.10046. Cited by: §1.
- [4] (2024) Generative adversarial reduced order modelling. Scientific Reports 14 (1), pp. 3826. Cited by: §1.
- [5] (2024) Conditional neural field latent diffusion model for generating spatiotemporal turbulence. Nature Communications 15 (1), pp. 10416. Cited by: §1.
- [6] (2007) Strictly proper scoring rules, prediction, and estimation. Journal of the American Statistical Association 102 (477), pp. 359–378. Cited by: §3.3.
- [7] (2017) GANs trained by a two time-scale update rule converge to a local Nash equilibrium. In Advances in Neural Information Processing Systems, Vol. 30. Cited by: §3.3.
- [8] (2020) Denoising diffusion probabilistic models. Advances in neural information processing systems 33, pp. 6840–6851. Cited by: §1, §2.2.
- [9] (2025) Deep learning-based statistical downscaling of sea surface temperature using a residual corrective neural network. ESS Open Archive 2025 (0813), pp. . External Links: Document, Link, https://essopenarchive.org/doi/pdf/10.22541/essoar.175510661.11731470/v1 Cited by: §1.
- [10] (2026) PODiff: latent diffusion in proper orthogonal decomposition space for scientific super-resolution. arXiv preprint arXiv:2605.03399. Cited by: §1.
- [11] (2019) A style-based generator architecture for generative adversarial networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4401–4410. Cited by: §3.1.
- [12] (2023) Latent diffusion models for generative precipitation nowcasting with accurate uncertainty quantification. arXiv preprint arXiv:2304.12891. Cited by: §1.
- [13] (2020) Stochastic super-resolution for downscaling time-evolving atmospheric fields with a generative adversarial network. IEEE Transactions on Geoscience and Remote Sensing 59 (9), pp. 7211–7223. Cited by: §1.
- [14] (2025) Residual corrective diffusion modeling for km-scale atmospheric downscaling. Communications Earth & Environment 6 (1), pp. 124. Cited by: §3.2.
- [15] (2024) Diffusion models, image super-resolution, and everything: a survey. IEEE Transactions on Neural Networks and Learning Systems. Cited by: §1.
- [16] (2021) Improved denoising diffusion probabilistic models. In International conference on machine learning, pp. 8162–8171. Cited by: §2.2.
- [17] (2023) Scalable diffusion models with transformers. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 4195–4205. Cited by: §2.4, §3.2.
- [18] (2023) Gencast: diffusion-based ensemble forecasting for medium-range weather. arXiv preprint arXiv:2312.15796. Cited by: §1.
- [19] (2022) High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 10684–10695. Cited by: §1, §1, §3.2.
- [20] (2015) U-net: convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention, pp. 234–241. Cited by: §3.2.
- [21] (2022) Image super-resolution via iterative refinement. IEEE transactions on pattern analysis and machine intelligence 45 (4), pp. 4713–4726. Cited by: §1, §1.
- [22] (2005) The regional oceanic modeling system (ROMS): a split-explicit, free-surface, topography-following-coordinate oceanic model. Ocean Modelling 9 (4), pp. 347–404. Cited by: §3.1.
- [23] (1987) Turbulence and the dynamics of coherent structures. I. coherent structures. Quarterly of applied mathematics 45 (3), pp. 561–571. Cited by: §1.
- [24] (2021) Denoising diffusion implicit models. In International Conference on Learning Representations, External Links: Link Cited by: §2.5.
- [25] (2021) Score-based generative modeling through stochastic differential equations. In International Conference on Learning Representations, External Links: Link Cited by: §1.
- [26] (2020) Adversarial super-resolution of climatological wind and solar data. Proceedings of the National Academy of Sciences 117 (29), pp. 16805–16815. Cited by: §1.
- [27] (2021) Score-based generative modeling in latent space. Advances in neural information processing systems 34, pp. 11287–11302. Cited by: §1.
- [28] (2017) ChestX-ray8: hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2097–2106. Cited by: §3.1.
- [29] (2004) Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing 13 (4), pp. 600–612. Cited by: §3.3.
- [30] (2024) Generative diffusion-based downscaling for climate. arXiv preprint arXiv:2404.17752. Cited by: §1.
- [31] (2022) ACCESS-S2: the upgraded bureau of meteorology multi-week to seasonal prediction system. Journal of Southern Hemisphere Earth Systems Science 72 (3), pp. 218–242. Cited by: §3.1.
- [32] (2018) The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 586–595. Cited by: §3.3.
Appendix A Proposition 1 Proof
Proposition 1 (Patchwise POD Reconstruction Error Bound).
Let random field be partitioned into non-overlapping patches , where each patch and .
Let be the global patch mean and the shared POD basis formed by the top- eigenvectors of the pooled patch covariance, with corresponding eigenvalues
Assume the retained modes satisfy
Define the patchwise POD reconstruction
and let be the global reconstruction obtained by reassembling the reconstructed patches. Then
Proof.
Because the patches are non-overlapping,
Taking expectations gives
For each patch , define the centered patch . Then
and therefore
Since is constructed from the pooled patch covariance, the POD projection identity applies to the pooled patch distribution:
Using the retained-energy assumption,
The total variance of the pooled centered patches is
Combining the previous two equations gives
Multiplying both sides by yields
Finally, using the non-overlapping patch decomposition,
This completes the proof. ∎
Remark 1.
If , then the expected reconstruction error under the pooled patch distribution is at most of the total pooled patch variance. Equivalently, for a non-overlapping reconstruction, the expected global reconstruction error is bounded by of the sum of patchwise variances.
Appendix B Proposition 2 Proof
Proposition 2 (Analytic Uncertainty Propagation under Patchwise POD).
Let an input field be represented by patches. For each patch , let the reconstruction be
where is the global patch mean, is the shared retained POD basis, and is a random latent coefficient vector with covariance .
Then the following hold:
-
(i)
Patch-level covariance. The covariance of the reconstructed patch is
-
(ii)
Non-overlapping patch assembly. Suppose patches are reassembled without overlap into . If the latent variables are mutually uncorrelated across distinct patches, i.e. for , then the global covariance is block-diagonal:
-
(iii)
Overlapping patches with linear aggregation. Suppose overlapping reconstructed patches are concatenated into , and the final field is obtained by a fixed linear operator : . If patch latents are mutually uncorrelated across patches, then
and the global covariance is
Proof.
The result follows from linear covariance propagation. For each patch, . Since is deterministic,
proving part (i).
Parts (ii) and (iii) follow by writing the global reconstruction as either a concatenation (non-overlapping case) or a linear transformation via (overlapping case), and applying the identity , together with the assumption that cross-patch covariances vanish. ∎
Remark 2 (Practical significance).
Proposition 2 shows that uncertainty propagation through the patchwise POD decoder is analytically tractable due to its linear structure. Unlike nonlinear decoders (e.g., VAEs or diffusion models in pixel space), no Jacobian linearisation or Monte Carlo backpropagation is required.
Remark 3 (Empirical covariance estimation).
In practice, is estimated from sampled latent realisations using the empirical covariance
The plug-in estimator is then used to construct analytic uncertainty maps.
Corollary 1 (Pointwise predictive variance).
Under Proposition 2, the predictive variance at within-patch pixel index in patch is . In the overlapping case, for global pixel index , .
Appendix C POD Basis Analysis
C.1 Singular Value Decay and Compression
Figure 6 shows the cumulative retained energy of the patchwise POD basis across datasets. The shaded bands indicate variation across patches, and the dashed line marks the energy threshold used in the main experiments.
The required number of modes varies noticeably: for SST, for Chest X-ray, and for FFHQ. This reflects increasing local complexity from smooth geophysical fields to anatomical structure and natural image texture. The ordering also explains the observed compression trends: datasets with faster spectral decay allow stronger dimensionality reduction, while more complex datasets require larger latent dimensions to preserve fine-scale structure.
C.2 POD Mode Statistics
Table 3 reports the mean, median, and maximum number of POD modes needed to retain and variance across patches. The median values match those used in the main experiments, showing that the selected latent dimensions are representative. SST and Chest X-ray show small mean–median gaps, indicating uniform spectral decay, while FFHQ shows a mild tail of slower-decaying patches due to higher texture variability. Overall, the statistics support a shared patchwise POD basis whose dimensionality remains stable within each dataset while adapting to domain complexity.
| Dataset | Mean | Median | Max | Mean | Median | Max |
|---|---|---|---|---|---|---|
| SST | 1.005 | 1 | 2 | 1.594 | 2 | 3 |
| ChestX-ray | 3.078 | 3 | 4 | 11.551 | 11 | 13 |
| FFHQ | 5.195 | 5 | 8 | 26.875 | 26 | 32 |
C.3 Validation of the POD Reconstruction Bound
We validate the reconstruction error bound in Proposition 1 by comparing the empirical POD reconstruction error with the theoretical bound for each dataset. Table 4 shows that the mean empirical POD reconstruction error stays below the expected bound for all datasets, with ratios of 0.94–0.98; sample-wise satisfaction is reported as an empirical diagnostic, not as a deterministic guarantee. This supports the retained-energy criterion in Eq. 1 as a reliable control on patchwise reconstruction error.
| Dataset | Bound | Actual Error | Ratio | % Satisfying |
|---|---|---|---|---|
| SST | 2.6075 | 2.4800 | 0.9810 | 99.75 |
| X-ray | 2.6521 | 2.5980 | 0.9511 | 98.95 |
| FFHQ | 23.6347 | 23.1856 | 0.9796 | 97.62 |
Appendix D Extended Reconstruction Results
Table 5 extends Table 1 by reporting mean standard deviation across three seed runs for RMSE, PSNR, SSIM, and LPIPS across all models and datasets. FID is reported once per dataset, since it is a distribution-level metric rather than a per-sample statistic.
| Metric | Patch-PODiff-ViT | VAE-LDM | DiT | PixelDiff | U-Net | Fullfield-PODiff |
|---|---|---|---|---|---|---|
| SST (Sea Surface Temperature) | ||||||
| RMSE | ||||||
| PSNR | ||||||
| SSIM | ||||||
| LPIPS | ||||||
| FID | ||||||
| Chest X-ray | ||||||
| RMSE | ||||||
| PSNR | ||||||
| SSIM | ||||||
| LPIPS | ||||||
| FID | ||||||
| FFHQ (Face Images) | ||||||
| RMSE | ||||||
| PSNR | ||||||
| SSIM | ||||||
| LPIPS | ||||||
| FID | ||||||
Appendix E Qualitative Comparisons
Figures 7, 8, and 9 present extended qualitative super-resolution results for SST, Chest X-ray, and FFHQ respectively, complementing the three-domain overview in Figure 2. The SST figure shows one representative scene; the X-ray and FFHQ figures each show two scenes. All include full reconstructions, zoomed regions of interest, and corresponding error maps, consistent with the quantitative trends reported in Section 4.1.
On SST (Figure 7), the low-resolution input and U-Net baseline fail to recover fine-scale thermal fronts, particularly in the zoomed coastal region. PixelDiff and VAE-LDM partially recover large-scale structure but exhibit smoothing near sharp meridional gradients. Patch-PODiff-ViT produces the lowest error, preserving both the large-scale warm water mass and fine-scale frontal structure in the zoomed region.
On Chest X-ray (Figure 8), the low-resolution input and U-Net baseline exhibit higher reconstruction errors than diffusion-based methods, particularly along rib edges and lung boundaries. PixelDiff and VAE-LDM reduce these errors but introduce noticeable smoothing of anatomical structures. In contrast, Patch-PODiff-ViT produces sharper boundaries and more accurate structural detail, with consistently lower error in both global views and zoomed regions.
On FFHQ (Figure 9), baseline methods tend to smooth or distort high-frequency textures, especially in regions such as hair and eyes. Patch-PODiff-ViT better preserves fine-scale detail, resulting in more faithful reconstructions and reduced error in high-detail regions, as seen in the zoomed panels.
Appendix F Coverage and Calibration Details
F.1 CRPS and MACE Summary
Table 6 reports CRPS and MACE for all models using ensemble samples, with SST averaged over all 2011 test days. Patch-PODiff-ViT achieves the lowest CRPS on SST and Chest X-ray, indicating sharper predictive distributions in these domains. On FFHQ, VAE-LDM attains a lower CRPS () than Patch-PODiff-ViT (), but this comes with a higher MACE ( vs. ), indicating improved sharpness at the cost of reduced calibration. Across all datasets, Patch-PODiff-ViT consistently achieves the lowest MACE, demonstrating better calibration of predictive uncertainty.
| SST | Chest X-ray | FFHQ | ||||
|---|---|---|---|---|---|---|
| Model | CRPS | MACE | CRPS | MACE | CRPS | MACE |
| Patch-PODiff-ViT | 0.0080 | 0.0046 | 0.0084 | |||
| DiT | 0.0216 | 0.0099 | 0.0143 | |||
| VAE-LDM | 0.0159 | 0.0114 | 0.0121 | |||
| PixelDiff | 0.0193 | 0.0206 | 0.0281 | |||
F.2 Full Coverage Tables
Tables 7–9 report empirical coverage at nominal levels for all models across SST, Chest X-ray, and FFHQ. For each level, we report the empirical coverage along with the deviation , where positive values indicate over-coverage and negative values indicate under-coverage. Across all datasets, Patch-PODiff-ViT exhibits the smallest deviations from nominal coverage, indicating consistently well-calibrated uncertainty estimates. In contrast, DiT and VAE-LDM tend to show moderate over- or under-coverage depending on the dataset, while PixelDiff exhibits larger deviations, particularly at higher confidence levels.
| Patch-PODiff-ViT | DiT | VAE-LDM | PixelDiff | |||||
|---|---|---|---|---|---|---|---|---|
| Nominal | Empirical | Empirical | Empirical | Empirical | ||||
| 50% | 0.4882 | 0.4662 | 0.4645 | 0.4918 | ||||
| 60% | 0.5804 | 0.5700 | 0.5690 | 0.5952 | ||||
| 70% | 0.7058 | 0.7176 | 0.6928 | 0.6808 | ||||
| 80% | 0.8058 | 0.8226 | 0.8139 | 0.8022 | ||||
| 90% | 0.8999 | 0.8883 | 0.8905 | 0.9085 | ||||
| 95% | 0.9510 | 0.9370 | 0.9617 | 0.9150 | ||||
| 99% | 0.9918 | 0.9726 | 0.9878 | 0.9326 | ||||
| Patch-PODiff-ViT | DiT | VAE-LDM | PixelDiff | |||||
|---|---|---|---|---|---|---|---|---|
| Nominal | Empirical | Empirical | Empirical | Empirical | ||||
| 50% | 0.5089 | 0.5171 | 0.5169 | 0.5001 | ||||
| 60% | 0.6072 | 0.6002 | 0.6178 | 0.6302 | ||||
| 70% | 0.6980 | 0.6914 | 0.7081 | 0.6687 | ||||
| 80% | 0.8033 | 0.8106 | 0.8149 | 0.7919 | ||||
| 90% | 0.9088 | 0.9170 | 0.9023 | 0.9350 | ||||
| 95% | 0.9493 | 0.9404 | 0.9400 | 0.9654 | ||||
| 99% | 0.9911 | 0.9962 | 0.9798 | 0.9659 | ||||
| Patch-PODiff-ViT | DiT | VAE-LDM | PixelDiff | |||||
|---|---|---|---|---|---|---|---|---|
| Nominal | Empirical | Empirical | Empirical | Empirical | ||||
| 50% | 0.4889 | 0.4954 | 0.4827 | 0.5144 | ||||
| 60% | 0.6172 | 0.6257 | 0.6264 | 0.6657 | ||||
| 70% | 0.6990 | 0.7062 | 0.7080 | 0.7342 | ||||
| 80% | 0.8103 | 0.8196 | 0.8039 | 0.7919 | ||||
| 90% | 0.9091 | 0.9173 | 0.9204 | 0.9500 | ||||
| 95% | 0.9411 | 0.9319 | 0.9500 | 0.9649 | ||||
| 99% | 0.9891 | 0.9817 | 0.9816 | 0.9997 | ||||
Appendix G Uncertainty Map Comparisons
Figures 10 and 11 extend the analytic versus empirical uncertainty comparison from SST (Figure 3) to Chest X-ray and FFHQ, further supporting the calibration results in Section 4.3.
For Chest X-ray, analytic and empirical maps agree strongly (), with high uncertainty concentrated along lung boundaries and rib edges, where structural variability and reconstruction difficulty are greatest. For FFHQ, agreement remains high (), with uncertainty concentrated around fine-scale features such as eyes, mouth, and hair. The faint grid pattern in the FFHQ difference map reflects patch-boundary effects from independent patchwise covariance propagation and deterministic stitching. While cross-patch covariance affects off-diagonal entries of the global covariance, pointwise variances are determined by the propagated within-patch covariance and any aggregation or post-processing applied after decoding. These effects are most visible for FFHQ, where texture varies strongly across neighboring patches.
Appendix H Cross-Patch Covariance Analysis
Proposition 2 uses a block-diagonal covariance approximation that neglects cross-patch covariance. To quantify this, we measure the fraction of latent covariance energy in off-diagonal cross-patch blocks. Figure 12 shows low off-diagonal energy for SST and Chest X-ray, with mean ratios of and , respectively, and a moderate but still limited ratio for FFHQ (). This supports the block-diagonal approximation for structured physical and medical fields, while explaining the mild FFHQ patch-boundary discrepancies observed in uncertainty maps.
Appendix I Ablation Studies
I.1 Energy Threshold
Table 10 evaluates . Lower reduces retained modes and latent dimensionality, but degrades reconstruction. Pixel metrics change moderately from to , whereas FID worsens sharply at (e.g., on SST and on FFHQ), supporting as the default.
| Dataset | RMSE | PSNR | SSIM | LPIPS | FID | |
|---|---|---|---|---|---|---|
| SST | 0.99 (default) | 0.0030 | 50.43 | 0.9888 | 0.0132 | 3.99 |
| 0.95 | 0.0059 | 43.15 | 0.9802 | 0.0258 | 4.15 | |
| 0.90 | 0.0062 | 43.06 | 0.9798 | 0.0269 | 12.14 | |
| Chest X-ray | 0.99 (default) | 0.0065 | 42.98 | 0.9885 | 0.0201 | 6.02 |
| 0.95 | 0.0127 | 42.02 | 0.9799 | 0.0394 | 6.26 | |
| 0.90 | 0.0133 | 41.93 | 0.9791 | 0.0411 | 18.32 | |
| FFHQ | 0.99 (default) | 0.0109 | 39.16 | 0.9523 | 0.0301 | 9.17 |
| 0.95 | 0.0214 | 38.20 | 0.9431 | 0.0589 | 9.54 | |
| 0.90 | 0.0223 | 38.11 | 0.9410 | 0.0615 | 27.92 |
I.2 Patch Size
Table 11 compares patch sizes , , and . The setting consistently achieves the best RMSE and FID across datasets. Smaller patches increase sequence length and reduce per-patch compressibility, while larger patches require more POD modes to retain the same energy, offsetting dimensionality reduction. Overall, provides the best trade-off between locality, compression, and sequence length.
| Dataset | Patch | RMSE | PSNR | SSIM | FID |
|---|---|---|---|---|---|
| SST | 0.0040 | 42.93 | 0.9811 | 5.112 | |
| (default) | 0.0030 | 50.43 | 0.9888 | 3.986 | |
| 0.0039 | 42.59 | 0.9836 | 4.011 | ||
| Chest X-ray | 0.0078 | 38.75 | 0.9799 | 7.156 | |
| (default) | 0.0065 | 42.98 | 0.9885 | 6.015 | |
| 0.0070 | 42.57 | 0.9822 | 6.589 | ||
| FFHQ | 0.0185 | 37.95 | 0.9399 | 9.999 | |
| (default) | 0.0109 | 39.16 | 0.9523 | 9.169 | |
| 0.0187 | 37.99 | 0.9455 | 9.530 |
I.3 Denoiser Architecture: ViT vs. Per-Token MLP
Table 12 compares the ViT denoiser with a per-token MLP that processes patches independently. Removing cross-patch communication substantially degrades performance, increasing FID by – and worsening RMSE across all datasets. This confirms that self-attention is important for modeling inter-patch dependencies.
| Dataset | Denoiser | RMSE | PSNR | SSIM | LPIPS | FID |
|---|---|---|---|---|---|---|
| SST | ViT | 0.0030 | 50.43 | 0.9888 | 0.0132 | 3.99 |
| MLP | 0.0698 | 37.72 | 0.9456 | 0.0682 | 12.59 | |
| Chest X-ray | ViT | 0.0065 | 42.98 | 0.9885 | 0.0201 | 6.02 |
| MLP | 0.0431 | 34.33 | 0.9555 | 0.0982 | 13.22 | |
| FFHQ | ViT | 0.0109 | 39.16 | 0.9523 | 0.0301 | 9.17 |
| MLP | 0.1182 | 30.07 | 0.9001 | 0.1011 | 28.57 |
I.4 Effect of Ensemble Size
| MACE | 0.0191 | 0.0091 | 0.0080 | 0.0081 |
|---|---|---|---|---|
| 50% | 0.527 | 0.520 | 0.488 | 0.480 |
| 70% | 0.736 | 0.719 | 0.706 | 0.709 |
| 90% | 0.884 | 0.900 | 0.900 | 0.899 |
| 95% | 0.936 | 0.952 | 0.951 | 0.941 |
| 99% | 0.989 | 0.986 | 0.992 | 0.991 |
Table 13 reports MACE and selected empirical coverage levels for different ensemble sizes , averaged over all 2011 SST test days. Calibration improves from to , but gains beyond are marginal, indicating diminishing returns. We therefore use as the default, balancing ensemble inference cost and calibration accuracy. Notably, even achieves MACE below 0.01, suggesting that useful uncertainty estimates remain available under tighter compute budgets.
I.5 Effect of Compression Level
To disentangle POD compression from POD structure, we evaluate a variant retaining all K=256 modes on SST. Despite identical ViT architecture and linear POD structure, this uncompressed variant yields RMSE 0.0046 and FID 5.18, worse than Patch-PODiff-ViT (RMSE 0.0030, FID 3.986) and comparable to DiT (RMSE 0.0040, FID 5.01). This confirms that variance-ordered truncation to the data’s intrinsic dimensionality — not merely the linearity of the decoder — is the primary driver of reconstruction quality.
Appendix J Advection-Dominated Regime Analysis
| Dataset | Pe | RMSE | |
|---|---|---|---|
| SST | – | 2 | 0.0030 |
| Chest X-ray | – | 11 | 0.0065 |
| FFHQ | – | 26 | 0.0109 |
| Adv.-dom. | 150 | 0.0291 | |
| U-Net (adv.-dom.) | – | 0.1985 |
We test Patch-PODiff-ViT in a strongly advection-dominated setting to validate the limitation in Section 2.8. Synthetic fields are generated from the 2D convection–diffusion equation with and velocities in , yielding , on a grid with downsampling. Table 14 shows that this regime requires modes, far more than the main datasets, indicating much slower spectral decay. Patch-PODiff-ViT still achieves , improving over U-Net by , but the larger latent size reduces the compression advantage. Thus, the method is most efficient when local patch spectra decay rapidly. The highly advective regimes may require adaptive bases, overlapping aggregation, or hybrid local–global covariance modeling.
NeurIPS Paper Checklist
-
1.
Claims
-
Question: Do the main claims made in the abstract and introduction accurately reflect the paper’s contributions and scope?
-
Answer: [Yes]
-
Justification: The abstract and introduction summarize the proposed Patch-PODiff-ViT framework, its structured POD latent representation, uncertainty propagation, computational efficiency, and empirical evaluation. The claims are supported by the theoretical results, experiments, ablations, and limitations discussed in the paper.
-
Guidelines:
-
•
The answer [N/A] means that the abstract and introduction do not include the claims made in the paper.
-
•
The abstract and/or introduction should clearly state the claims made, including the contributions made in the paper and important assumptions and limitations. A [No] or [N/A] answer to this question will not be perceived well by the reviewers.
-
•
The claims made should match theoretical and experimental results, and reflect how much the results can be expected to generalize to other settings.
-
•
It is fine to include aspirational goals as motivation as long as it is clear that these goals are not attained by the paper.
-
•
-
2.
Limitations
-
Question: Does the paper discuss the limitations of the work performed by the authors?
-
Answer: [Yes]
-
Guidelines:
-
•
The answer [N/A] means that the paper has no limitation while the answer [No] means that the paper has limitations, but those are not discussed in the paper.
-
•
The authors are encouraged to create a separate “Limitations” section in their paper.
-
•
The paper should point out any strong assumptions and how robust the results are to violations of these assumptions (e.g., independence assumptions, noiseless settings, model well-specification, asymptotic approximations only holding locally). The authors should reflect on how these assumptions might be violated in practice and what the implications would be.
-
•
The authors should reflect on the scope of the claims made, e.g., if the approach was only tested on a few datasets or with a few runs. In general, empirical results often depend on implicit assumptions, which should be articulated.
-
•
The authors should reflect on the factors that influence the performance of the approach. For example, a facial recognition algorithm may perform poorly when image resolution is low or images are taken in low lighting. Or a speech-to-text system might not be used reliably to provide closed captions for online lectures because it fails to handle technical jargon.
-
•
The authors should discuss the computational efficiency of the proposed algorithms and how they scale with dataset size.
-
•
If applicable, the authors should discuss possible limitations of their approach to address problems of privacy and fairness.
-
•
While the authors might fear that complete honesty about limitations might be used by reviewers as grounds for rejection, a worse outcome might be that reviewers discover limitations that aren’t acknowledged in the paper. The authors should use their best judgment and recognize that individual actions in favor of transparency play an important role in developing norms that preserve the integrity of the community. Reviewers will be specifically instructed to not penalize honesty concerning limitations.
-
•
-
3.
Theory assumptions and proofs
-
Question: For each theoretical result, does the paper provide the full set of assumptions and a complete (and correct) proof?
-
Answer: [Yes]
-
Guidelines:
-
•
The answer [N/A] means that the paper does not include theoretical results.
-
•
All the theorems, formulas, and proofs in the paper should be numbered and cross-referenced.
-
•
All assumptions should be clearly stated or referenced in the statement of any theorems.
-
•
The proofs can either appear in the main paper or the supplemental material, but if they appear in the supplemental material, the authors are encouraged to provide a short proof sketch to provide intuition.
-
•
Inversely, any informal proof provided in the core of the paper should be complemented by formal proofs provided in appendix or supplemental material.
-
•
Theorems and Lemmas that the proof relies upon should be properly referenced.
-
•
-
4.
Experimental result reproducibility
-
Question: Does the paper fully disclose all the information needed to reproduce the main experimental results of the paper to the extent that it affects the main claims and/or conclusions of the paper (regardless of whether the code and data are provided or not)?
-
Answer: [Yes]
-
Justification: The paper specifies the datasets, train/validation/test splits, preprocessing, POD basis construction, model architectures, training hyperparameters, sampling settings, and evaluation metrics. The processed SST benchmark fields will be released with documentation and access terms consistent with the original data providers, while X-ray and FFHQ use publicly available datasets.
-
Guidelines:
-
•
The answer [N/A] means that the paper does not include experiments.
-
•
If the paper includes experiments, a [No] answer to this question will not be perceived well by the reviewers: Making the paper reproducible is important, regardless of whether the code and data are provided or not.
-
•
If the contribution is a dataset and/or model, the authors should describe the steps taken to make their results reproducible or verifiable.
-
•
Depending on the contribution, reproducibility can be accomplished in various ways. For example, if the contribution is a novel architecture, describing the architecture fully might suffice, or if the contribution is a specific model and empirical evaluation, it may be necessary to either make it possible for others to replicate the model with the same dataset, or provide access to the model. In general. releasing code and data is often one good way to accomplish this, but reproducibility can also be provided via detailed instructions for how to replicate the results, access to a hosted model (e.g., in the case of a large language model), releasing of a model checkpoint, or other means that are appropriate to the research performed.
-
•
While NeurIPS does not require releasing code, the conference does require all submissions to provide some reasonable avenue for reproducibility, which may depend on the nature of the contribution. For example
-
(a)
If the contribution is primarily a new algorithm, the paper should make it clear how to reproduce that algorithm.
-
(b)
If the contribution is primarily a new model architecture, the paper should describe the architecture clearly and fully.
-
(c)
If the contribution is a new model (e.g., a large language model), then there should either be a way to access this model for reproducing the results or a way to reproduce the model (e.g., with an open-source dataset or instructions for how to construct the dataset).
-
(d)
We recognize that reproducibility may be tricky in some cases, in which case authors are welcome to describe the particular way they provide for reproducibility. In the case of closed-source models, it may be that access to the model is limited in some way (e.g., to registered users), but it should be possible for other researchers to have some path to reproducing or verifying the results.
-
(a)
-
•
-
5.
Open access to data and code
-
Question: Does the paper provide open access to the data and code, with sufficient instructions to faithfully reproduce the main experimental results, as described in supplemental material?
-
Answer: [No]
-
Justification: ChestX-ray14 and FFHQ are publicly available. Upon acceptance, we will release the complete Patch-PODiff-ViT codebase, preprocessing pipelines, trained model configurations, evaluation scripts, and the processed SST benchmark fields needed to reproduce the main results. These will be hosted in a public repository or university-supported public link with documentation and reproduction instructions.
-
Guidelines:
-
•
The answer [N/A] means that paper does not include experiments requiring code.
-
•
Please see the NeurIPS code and data submission guidelines (https://neurips.cc/public/guides/CodeSubmissionPolicy) for more details.
-
•
While we encourage the release of code and data, we understand that this might not be possible, so [No] is an acceptable answer. Papers cannot be rejected simply for not including code, unless this is central to the contribution (e.g., for a new open-source benchmark).
-
•
The instructions should contain the exact command and environment needed to run to reproduce the results. See the NeurIPS code and data submission guidelines (https://neurips.cc/public/guides/CodeSubmissionPolicy) for more details.
-
•
The authors should provide instructions on data access and preparation, including how to access the raw data, preprocessed data, intermediate data, and generated data, etc.
-
•
The authors should provide scripts to reproduce all experimental results for the new proposed method and baselines. If only a subset of experiments are reproducible, they should state which ones are omitted from the script and why.
-
•
At submission time, to preserve anonymity, the authors should release anonymized versions (if applicable).
-
•
Providing as much information as possible in supplemental material (appended to the paper) is recommended, but including URLs to data and code is permitted.
-
•
-
6.
Experimental setting/details
-
Question: Does the paper specify all the training and test details (e.g., data splits, hyperparameters, how they were chosen, type of optimizer) necessary to understand the results?
-
Answer: [Yes]
-
Guidelines:
-
•
The answer [N/A] means that the paper does not include experiments.
-
•
The experimental setting should be presented in the core of the paper to a level of detail that is necessary to appreciate the results and make sense of them.
-
•
The full details can be provided either with the code, in appendix, or as supplemental material.
-
•
-
7.
Experiment statistical significance
-
Question: Does the paper report error bars suitably and correctly defined or other appropriate information about the statistical significance of the experiments?
-
Answer: [Yes]
-
Justification: Reconstruction metrics are reported as mean and standard deviation across three seed runs in Appendix D. CRPS is also reported with standard deviation, and empirical coverage is reported across multiple nominal levels.
-
Guidelines:
-
•
The answer [N/A] means that the paper does not include experiments.
-
•
The authors should answer [Yes] if the results are accompanied by error bars, confidence intervals, or statistical significance tests, at least for the experiments that support the main claims of the paper.
-
•
The factors of variability that the error bars are capturing should be clearly stated (for example, train/test split, initialization, random drawing of some parameter, or overall run with given experimental conditions).
-
•
The method for calculating the error bars should be explained (closed form formula, call to a library function, bootstrap, etc.)
-
•
The assumptions made should be given (e.g., Normally distributed errors).
-
•
It should be clear whether the error bar is the standard deviation or the standard error of the mean.
-
•
It is OK to report 1-sigma error bars, but one should state it. The authors should preferably report a 2-sigma error bar than state that they have a 96% CI, if the hypothesis of Normality of errors is not verified.
-
•
For asymmetric distributions, the authors should be careful not to show in tables or figures symmetric error bars that would yield results that are out of range (e.g., negative error rates).
-
•
If error bars are reported in tables or plots, the authors should explain in the text how they were calculated and reference the corresponding figures or tables in the text.
-
•
-
8.
Experiments compute resources
-
Question: For each experiment, does the paper provide sufficient information on the computer resources (type of compute workers, memory, time of execution) needed to reproduce the experiments?
-
Answer: [Yes]
-
Justification: The paper reports hardware type, training time, peak GPU memory, parameter count, per-sample inference time, and ensemble inference time for the main diffusion models in Section 4.5. These values provide the compute requirements needed to reproduce the main experiments.
-
Guidelines:
-
•
The answer [N/A] means that the paper does not include experiments.
-
•
The paper should indicate the type of compute workers CPU or GPU, internal cluster, or cloud provider, including relevant memory and storage.
-
•
The paper should provide the amount of compute required for each of the individual experimental runs as well as estimate the total compute.
-
•
The paper should disclose whether the full research project required more compute than the experiments reported in the paper (e.g., preliminary or failed experiments that didn’t make it into the paper).
-
•
-
9.
Code of ethics
-
Question: Does the research conducted in the paper conform, in every respect, with the NeurIPS Code of Ethics https://neurips.cc/public/EthicsGuidelines?
-
Answer: [Yes]
-
Justification: The research uses established public or licensed datasets, does not involve new human-subject data collection, and does not deploy the proposed model in a real-world decision-making system. We have reviewed the NeurIPS Code of Ethics and believe the work conforms to it.
-
Guidelines:
-
•
The answer [N/A] means that the authors have not reviewed the NeurIPS Code of Ethics.
-
•
If the authors answer [No] , they should explain the special circumstances that require a deviation from the Code of Ethics.
-
•
The authors should make sure to preserve anonymity (e.g., if there is a special consideration due to laws or regulations in their jurisdiction).
-
•
-
10.
Broader impacts
-
Question: Does the paper discuss both potential positive societal impacts and negative societal impacts of the work performed?
-
Answer: [Yes]
-
Justification: The work may support uncertainty-aware scientific and medical super-resolution by providing calibrated spatial confidence maps. However, generated high-resolution outputs should not be treated as direct observations in high-stakes settings and should require domain validation, uncertainty reporting, and expert oversight.
-
Guidelines:
-
•
The answer [N/A] means that there is no societal impact of the work performed.
-
•
If the authors answer [N/A] or [No] , they should explain why their work has no societal impact or why the paper does not address societal impact.
-
•
Examples of negative societal impacts include potential malicious or unintended uses (e.g., disinformation, generating fake profiles, surveillance), fairness considerations (e.g., deployment of technologies that could make decisions that unfairly impact specific groups), privacy considerations, and security considerations.
-
•
The conference expects that many papers will be foundational research and not tied to particular applications, let alone deployments. However, if there is a direct path to any negative applications, the authors should point it out. For example, it is legitimate to point out that an improvement in the quality of generative models could be used to generate Deepfakes for disinformation. On the other hand, it is not needed to point out that a generic algorithm for optimizing neural networks could enable people to train models that generate Deepfakes faster.
-
•
The authors should consider possible harms that could arise when the technology is being used as intended and functioning correctly, harms that could arise when the technology is being used as intended but gives incorrect results, and harms following from (intentional or unintentional) misuse of the technology.
-
•
If there are negative societal impacts, the authors could also discuss possible mitigation strategies (e.g., gated release of models, providing defenses in addition to attacks, mechanisms for monitoring misuse, mechanisms to monitor how a system learns from feedback over time, improving the efficiency and accessibility of ML).
-
•
-
11.
Safeguards
-
Question: Does the paper describe safeguards that have been put in place for responsible release of data or models that have a high risk for misuse (e.g., pre-trained language models, image generators, or scraped datasets)?
-
Answer: [N/A]
-
Justification: The paper does not release a high-risk foundation model, scraped dataset, or general-purpose image generator. FFHQ is used only as a standard benchmark for reconstruction evaluation, and the proposed method is not presented for identity recognition, surveillance, or unrestricted image generation.
-
Guidelines:
-
•
The answer [N/A] means that the paper poses no such risks.
-
•
Released models that have a high risk for misuse or dual-use should be released with necessary safeguards to allow for controlled use of the model, for example by requiring that users adhere to usage guidelines or restrictions to access the model or implementing safety filters.
-
•
Datasets that have been scraped from the Internet could pose safety risks. The authors should describe how they avoided releasing unsafe images.
-
•
We recognize that providing effective safeguards is challenging, and many papers do not require this, but we encourage authors to take this into account and make a best faith effort.
-
•
-
12.
Licenses for existing assets
-
Question: Are the creators or original owners of assets (e.g., code, data, models), used in the paper, properly credited and are the license and terms of use explicitly mentioned and properly respected?
-
Answer: [Yes]
-
Justification: Existing datasets and methods are cited in the paper. ChestX-ray14 is used under the NIH Clinical Center terms with required attribution; FFHQ is used under its Creative Commons BY-NC-SA 4.0 license; ROMS is distributed under an MIT/X-style license; and ACCESS-S2 data are used under Bureau of Meteorology data-access terms. The processed SST benchmark fields will be released with appropriate attribution, documentation, and access terms consistent with the ROMS and ACCESS-S2 data providers.
-
Guidelines:
-
•
The answer [N/A] means that the paper does not use existing assets.
-
•
The authors should cite the original paper that produced the code package or dataset.
-
•
The authors should state which version of the asset is used and, if possible, include a URL.
-
•
The name of the license (e.g., CC-BY 4.0) should be included for each asset.
-
•
For scraped data from a particular source (e.g., website), the copyright and terms of service of that source should be provided.
-
•
If assets are released, the license, copyright information, and terms of use in the package should be provided. For popular datasets, paperswithcode.com/datasets has curated licenses for some datasets. Their licensing guide can help determine the license of a dataset.
-
•
For existing datasets that are re-packaged, both the original license and the license of the derived asset (if it has changed) should be provided.
-
•
If this information is not available online, the authors are encouraged to reach out to the asset’s creators.
-
•
-
13.
New assets
-
Question: Are new assets introduced in the paper well documented and is the documentation provided alongside the assets?
-
Answer: [N/A]
-
Justification: The paper does not introduce a new dataset or benchmark asset. The codebase will be made available upon acceptance, with full documentation for reproducing the Patch-PODiff-ViT pipeline across all three datasets. Access to the SST benchmark fields will follow the pathway described in Item 5.
-
Guidelines:
-
•
The answer [N/A] means that the paper does not release new assets.
-
•
Researchers should communicate the details of the dataset/code/model as part of their submissions via structured templates. This includes details about training, license, limitations, etc.
-
•
The paper should discuss whether and how consent was obtained from people whose asset is used.
-
•
At submission time, remember to anonymize your assets (if applicable). You can either create an anonymized URL or include an anonymized zip file.
-
•
-
14.
Crowdsourcing and research with human subjects
-
Question: For crowdsourcing experiments and research with human subjects, does the paper include the full text of instructions given to participants and screenshots, if applicable, as well as details about compensation (if any)?
-
Answer: [N/A]
-
Justification: The paper does not involve crowdsourcing, user studies, or new human-subject data collection.
-
Guidelines:
-
•
The answer [N/A] means that the paper does not involve crowdsourcing nor research with human subjects.
-
•
Including this information in the supplemental material is fine, but if the main contribution of the paper involves human subjects, then as much detail as possible should be included in the main paper.
-
•
According to the NeurIPS Code of Ethics, workers involved in data collection, curation, or other labor should be paid at least the minimum wage in the country of the data collector.
-
•
-
15.
Institutional review board (IRB) approvals or equivalent for research with human subjects
-
Question: Does the paper describe potential risks incurred by study participants, whether such risks were disclosed to the subjects, and whether Institutional Review Board (IRB) approvals (or an equivalent approval/review based on the requirements of your country or institution) were obtained?
-
Answer: [N/A]
-
Justification: The paper does not involve new human-subject research, crowdsourcing, or interaction with study participants. ChestX-ray14 and FFHQ are pre-existing datasets used as benchmarks.
-
Guidelines:
-
•
The answer [N/A] means that the paper does not involve crowdsourcing nor research with human subjects.
-
•
Depending on the country in which research is conducted, IRB approval (or equivalent) may be required for any human subjects research. If you obtained IRB approval, you should clearly state this in the paper.
-
•
We recognize that the procedures for this may vary significantly between institutions and locations, and we expect authors to adhere to the NeurIPS Code of Ethics and the guidelines for their institution.
-
•
For initial submissions, do not include any information that would break anonymity (if applicable), such as the institution conducting the review.
-
•
-
16.
Declaration of LLM usage
-
Question: Does the paper describe the usage of LLMs if it is an important, original, or non-standard component of the core methods in this research? Note that if the LLM is used only for writing, editing, or formatting purposes and does not impact the core methodology, scientific rigor, or originality of the research, declaration is not required.
-
Answer: [N/A]
-
Justification: The core method does not use LLMs as a model component, experimental tool, or source of scientific results.
-
Guidelines:
-
•
The answer [N/A] means that the core method development in this research does not involve LLMs as any important, original, or non-standard components.
-
•
Please refer to our LLM policy in the NeurIPS handbook for what should or should not be described.
-
•