Sequential RC-TGAN: Generating Relational Time Series with Spectral Envelope Loss
††thanks: This work was supported by Mitacs through the Mitacs Accelerate program.
Abstract
The generation of synthetic relational databases often involves modeling complex temporal dynamics, such as transaction logs or event sequences. A significant challenge in this domain is the handling of categorical time series (e.g., status codes), where standard encoding methods like one-hot encoding fail to capture intrinsic frequency-domain features such as seasonality and cyclicity. In this paper, we introduce Sequential RC-TGAN (Seq. RC-TGAN), a temporal extension of the RC-TGAN framework, equipped with a novel integrated loss function based on the Spectral Envelope Theory. This differentiable loss allows the generator to directly optimize the preservation of latent periodic structures via backpropagation. While spectral envelope theory is inherently designed for categorical sequences, we extend this frequency-domain regularization to continuous time series by employing a Variational Gaussian Mixture Model (VGM) discretization strategy. To establish a mathematically rigorous evaluation standard, we simulate categorical time series governed by a parameter , with exactly known theoretical spectral envelopes. Integrating these dynamic sequences into the child tables of a relational database yields a robust ground-truth benchmark for evaluating the frequency-domain fidelity of our generative framework. Furthermore, we address the lack of robust evaluation standards for relational time series by proposing two new metrics: Spectral Density Divergence and Spectral Envelope Divergence. Experimental results on real-world datasets, as well as our simulated benchmarks, demonstrate that our end-to-end approach significantly outperforms state-of-the-art systems in reproducing cyclic patterns and long-term seasonality across both categorical and continuous features.
I Introduction
Synthetic data generation has rapidly evolved from a niche privacy-preserving technique into a foundational pillar of modern machine learning, addressing critical bottlenecks related to data scarcity and algorithmic fairness while circumventing stringent privacy regulations. Early generative paradigms primarily focused on static, single-table tabular data [21, 5, 15]. Architectures such as TabGPT [10] and Tabular Transformer GAN (TT-GAN) [3] adapted NLP techniques to generate tabular rows via autoregressive next-token prediction.
In practice, contemporary enterprise data is predominantly structured within complex Relational Databases (RDBs), consisting of interconnected networks of tables governed by strict primary key (PK) and foreign key (FK) constraints. Consequently, multi-table generation models have emerged to address this structural complexity. Early approaches to relational data generation relied on statistical baselines, such as the Synthetic Data Vault (SDV) [12], which utilized hierarchical Gaussian copulas to model cross-table distributions. The transition to deep learning in this domain was pioneered by the Row Conditional Tabular GAN (RC-TGAN) [1], which leveraged Generative Adversarial Networks (GANs) to explicitly maintain referential integrity between parent and child tables. More recently, diverse architectures have been introduced, including transformer-based sequence-to-sequence models like REaLTabFormer [17], standard tabular diffusion models like ClavaDDPM [11], and graph-based diffusion frameworks such as RelDiff [2]. Despite their structural sophistication, these relational models are fundamentally static. They treat data as fixed snapshots and obliterate the complex longitudinal dynamics of multivariate time series (e.g., financial transaction logs) embedded within these schemas.
Synthesizing dynamic temporal sequences that are structurally embedded within a relational database requires conditioning child time series trajectories on the static parent table. Models such as TimeGAN [22] and DoppelGANger [7] pioneered this domain. However, these methods operate strictly in the time domain and are not focused on categorical time series, which are ubiquitous in real-world relational tables. Because standard representations like one-hot encoding map categories to orthogonal, equidistant vectors (where the Euclidean distance is always ), the neural network becomes completely blind to ordinal, hierarchical, or periodic relationships, preventing the generator from understanding the cyclical nature of categorical states. Apprehending these complex cyclical patterns in the time domain is inherently difficult, often leading to models missing crucial structural amplitudes. Consequently, enriching this sequence analysis with the frequency domain provides a significantly better approach, allowing the model to explicitly uncover and optimize the latent periodic structures underlying the discrete categories.
To overcome the intersecting limitations of time-domain optimization and categorical data modeling, we propose a profound paradigm shift by directly integrating Spectral Envelope Theory [18, 19, 16] into a relational generative architecture. We introduce Sequential RC-TGAN (Seq. RC-TGAN), equipped with a novel, differentiable spectral envelope loss that explicitly exploits the frequency domain to optimize the generator’s ability to model the complex pattern of categorical time series. The principle of spectral envelope in this context is to find an optimal scalar transformation that maximizes the spectral density of categorical time series; through this principle, we successfully translate discrete categories into continuous numerical representations. While recent literature has also pivoted toward frequency-domain regularization with architectures such as the Frequency-Markov Diffusion GAN (FMD-GAN) [8], FDEDiff [23], and TIFO [13] introducing highly innovative frequency-aware denoising, these methods are primarily designed for single-table generation and continuous time series, processing categorical time series using standard one-hot encoding representations. Consequently, they fail to resolve the challenge of categorical periodicity, as they cannot natively assign spectral meaning to orthogonal vectors without extensive feature engineering.
Our main contributions are as follows:
-
•
We integrate spectral envelope theory into a conditional sequential GAN framework by introducing a novel spectral loss term (). This loss explicitly minimizes the distance between the spectral envelopes of real and synthetic data, overcoming the orthogonality of one-hot encodings to preserve latent periodic structures in categorical time series.
-
•
We extend this spectral methodology to continuous numerical features by employing beforehand a discretization strategy based on Gaussian Mixture Models (GMM) [21], allowing the spectral envelope to capture and enforce frequency-domain features across mixed data types simultaneously.
-
•
We analytically derive the exact theoretical spectral envelope for Markov chains governed by circulant transition matrices. This provides a mathematically tractable and rigorous "gold standard" benchmark simulated dataset to evaluate the frequency-domain fidelity of sequential generative models without relying on empirical periodograms.
-
•
We propose a new set of evaluation metrics rooted in spectral analysis : Spectral Density Divergence () and Spectral Envelope Divergence (). These metrics are designed to rigorously assess the temporal fidelity and cyclic consistency of generated continuous and categorical time series, addressing the blindspots of traditional time-domain metrics.
The remainder of this paper is organized as follows. Section II provides the necessary background on spectral analysis. Section III formulates spectral envelopes within a metric space. Section IV introduces the proposed GAN framework for multi-table time series synthesis. Section V outlines the design of simulated data for our experiments. Section VI defines the new evaluation metrics based on spectral analysis. Finally, Section VII presents the experimental setup and results, followed by concluding remarks.
II Background on Spectral Analysis
II-A Spectral Density
Let be a weakly stationary process with value on , with mean and autocovariance function . The spectral density describes how the variance of the process is distributed across frequencies . The spectral density is defined as the Fourier transform of the autocovariance:
| (1) |
Inversely :
In practice, for a finite time series , the spectral density is estimated using the periodogram , calculated at Fourier frequencies :
where , the Discrete Fourier Transform (DFT).
The concept of spectral density can be extended to the multivariate case. Let be a weakly stationary process in with mean and autocovariance matrix . The -th entry of this matrix is the cross-covariance function , which measures the covariance between component at time and component at time .
The spectral density matrix is defined as the Fourier transform of :
The diagonal elements represent the univariate spectral densities, while the off-diagonal elements denote the cross-spectral densities.
For a finite observation , the spectral density is estimated using the periodogram. Let be the Discrete Fourier Transform (DFT) at frequency :
The multivariate periodogram matrix is defined as the outer product:
| (2) |
where ∗ denotes the conjugate transpose. While is an asymptotically unbiased estimator of , it is not consistent; its variance does not vanish as . Consequently, consistent estimation requires smoothing techniques, such as windowing or averaging over frequency bands.
II-B Spectral Envelope for Categorical Time Series
Consider a categorical time series taking values in a finite set that is stationary. Because standard frequency-domain tools cannot be directly applied to discrete qualitative symbols, we assign a vector of numerical scaling values to the categories in a. This transformation results in a real-valued numerical process, denoted , where whenever the original series is in state . By explicitly mapping the qualitative categories to quantitative scalars, we convert the discrete sequence into a standard univariate continuous-state time series. This mathematical conversion is a strict prerequisite, as it enables the calculation of autocovariance functions and the subsequent computation of the spectral density via the Fourier transform.
Instead of assigning arbitrary numbers to categories, the spectral envelope framework systematically derives optimal numerical values that expose hidden periodicities within a categorical time series. The primary objective is to find a scaling vector that maximizes the spectral density relative to the total variance at each specific frequency . Formally, the Spectral Envelope is defined as:
| (3) |
where and represent the spectral density and the variance of the transformed numerical process , respectively [18]. The condition explicitly excludes trivial scalings where every category is assigned the exact same numerical value. If is proportional to a vector of all ones (), the transformed sequence would merely become a flat, constant series. This would result in a variance of zero (), thereby rendering the objective ratio undefined.
This optimization problem can be solved by representing the categorical process as a multivariate point process (using one-hot vectors). Let be the spectral density matrix and be the variance matrix of stationary process . The optimization problem in (3) can be re-written :
| (4) |
This expression is a generalized Rayleigh quotient. The solution is the largest eigenvalue of in the metric of . The corresponding eigenvector is called the optimal scaling at frequency .
The value is called the spectral envelope because it envelopes the normalized spectrum of any scaled process . In other words, for any normalized scaling (such that ), we have , with equality achieved if and only if is proportional to the optimal scaling .
While the spectral envelope provides a robust mechanism for uncovering the latent periodicities of a single categorical time series, leveraging this concept within a deep generative framework requires systematically comparing the structural properties of real and synthesized processes. To formulate a differentiable objective that minimizes the frequency-domain discrepancy between these temporal dynamics, we cannot merely view as a collection of point-wise maxima. Instead, we must formalize the spectral envelope as a distinct mathematical object residing within a well-defined functional space. This theoretical shift naturally motivates the construction of a metric space for spectral envelopes, providing the foundational distance metrics required to optimize our generative model via backpropagation.
III A Metric Space Formulation for Spectral Envelopes
Consider a stationary categorical process taking values in the finite set a with spectral envelope . Let be a parametric stationary categorical process (e.g., a synthetic process generated by a model) with values in a, parameters , and spectral envelope .
In a generative context, the goal is to ensure that the synthetic process approximates the real process . A fundamental question arises: how can we quantify the discrepancy between these processes in the frequency domain? By defining a metric distance between and , we can formulate an optimization problem where minimizing this distance with respect to forces the synthetic process to recover the latent periodic structures of the real data. We first formalize the space in which these spectral envelopes reside.
Definition 1.
Let be the set of spectral envelopes corresponding to stationary categorical processes with categories that possess a continuous spectral density matrix associated with their one-hot encoding representation (i.e. ).
Lemma 1.
Every element is a continuous function on the interval .
The proof of this lemma is in the appendix.
Consequently, is a subset of , the space of continuous functions on the fundamental frequency domain. This inclusion implies that resides within the Hilbert space .
The Hilbert space consists of square-integrable functions defined on equipped with the inner product:
This induces the norm, representing the total energy of the function:
From this functional space definition, we derive metrics to measure the distance between the real spectral envelope and the synthetic spectral envelope :
| (5) |
The distance in (5) aggregates the error over the entire frequency domain. It is differentiable (assuming is differentiable with respect to ) and provides non-zero gradients for deviations across all frequencies simultaneously. This "smoothness" makes the metric significantly tractable as a loss function for backpropagation in deep neural networks. Therefore, we adopt the square of the distance as our objective function to minimize the divergence between the real and synthetic spectral envelopes.
Lemma 2.
For all , the following norm properties hold:
-
(i)
.
-
(ii)
.
The proof of this lemma is in the appendix.
The upper bound () reflects the dimensionality constraint of a categorical variable with states, where the rank of the associated variance-covariance matrix is at most . Regarding the lower bound , this property constitutes a fundamental energy constraint for any non-trivial stationary process. Because the spectral density decomposes the total variance of the process across frequencies, the integral of must equal the variance . Given that is defined as the supremum that envelopes the normalized spectrum of any scaled process, its integral (the norm) cannot be less than the variance of a standardized process (). By the relationship between norms on a compact domain of length 1, we have . This lower bound represents the "white noise" baseline where the spectral mass is uniformly distributed. In the context of deep learning, this ensures the loss function is anchored; the generator cannot minimize the spectral distance by simply reducing the synthetic process to a trivial or zero-variance state, as it must maintain the minimum spectral energy inherent to a categorical distribution.
IV Conditional GAN for Multi-table Time Series Synthesis
IV-A Formalization and Notation
Our formulation is grounded in the Probabilistic Relational Model (PRM) framework [4]. We consider a relational schema containing two classes (tables) and , where acts as the parent entity and as the child entity.
Let denote the set of attributes for table . This set is partitioned into continuous attributes and categorical attributes . The attribute space (or domain) for is defined as the Cartesian product of the domains of its individual attributes: . Similarly, we define as the attribute space for the parent table .
In this relational structure, specific dependencies exist between instances of and . Let denote a specific row (instance) in the parent table, with feature values . We define as the set of child rows in table that reference the parent .
In the context of time series synthesis, the set is not merely a bag of rows but an ordered sequence associated with the parent entity. We denote this sequence as , where each represents the state of the child entity at time step , and is the sequence length. Thus, the dataset consists of tuples , pairing static parent features with dynamic child sequences.
IV-B Sequential RC-TGAN Architecture
To address the challenge of generating relational time series, we introduce the Sequential RC-TGAN (see Fig. 1), an extension of the Row Conditional-TGAN (RC-TGAN) [1] model enhanced by the temporal dimension modeling. The original RC-TGAN primarily focused on modeling inter-table relationships, employing a generator to model the conditional distribution of a single child row given its parent: .
The Sequential RC-TGAN adapts this paradigm to support inter-row relationships modeling inside a tabular data. Rather than mapping parent feature values and a noise vector to a static point in the feature space , our generator learns to map them to a temporal trajectory within . Formally, the model approximates the conditional joint distribution of the child sequence given the parent attributes:
| (6) |
This formulation ensures that the generation process is explicitly conditioned on the static characteristics of the parent entity, thereby guaranteeing that the synthesized temporal dynamics remain consistent with their relational context.
IV-B1 Conditional Recurrent Generator
To capture temporal dependencies effectively, we replace the fully connected layers of the original RC-TGAN with a Recurrent Neural Network (RNN) generator [9].
The generation process is conditioned on the static parent attributes at every time step, ensuring the generated sequence adheres to the specific constraints of the parent entity. At each time step , the generator receives a concatenated input consisting of a random noise vector and the parent vector :
| (7) | ||||
| (8) |
where denotes concatenation, represents the hidden state, and is the generated attribute vector at time . By reinjecting at each step, this architecture ensures that the static relational constraints (e.g., Store Type, Location) exert a persistent influence over the entire dynamic trajectory of the child sequence.
IV-B2 Conditional Discriminator
In contrast to the generator, the discriminator is implemented as a fully connected network (MLP) designed to assess the global coherence of the sequence. It models the joint probability of the entire sequence conditioned on the parent attributes.
Assuming a fixed sequence length during training, the input to the discriminator is constructed by flattening the sequence into a single vector and concatenating it with the parent attributes . The discriminator then maps this joint representation to a validity score, determining whether the complete temporal trajectory constitutes a plausible instance given the specific parent context.
IV-C Spectral Adaptation for Continuous Features
The spectral envelope theory in [18] is inherently designed for categorical time series. However, relational datasets frequently contain continuous numerical attributes that exhibit significant periodic behavior (e.g., sales volume, temperature). To incorporate these attributes into our frequency-domain regularization, we first employ a discretization strategy based on Variational Gaussian Mixture Models (VGM) [21].
For each continuous attribute , we fit a VGM to the training data to estimate the optimal number of modes and their parameters. The probability distribution of a value is modeled as a mixture of Gaussians:
| (9) |
To compute the spectral envelope for a continuous sequence , we transform it into a discrete sequence of mode indicators . At each time step , the value is assigned to the mode that maximizes the posterior probability:
| (10) |
This process effectively maps the continuous domain to a finite categorical set . Consequently, we can calculate the spectral envelope on this discretized sequence, allowing the spectral loss to enforce periodic consistency across both naturally categorical attributes and discretized continuous attributes .
Beyond this discrete mode assignment, each continuous value is concurrently represented by a normalized scalar that captures its relative position within the assigned mode. Specifically, if the value is assigned to mode , we compute an intra-mode scalar . By concatenating the one-hot encoded discrete mode indicator with this normalized continuous scalar , the model retains the complete information necessary to fully reconstruct the original continuous feature . Therefore, while the categorical mode sequence explicitly drives the frequency-domain regularization via the spectral envelope, the supplementary scalar sequence ensures no loss of localized continuous variance in the time domain.
Note that another way to incorporate the continuous attributes into frequency domain is to use the power spectrum of the signal. However as it will be shown in the ablation study section, we find that the discretization method is more effective.
IV-D Generator Losses
The training of the generator is guided by a hybrid objective function designed to satisfy two complementary requirements: global statistical realism (via adversarial feedback) and frequency-domain fidelity (via spectral envelope matching).
IV-D1 Adversarial Loss ()
The primary objective of the generator is to produce relational sequences that are indistinguishable from real data. To achieve stable training dynamics, we employ the Wasserstein GAN (WGAN) objective.
Let denote the real data distribution and the generator distribution conditioned on parent attributes . The discriminator (or critic) aims to maximize the divergence between its scoring of real and synthetic sequences. Conversely, the generator minimizes this divergence. The adversarial loss for the generator is defined as:
| (11) |
Minimizing this term encourages the generator to capture general temporal correlations and the joint distribution of the sequence conditioned on the parent .
IV-D2 Spectral Envelope Loss ()
Standard adversarial losses often fail to capture frequency patterns in categorical time series because discriminators tend to focus on local transitions rather than global frequency structures. To remedy this, we introduce a regularization term based on the spectral envelope.
Sequence-wise Spectral Estimation: Since the spectral envelope is a statistical property, we estimate it over mini-batches to ensure stability. Let be a mini-batch of sequences. For a specific categorical feature , we compute the spectral envelope for the -th sequence at frequency (as defined in (3)).
We calculate the mean spectral envelope for the real batch, , and the synthetic batch, , by averaging the envelopes across the batch dimension:
| (12) |
This batch-averaging step reduces the variance of the periodogram estimator and provides a robust target frequency profile for the generator. We adapt this estimation for the continuous numerical features by relying on their discrete mode indicators (as detailed in Section IV-C). Let denote the discretized sequence for the -th instance of feature . The mean spectral envelope is correspondingly calculated as:
| (13) |
The synthetic counterparts, and , are computed analogously over the generated batch.
Loss Formulation: To enforce periodic consistency across the entire relational dataset, we partition our frequency-domain objective into two components. The categorical spectral loss, , minimizes the average distance between the real and synthetic mean spectral envelopes across all categorical features:
| (14) |
Likewise, the continuous spectral loss, , computes the average distance across the discretized numerical features:
| (15) |
The total spectral envelope loss, , is constructed as the weighted sum of these two terms, distributed proportionally to the number of features of each type:
| (16) |
Minimizing this unified term explicitly forces the generator to align the latent periodicities (e.g., seasonality, cyclic trends) of the synthetic sequences with the ground truth across both mixed data types (see Fig. 2).
IV-E Training Loop
The training procedure employs an alternating optimization strategy to balance the competing objectives. In each epoch, we execute the following three distinct phases:
-
1.
Discriminator Update: First, we optimize the discriminator to distinguish between real sequences and the current synthetic output. We perform updates to the discriminator for every generator update to maintain an optimal gradient approximation for the WGAN objective.
-
2.
Adversarial Generator Update: Second, we update the generator by minimizing . In this step, the generator weights are adjusted to fool the discriminator, ensuring global statistical coherence and adherence to the parent conditioning.
-
3.
Spectral Generator Update: Finally, we perform a specialized refinement step focused on frequency-domain fidelity. We update the generator by minimizing . This update is repeated times per epoch.
V Design of Simulated Data for Experiments
Validating generative models on real-world categorical time series is inherently difficult. Because real-world data lacks a definitive "ground truth" for its underlying stochastic frequencies, evaluations often rely on noisy periodogram estimates. To rigorously evaluate whether a generative model genuinely learns complex frequency-domain features, rather than merely memorizing local transitions, it is crucial to employ benchmark time series where the spectral properties are known beforehand.
To this end, we turn to stationary Markov chains. These stochastic processes provide a controlled, "gold standard" evaluation environment for two primary reasons: first, they can be easily and exactly simulated to generate massive, customized datasets for model training; second, they allow for the exact analytical derivation of their theoretical spectral envelope. By comparing the empirical spectral envelope of the generated sequences against this mathematically known ground truth, we can accurately measure the frequency fidelity of our synthetic approximations.
We map the categorical series into the multivariate point process (one-hot vector). Specifically, takes values in the set of standard basis vectors . In this one-hot encoded representation, is a vector with a at the -th position and everywhere else, corresponding exactly to the event that is in state . The process is characterized by the Transition Matrix Function, denoted as . This matrix-valued function describes the conditional probability of the process transitioning from one basis state to another over a given time lag .
For a stationary categorical process, the entry of the transition matrix function at lag , , represents the probability of transitioning from state to state after steps:
| (17) |
This matrix captures the "flow" of probability mass across the state space over time.
In the context of a first-order Markov chain, the behavior of the transition matrix function is strictly governed by the immediate 1-step transitions. Consequently, the transition probabilities at any lag are entirely determined by the -th power of the 1-step transition matrix :
This transition relationship is the key to computing the temporal covariance of the process. For a stationary categorical process characterized by a stationary distribution vector (row vector), let denote the diagonal matrix of its marginal probabilities. The autocovariance matrix function, , is directly related to the transition matrix function by the following equation:
| (18) |
By substituting the property established above for a first-order Markov chain where the multi-step transition is simply the matrix power , this general relation simplifies significantly. The autocovariance matrix function reduces to a geometric decay governed entirely by the 1-step transition matrix :
Equation (18) reveals that the spectral properties of the process are entirely governed by the relaxation of the transition mechanism .
For the remainder of this section, we assume that the stationary categorical process is a first-order Markov chain characterized by the one-step transition matrix .
V-A Spectral Properties of Circulant Transitions
Deriving the spectral envelope for a general transition matrix requires numerically solving the eigenvalue problem at every frequency. For the class of circulant transition matrices, we can derive an exact analytical form that links the stochastic parameters directly to the spectral shape.
A transition matrix is circulant if every row is a cyclic right shift of the preceding row. Consequently, the entire matrix is fully characterized by its first row vector , where .
The general form of such a matrix is:
| (19) |
This structural symmetry serves as a mathematical bridge between the time domain and the frequency domain: circulant matrices are diagonalized by the Inverse Discrete Fourier Transform matrix [6], a property we leverage to derive analytical spectral envelopes. Then, the eigenvalues of the circulant matrix in (19) is given by:
| (20) |
The magnitude () is determined by the concentration of the probability mass in b. If b is highly concentrated (low entropy), the magnitude approaches 1 (), implying long memory, whereas a uniform b (high entropy) yields , which is characteristic of a white noise process.
Lemma 3 (Spectral Envelope of Circulant Chains).
Let be a stationary categorical process with states governed by a circulant transition matrix . Let be the eigenvalues of expressed in polar form i.e. and . The spectral envelope is the upper boundary of the spectral densities of the non-trivial eigenmodes:
| (21) |
The proof of this lemma is in the appendix.
Using this lemma, we analyze two types of circulant chains representing distinct temporal dynamics: periodicity and inertia.
V-B The Noisy Cyclic Process (Periodicity)
This process models periodic behavior with phase noise, serving as a robust benchmark for capturing seasonality and cyclic constraints.
A Noisy Cyclic Process (NCP) is defined by the transition matrix:
where is the switching state parameter. An NCP is a circulant chain where . Its spectral envelope is given by equation (21) where :
The NCP serves as a robust benchmark for modeling periodic behavior and cyclic constraints under varying degrees of phase noise. Its temporal dynamics are primarily controlled by the switching state parameter , which dictates the strictness of the cycle. Figure 3 visualizes the spectral envelope of the NCP with a state space of for different values of . As shown, the process naturally exhibits distinct resonant peaks clustered around the fundamental frequency of and its associated harmonics. When the cycle strength approaches 1 (represented by the darker lines), the system mimics a deterministic cycle, concentrating the spectral energy into very sharp, Dirac-like peaks. Conversely, as decreases toward its lower bound, the process introduces greater phase noise, which progressively broadens these sharp harmonic peaks into wide spectral hills, reflecting a more stochastic and relaxed periodic progression.
V-C The Symmetric Sticky Process (Inertia)
This process models systems with inertia, where the state tends to persist over time with no preferred direction of change.
A Symmetric Sticky Process (SSP) is defined by the transition matrix:
where is the switching state parameter. We can remark that the transition matrix of the SSP is circulant such that the first row . We can derive the spectral envelope of the SSP from equation (21):
where . The non-trivial eigenvalues are identical and real corresponding to .
The asymptotic behavior of the process is highly sensitive to the switching state parameter . As , the eigenvalue , causing the process to become extremely "sticky" and rarely switch states. In this regime, the spectral envelope forms a sharp peak at , ultimately approaching a Dirac delta. Conversely, as , the eigenvalue , which reduces the process to pure random noise (see Figure 3). Consequently, the spectral energy becomes uniformly distributed, and the envelope flattens to a constant line where .
V-D Bayesian Hierarchical Sampling for generating simulated relational databases
To rigorously evaluate the conditional generation capabilities of our model, we elaborate a method for building a synthetic relational database using a Bayesian hierarchical framework. Unlike using a single fixed parameter for the entire dataset, we model the switching parameter as a random variable associated with each parent entity. This setup forces the generative model to learn the mapping rather than memorizing a static distribution.
Following the relational schema introduced in Section IV, we construct a framework where the parent table governs the stochastic dynamics of the child time series in table . Note that for any single simulated database, we select only one of these two types of circulant chains (either the Symmetric Sticky or the NCP) and fix the total number of categorical states to drive the temporal dynamics. Because both processes are fully parameterized by the switching parameter for a given , we apply a Bayesian hierarchical modeling to each choice: first, we sample and store values of in the parent table; second, we generate a corresponding categorical time series for each of these values using the chosen Markov process.
For the NCP, where represents the probability of advancing the cycle, we use a uniform prior over the valid range of directed cycles:
where is the random variable illustrating the value of for the -th row in the parent table. For the Symmetric Sticky, we simply replace distribution by .
For each parent row , we generate a categorical time series of length , which acts as part of the child table . The dynamics of this series are conditioned strictly on the parent’s parameter .
The sequence is generated via the transition matrix specific to the chosen type of circulant chain (Symmetric Sticky or Noisy Cyclic):
| (22) |
This hierarchical construction provides a "gold standard" dataset for conditional generative modeling. Since the true spectral envelope is analytically known for every parent (via Lemma 3), we can compute the exact expected spectral error. A successful generative model must produce synthetic children such that their empirical spectral envelopes match the theoretical envelopes dictated by their sampled parent attributes .
VI New Metrics Based on Spectral Analysis
Evaluating the fidelity of synthetic relational time series requires going beyond simple marginal distributions or static correlations. Standard metrics often fail to accurately detect if the synthetic data preserves the specific frequency-domain characteristics (such as seasonality and cyclic constraints) inherent to the real process. To address this, we propose two metrics rooted in spectral analysis.
Let be the set of parent instances in the real database, and be the set of parent instances in the synthetic database. Each parent (or ) identifies a specific sub-population of children rows forming a multivariate time series.
For a numerical attribute , let denote the spectral density of the series associated with parent . For a categorical attribute , let denote its spectral envelope. We define the mean spectral densities and mean spectral envelopes for the real data as:
| (23) | ||||
| (24) |
The synthetic counterparts, and , are defined analogously over the synthetic parents.
VI-A Spectral Density Divergence ()
To evaluate the temporal fidelity of continuous features, we measure the divergence between the average power spectrums. We first normalize the spectral densities so that , considering them as probability distributions over the frequency domain.
The individual divergence for an attribute is defined as the divergence (e.g., Wasserstein or Kullback-Leibler) between the real and synthetic mean densities. The global Spectral Density Divergence (SDD) is the average over all continuous attributes:
| (25) |
where . It is worth noting that the aggregated quantities and constitute well-defined normalized spectral densities. Mathematically, the set of valid normalized spectral densities is closed under convex combinations; since each individual is a non-negative, real-valued, its integral under interval is equal to one, and even function (for real-valued processes), their arithmetic mean preserves these fundamental properties. Consequently, effectively represents the spectral density of a "representative" process for the class , averaging out local idiosyncrasies to reveal the global frequency structure of the population. This validity allows us to treat these patterns as probability distributions and rigorously apply divergence metrics such as Kullback-Leibler (KL) or Wasserstein distance.
VI-B Spectral Envelope Divergence ()
For categorical attributes, we assess the preservation of latent periodicities using the spectral envelope. The divergence for a single attribute is calculated as the distance between the mean envelopes:
| (26) |
The global Spectral Envelope Divergence (SED) is the mean over all categorical attributes:
| (27) |
The aggregated spectral envelope inherits the fundamental algebraic properties of its constituents. Since is constructed as a finite linear combination of individual envelopes, and given that each component is continuous on the compact interval (Lemma 1), the mean envelope itself is necessarily a continuous function in . Furthermore, the fundamental norm constraints established in Lemma 2 are preserved under this averaging operation. Specifically, by the convexity of the norm, the mean envelope satisfies the dimensionality constraint (If is the number of categories of ) and maintains finite energy . These properties ensure that remains a well-defined term within the functional and verify important properties of spectral envelopes, guaranteeing that the divergence metric is both bounded and mathematically stable.
VII Experiments
In this section, we empirically evaluate the performance of our proposed generative framework. The primary objective is to demonstrate that integrating the spectral envelope loss into a sequential GAN architecture significantly improves the preservation of latent periodicities and temporal dynamics in both continuous and categorical time series conveyed by rows of child tables of relational databases. To this end, we conduct comprehensive experiments on both simulated data and real-world transactional datasets. We compare our model against several state-of-the-art generative approaches, followed by an ablation study to evaluate the contribution of specific components within our proposed model.
VII-A Experimental setup
VII-A1 Simulated Data (Bayesian Hierarchical Benchmarks)
We first evaluate our models on simulated relational databases generated via our Bayesian Hierarchical Benchmarking framework. We simulate two distinct categorical Markov processes:
-
•
NCP: Tests the model’s ability to capture periodic behaviors of categorical time series. The transition parameter is sampled from the prior .
-
•
SSP: Tests the model’s ability to capture low-frequency, high-inertia dynamics (low-pass filter behavior). The transition parameter is sampled from the prior .
Specifically, we synthesize a parent table comprising 100 independent entities (rows), where each entity’s attribute is drawn from the corresponding uniform prior. For each parent row, we simulate a sequence of 10,000 child rows, generated using the Markov transition matrix governed by that specific . This hierarchical construction dictates the exact theoretical spectral envelope of the generated child sequences, providing a rigorous "gold standard" to isolate and evaluate frequency-domain fidelity across varying state space sizes ().
VII-A2 Real-World Datasets
We also evaluate our method on two real-world relational databases containing complex temporal dynamics: Rossmann [14] and Walmart [20]. Each database adheres to a two-level hierarchical relational schema. The parent table contains static metadata representing the set of individual stores (e.g., store type, location), while the child table contains the multivariate time series for each store, encompassing both continuous numerical features (e.g., daily or weekly sales volume) and highly periodic categorical features (e.g., day of the week, promotional events).
VII-A3 Baseline models
We compare our proposed method (Seq. RC-TGAN) against state-of-the-art systems spanning standard relational generation and dedicated time series generative adversarial networks:
-
•
SDV [12]: A standard probabilistic relational model that builds generative models of relational databases by computing statistics at the intersection of related tables.
-
•
ClavaDDPM [11]: A recent diffusion-based approach for multi-relational data synthesis.
-
•
DoppelGANger [7]: A state-of-the-art GAN designed for networked time series that tackles mode collapse and long-term dependencies.
-
•
TimeGAN [22]: A time series GAN that combines the unsupervised adversarial paradigm with the control of supervised training through a jointly optimized latent embedding space.
VII-A4 Metrics
To rigorously assess both temporal fidelity and the preservation of complex temporal patterns conveyed by child tables rows structures, we employ the following metrics:
-
•
MSE (ACF): The Mean Squared Error between the autocorrelation of the real and synthetic data. This measures the model’s ability to preserve time-domain dependencies and localized temporal structures.
-
•
SDD (): Defined in (25), we specifically use the KL divergence as function to evaluate categorical time series.
-
•
SED (): Defined in (27), used to evaluate numerical time series.
VII-B Experimental Results
The results are summarized in Tables II and I, alongside visual analyses in Figures 5 and 4. To assess model performance, we highlight relative improvements over the second-best baselines and evaluate statistical significance using a two-sample t-test ().
VII-B1 Performance on Simulated Data
Table I demonstrates that Seq. RC-TGAN achieves statistically significant reductions in SED () across all tested state space sizes (). For the NCP, our proposed method yields relative improvements of 45.8%, 43.3%, and 28.2% over the next best baselines at and , respectively. This trend holds for the SSP, where Seq. RC-TGAN significantly outperforms the second-best models by 32.7% (), 52.8% () and 37.48% ().
Figure 4 provides a qualitative spectral analysis of the generated sequences against the mathematical ground truth (black dashed line). A rigorous visual evaluation of synthetic categorical time series in the frequency domain necessitates assessing two critical criteria: (1) frequency localization, ensuring the synthetic envelope successfully exhibits peaks at all theoretical fundamental and harmonic frequencies; (2) spectral purity, verifying that every peak in the synthetic envelope corresponds to a true theoretical peak without introducing spurious periodic artifacts.
Our proposed model consistently satisfies both criteria. For the SSP (top row), it accurately captures the theoretical low-pass filter behavior, concentrating the precise magnitude of spectral mass exactly at without hallucinating higher-frequency artifacts as the persistence parameter approaches 1. For the NCP (bottom row), the model successfully isolates the true fundamental harmonic peaks (e.g., near for ), maintains strict spectral purity by avoiding false peaks, and faithfully reproduces the theoretical amplitudes to accurately model the phase noise. In stark contrast, competing baselines universally fail these criteria, failing to detect true periodicities and typically collapsing into flat, white-noise-like representations.
VII-B2 Performance on Real-World Data
Table II details the performance of the generative models on the Rossmann and Walmart databases. The proposed framework establishes state-of-the-art performance across multiple facets of temporal generation. Most notably, it demonstrates a unique ability to model complex categorical time series, yielding statistically significant divergence reductions in SED () compared to the second-best baselines: 37.8% and 59.3% relative gain on the Rossmann and Walmart databases, respectively ().
Furthermore, although the spectral envelope theory described in section II is inherently designed for categorical sequences, our framework extends this frequency-domain regularization to continuous numerical attributes by employing a Variational Gaussian Mixture Model (VGM) discretization strategy. By mapping continuous values to discrete mode indicators, the spectral loss successfully enforces periodic consistency across all feature types. This adaptation directly contributes to our model achieving a statistically significant 33.7% relative improvement in continuous SDD () on the Rossmann dataset, as well as a relative gain of 24.8% over DoppelGANger on the Walmart dataset ( for both).
SDV, ClavaDDPM, and TimeGAN consistently demonstrate the weakest performance, struggling to capture both local time-domain structures and global frequency distributions. In contrast, DoppelGANger proves to be a highly competitive state-of-the-art baseline for numerical data. On the Walmart dataset, DoppelGANger and our proposed model are statistically tied for the best time-domain performance (MSE ACF of 0.012 vs. 0.013, respectively; ). However, despite DoppelGANger’s proficiency with continuous variables, it struggles significantly when tasked with modeling the periodic dynamics of categorical time series. Our proposed method overcomes this important limitation via our unified spectral envelope regularization.
This dynamic is visually corroborated by the Autocorrelation Function (ACF) analysis of numerical time series presented in Figure 5. As seen in the top row (a, b), static tabular models like SDV and ClavaDDPM completely fail to capture temporal dependencies, resulting in flat ACF curves. This visual analysis highlights a critical limitation of the commonly used MSE (ACF) metric. On the Rossmann dataset, the static SDV model achieves a nominally better MSE (ACF) compared to the sequential DoppelGANger model (0.0700 vs. 0.0868). However, visual inspection reveals that SDV merely produces a flat line near zero; this mathematically minimizes the mean squared error across all lags by "playing it safe," but fails entirely to capture underlying temporal dynamics. DoppelGANger successfully reproduces the oscillating shape of the sales autocorrelation but misses the exact amplitude of certain peaks, resulting in a harsher point-wise MSE penalty.
The spectral metrics ( and ) correct this incompleteness by evaluating the global frequency structure rather than local point-wise errors. Ultimately, our proposed Seq. RC-TGAN framework bridges all these gaps, demonstrating the ability to accurately capture local point-wise dependencies, global continuous periodicities via VGM adaptation, and crucially, the complex structural harmonics inherent to categorical time series.
| State Space Size () | |||
| Model | K=7 | K=12 | K=21 |
| Noisy Cyclic | |||
| SDV | |||
| ClavaDDPM | |||
| DoppelGANger | |||
| TimeGAN | |||
| Seq. RC-TGAN | |||
| Symmetric Sticky | |||
| SDV | |||
| ClavaDDPM | |||
| DoppelGANger | |||
| TimeGAN | |||
| Seq. RC-TGAN | |||
| Dataset | Model | MSE (ACF) | ||
|---|---|---|---|---|
| Rossmann | SDV | |||
| ClavaDDPM | ||||
| DoppelGANger | ||||
| TimeGAN | ||||
| Seq. RC-TGAN | ||||
| Walmart | SDV | |||
| ClavaDDPM | ||||
| DoppelGANger | ||||
| TimeGAN | ||||
| Seq. RC-TGAN |
VII-C Ablation Study
To rigorously isolate the contributions of our architectural design choices, specifically the recurrent temporal generation and the proposed frequency-domain loss, we conducted an ablation study. We compared four variants of our framework: RC-TGAN [1] (no temporal dimension modeling), the Seq. RC-TGAN (w\o ) that is the recurrent baseline without any spectral loss, the Seq. RC-TGAN (psd) which models based on the spectral density loss for the numerical columns instead of the spectral envelope loss (based on VGM), and our proposed full model, Seq. RC-TGAN.
The necessity of the defined spectral loss is most starkly evident in our highly controlled simulated environments (Table III). While the model Seq. RC-TGAN (w\o ) demonstrates improvements on empirical real-world data, it completely fails to reproduce pure mathematical periodicities. The results show that without explicit frequency-domain guidance, the recurrent baseline performs almost identically to the static RC-TGAN model on both the NCP and SSP across all state space sizes.
This reveals that standard adversarial training in the time domain, even with an RNN-based architecture, is insufficient to prevent white-noise-like spectra when faced with periodic constraints. By incorporating the spectral envelope loss, the divergence () is reduced by approximately 50% across almost all configurations (e.g., a statistically significant divergence drop from 0.8483 to 0.4246 for the NCP at ). These results confirm that the proposed spectral loss is not merely an incremental tuning parameter for real-world data, but a fundamentally essential component for generative models to successfully reconstruct latent harmonics and system inertia in categorical time series.
Table IV details the performance of these variants on the Rossmann and Walmart datasets. Transitioning from a static generator (RC-TGAN) to a recurrent architecture (Seq. RC-TGAN (w/o )) yields statistically significant improvements () across both time and frequency domains on real-world data. For instance, on the Walmart dataset, introducing the recurrent structure reduces the time-domain MSE (ACF) by 54.6% (from 0.1200 to 0.0545) and drastically reduces the continuous frequency divergence () by 81.8% (from 45.26% to 8.22%).
Evaluating the progression of our ablation study highlights the fundamental necessity of the spectral envelope loss for mixed-type columns in relational databases. First, comparing the unregularized recurrent baseline (Seq. RC-TGAN (w\o )) to the Seq. RC-TGAN (psd) variant demonstrates the advantage of the latter, as applying a standard spectral density loss successfully provides frequency-domain guidance for continuous numerical columns. However, this approach remains fundamentally insufficient for reliably capturing the complex periodic dynamics inherent to categorical data. Subsequently, comparing the Seq. RC-TGAN (psd) variant to our full model (Seq. RC-TGAN) illustrates the critical impact of our proposed approach. Implementing the full Spectral Envelope loss forces the generator to comprehensively learn overarching periodic patterns across all data types natively. This yields a statistically significant 23.9% relative reduction in categorical SED () compared to the psd variant on the Rossmann dataset (dropping from 0.6014 to 0.4578). Furthermore, on the Walmart dataset, the full model drives the SED down to 0.0048, outperforming the PSD-only variant and achieving a massive 93.4% overall improvement compared to the initial recurrent baseline (dropping from 0.0732 to 0.0048).
These findings are visually confirmed by the Autocorrelation Function (ACF) analysis (Figure 5, bottom row). The static RC-TGAN completely fails to capture temporal dependencies, resulting in a flat ACF line. While the Seq. RC-TGAN (w\o ) successfully begins to capture localized temporal transitions, it still misses the global structural amplitudes. The integration of the full spectral loss acts as the definitive catalyst, enabling the generator to accurately reproduce long-range seasonal correlations rather than just step-by-step localized transitions.
| State Space Size () | |||
| Model | K=7 | K=12 | K=21 |
| Benchmark: Noisy Cyclic | |||
| RC-TGAN | |||
| Seq. RC-TGAN (w\o ) | |||
| Seq. RC-TGAN | |||
| Benchmark: Symmetric Sticky | |||
| RC-TGAN | |||
| Seq. RC-TGAN (w\o ) | |||
| Seq. RC-TGAN | |||
| Dataset | Model | MSE (ACF) | ||
|---|---|---|---|---|
| Rossmann | RC-TGAN | |||
| Seq. RC-TGAN (w\o ) | ||||
| Seq. RC-TGAN (psd) | ||||
| Seq. RC-TGAN | ||||
| Walmart | RC-TGAN | |||
| Seq. RC-TGAN (w\o ) | ||||
| Seq. RC-TGAN (psd) | ||||
| Seq. RC-TGAN |
VIII Conclusion
In this paper, we addressed the critical challenge of generating high-fidelity time series within relational databases by introducing Seq. RC-TGAN, a sequential generative adversarial network enhanced with a novel, integrated spectral envelope loss. Rather than relying solely on static encodings, our framework explicitly optimizes the network to preserve the complex frequency-domain features of both categorical and continuous time series during training. Furthermore, we established a mathematically rigorous evaluation paradigm by analytically deriving the spectral envelope for circulant Markov chains, providing a "gold standard" for categorical time series alongside two novel spectral divergence metrics. Extensive experiments on these simulated data and real-world datasets (Rossmann and Walmart) demonstrate that our approach significantly outperforms state-of-the-art baselines in capturing latent periodicities, strict cyclic constraints, and long-term seasonality.
References
- [1] (2023) Row conditional-TGAN for generating synthetic relational databases. In ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1–5. Cited by: §I, §IV-B, §VII-C.
- [2] (2025) RelDiff: relational data generative modeling with graph-based diffusion models. arXiv preprint arXiv:2506.00710. Cited by: §I.
- [3] (2025) Tabular transformer generative adversarial network for heterogeneous distribution in healthcare. Scientific Reports 15 (1), pp. 10254. Cited by: §I.
- [4] (1999) Probabilistic relational models. In International Conference on Inductive Logic Programming, pp. 3–13. Cited by: §IV-A.
- [5] (2024-10) TabDDPM: Modelling Tabular Data with Diffusion Models. arXiv. Note: arXiv:2209.15421 External Links: Link, Document Cited by: §I.
- [6] (2012) On circulant matrices. Notices of the AMS 59 (3), pp. 368–377. Cited by: §V-A.
- [7] (2020) Using gans for sharing networked time series data: challenges, initial promise, and open questions. In Proceedings of the ACM internet measurement conference, pp. 464–483. Cited by: §I, 3rd item.
- [8] (2026) Dynamic community detection using class preserving time series generation with fourier markov diffusion. Scientific Reports. Cited by: §I.
- [9] (2001) Recurrent neural networks. Design and applications 5 (64-67), pp. 2. Cited by: §IV-B1.
- [10] (2021) Tabular transformers for modeling multivariate time series. In ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 3565–3569. Cited by: §I.
- [11] (2024-11) ClavaDDPM: Multi-relational Data Synthesis with Cluster-guided Diffusion Models. arXiv. Note: arXiv:2405.17724 External Links: Link, Document Cited by: §I, 2nd item.
- [12] (2016-10) The Synthetic Data Vault. 2016 IEEE International Conference on Data Science and Advanced Analytics (DSAA) 2016, pp. 399–410 (en). External Links: Document Cited by: §I, 1st item.
- [13] (2026) TIFO: time-invariant frequency operator for stationarity-aware representation learning in time series. arXiv preprint arXiv:2602.17122. Cited by: §I.
- [14] Rossmann Store Sales. External Links: Link Cited by: §VII-A2.
- [15] (2025) A Comprehensive Survey of Synthetic Tabular Data Generation. arXiv preprint arXiv:2504.16506. Cited by: §I.
- [16] (2006) Time series analysis and its applications: with r examples. Springer. Cited by: §I.
- [17] (2023-02) REaLTabFormer: Generating Realistic Relational and Tabular Data using Transformers. arXiv. Note: arXiv:2302.02041 External Links: Link, Document Cited by: §I.
- [18] (1993) Spectral analysis for categorical time series: scaling and the spectral envelope. Biometrika 80 (3), pp. 611–622. Cited by: §I, §II-B, §IV-C.
- [19] (2000) The spectral envelope and its applications. Statistical Science, pp. 224–253. Cited by: §I.
- [20] Walmart. External Links: Link Cited by: §VII-A2.
- [21] (2019-10) Modeling Tabular data using Conditional GAN. arXiv:1907.00503 [cs, stat] (en). Note: arXiv: 1907.00503 External Links: Link Cited by: 2nd item, §I, §IV-C.
- [22] (2019) Time-series generative adversarial networks. Advances in neural information processing systems 32. Cited by: §I, 4th item.
- [23] Frequency decomposition and enhancement for time series generation using diffusion models. Cited by: §I.
Proof of Lemma 1
By assumption, the spectral density matrix of the one-hot encoded process, , is continuous. Because the categories are mutually exclusive and exhaustive, the covariance matrix has rank . We can apply any projection matrix to obtain a full-rank covariance matrix and a projected spectral density matrix .
The spectral envelope is given by the largest eigenvalue of the matrix . Since is continuous with respect to , the matrix is also continuous.
The eigenvalues of are the roots of its characteristic polynomial, which can be defined as . The coefficients of this polynomial are continuous functions of the entries of which are continuous functions of . Then, polynomial is continuous function of .
According to standard mathematical theorem in [ross2022yet] regarding the roots of polynomials, the roots of a polynomial are continuous functions of its coefficients. Consequently, the largest root, , is a continuous function on the fundamental frequency domain .
Proof of Lemma 2
We prove the two properties sequentially based on the definitions of the spectral envelope and the norms.
Let be the projected spectral density matrix of dimension , and let be the corresponding full-rank covariance matrix. The integral of the spectral density matrix over the fundamental frequency domain yields the covariance matrix:
Recall that the spectral envelope is defined as , where is the highest eigenvalue function and .
Upper Bound: Integrating over the frequency domain yields:
Taking the trace of both sides, we get:
Since is positive semi-definite, its maximum eigenvalue is bounded by its trace, for all . Therefore:
Lower Bound: Using the variational characterization of the spectral envelope, for any non-zero vector , we have:
Integrating this inequality over the frequency domain gives:
Thus, .
From Lemma 1, is a continuous function on the compact interval . Therefore, it is bounded, which implies and consequently , meaning .
For the lower bound, we apply Jensen’s inequality (or the Cauchy-Schwarz inequality) on the probability space defined by the interval with length 1:
Since we established in Part (i) that , it strictly follows that .
Proof of Lemma 3
Because is a circulant matrix, it is a normal matrix (). A fundamental property of circulant matrices is that they are diagonalized by the Discrete Fourier Transform (DFT) matrix. Therefore, the eigenvectors are the fixed, orthogonal Fourier basis vectors. This orthogonality allows us to project the multivariate one-hot encoded categorical process into uncorrelated scalar processes, defined as .
The conditional expectation of each projected scalar process is exactly governed by its corresponding eigenvalue: . This equation defines a complex Autoregressive Process of order 1 (AR(1)). For such an AR(1) process, the temporal dependence decays geometrically. Consequently, the normalized autocorrelation function at lag is given exactly by the corresponding eigenvalue raised to the absolute lag: .
By the Wiener-Khinchin theorem, the spectral density of a stationary discrete-time process is the Discrete-Time Fourier Transform (DTFT) of its autocorrelation sequence. Substituting the geometric autocorrelation into the Fourier sum yields an explicitly solvable infinite geometric series:
Using the polar representation of the eigenvalue , we can expand the squared norm in the denominator:
This yields the explicit polar form for the spectral density: .
The spectral envelope is defined as the supremum of the normalized spectral density over all possible projection vectors : . Because the scalar modes are mutually uncorrelated (their cross-covariance is zero for all lags), the total spectral density of any linear combination is simply the sum of the individual mode densities.
To maximize a weighted average of independent components at any specific frequency , the optimal strategy is to assign all weight to the single component with the largest value. Thus, evaluating the envelope simplifies to finding the point-wise maximum of the individual harmonic densities (excluding the trivial stationary DC component ):