VertiAKD: Adaptive Off-Road Kinodynamics on
Vertically Challenging Terrain

Classical off-road navigation commonly relies on simplified kinematic models, such as bicycle or ackermann formulations, or physics-based models of wheel-terrain interaction [19]. Although these analytical models provide interpretable predictions, their parameters are difficult to identify and often do not transfer across diverse terrain surfaces and changing operating conditions.

Learning-based methods [1] instead estimate vehicle-terrain kinodynamics directly from data. Recent approaches incorporate geometric features, including elevation maps, surface normals, and point clouds, together with semantic or physical terrain properties to improve off-road motion prediction [7, 20, 9, 10, 6, 21, 8]. For example, PIETRA [9] and PhysORD [10] combine learned terrain representations with physical principles to improve prediction under challenging terrain conditions. Nevertheless, these models are generally trained for a specific platform, tightly coupling its terrain representations to its kinodynamics. Applying them to a different vehicle therefore requires additional platform-specific data and model adaptation, limiting their scalability across heterogeneous fleets.

Meta-learning aims to enable rapid adaptation from limited data. Model-Agnostic Meta-Learning (MAML) [22] learns an initialization that can be fine-tuned with a small number of gradient updates, while HyperDynamics [23] and RMA [24] infer task- or environment-specific latent representations for fast adaptation. However, gradient-based approaches require iterative backpropagation, and learned adaptation often generalize poorly to unseen vehicle-terrain interactions.

Function encoders provide an alternative by representing kinodynamics as a linear combination of learned basis functions and a compact coefficient vector [12, 11, 25]. This decomposition separates shared kinodynamic structure from environment-specific variation. VertiAKD leverages this representation to construct terrain-aware coefficient priors from relevant mobility descriptors identified in the shared latent space.

Online adaptation updates kinodynamic models as new observations become available. Classical methods, such as Recursive Least Squares (RLS) and Kalman filtering, provide efficient parameter updates but typically assume a fixed linear model structure. Neural approaches relax this assumption by updating network weights through online stochastic gradient descent, at the cost of repeated backpropagation that is often impractical at control frequencies. Hybrid methods, including kernel-based adaptation [26] and gaussian-process regression [27], balance data efficiency with generalization, but their computational and memory cost still grows with accumulated data.

VertiAKD performs online adaptation only in the low-dimensional coefficient space of a pretrained function encoder. During deployment, the nonlinear basis functions remain fixed, while RLS recursively refines the transferred coefficient priors from streaming observations. This enables efficient adaptation without gradient-based retraining or optimization over the accumulated dataset.

We consider a heterogeneous fleet of ground vehicles $\mathcal{V}=\{v_{1},\dots,v_{k}\}$, each characterized by a distinct physical configuration $\mathbf{c}\in\mathbb{R}^{d_{c}}$, where $d_{c}$ denotes the number of configurable physical parameters, e.g., mass, friction, stiffness. The vehicle state at time $t$ is defined as

and possible higher-order derivatives, where $x_{t},y_{t},z_{t}$ denote the vehicle position in 3D, and $\phi_{t},\varphi_{t},\eta_{t}$ denote roll, pitch, and yaw. The control input $\mathbf{u}_{t}\in\mathcal{U}$ corresponds to steering and speed. Local terrain beneath the vehicle is summarized by an embedding $\mathbf{e}_{t}=[\mathbf{e}_{\text{elev}},\mathbf{e}_{\text{sem}}]\in\mathbb{R}^{d_{e}+d_{s}},$ where $\mathbf{e}_{\text{elev}}\in\mathbb{R}^{d_{e}}$ and $\mathbf{e}_{\text{sem}}\in\mathbb{R}^{d_{s}}$ represent elevation and semantic features respectively. The forward kinodynamics of a single vehicle is modeled in continuous time as a neural ODE,

parameterized by $\theta$, which jointly captures vehicle-terrain interaction effects on the resulting motion. For compatibility with the MPPI sampling-based control framework, we adopt a discretized form,

with fixed time step $\Delta t$.

To enable cross-vehicle knowledge sharing, we treat $\mathcal{V}$ as the training fleet $\mathcal{V}_{\text{train}}$. For each vehicle $v_{i}\in\mathcal{V}_{\text{train}}$, characterized by its physical configuration $\mathbf{c}_{i}$, a trajectory dataset $\mathcal{D}_{i}=\{\tau_{1},\tau_{2},\dots,\tau_{M_{i}}\}$ is available as prior knowledge. Each trajectory $\tau_{j}=\{(\mathbf{x}_{t},\mathbf{u}_{t},\mathbf{e}_{t},\mathbf{x}_{t+1})\}_{t=1}^{H}$ consists of $H$ discrete kinodynamic transition steps, each paired with the local terrain embedding observed at that step. Given a new vehicle $v_{\text{new}}$, possibly operating on terrain not represented in $\mathcal{V}_{\text{train}}$’s collected data, the problem becomes to derive the forward kinodynamics model $f_{\theta}$ with as little new data as possible, i.e., $\mathcal{D}_{\text{new}}=\{\tau_{1},\tau_{2},\dots,\tau_{M_{\text{new}}}\}$, $M_{\text{new}}\ll M_{i}$, with or without its physical configuration $\mathbf{c}_{\text{new}}$.

Given trajectory transitions, vehicle configurations, and local terrain embeddings from the training fleet, we learn an encoder $\mathcal{E}_{\psi}$ that maps vehicle-terrain mobility interactions into a shared latent space. This structured representation preserves kinodynamic (dis)similarities across both platforms and terrain conditions, while incorporating physical priors from vehicle configurations. Such resulting structure supports downstream mobility descriptor identification and rapid adaptation to unseen vehicle-terrain interactions.

After training $\mathcal{E}_{\psi}$, we project training fleet mobility embeddings into a low-dimensional space via Principal Component Analysis (PCA) and group them into $K$ vehicle-terrain mobility descriptors using K-means clustering, selecting $K$ by maximizing silhouette score to balance intra-cluster compactness against inter-cluster separation. This yields $\mathcal{Z}_{\mathrm{train}}=\bigcup_{k=1}^{K}\mathcal{C}_{k}$, where each cluster $\mathcal{C}_{k}$ represents a mobility descriptor shared across related vehicle-terrain interactions. Given limited data $\mathcal{D}_{\mathrm{new}}$ from a novel vehicle, we encode its trajectory segments as $\mathcal{Z}_{\mathrm{new}}=\{\mathcal{E}_{\psi}(\mathbf{P}_{j},\mathbf{T}_{j},\mathbf{c}_{\mathrm{new}})\}_{j=1}^{M_{\mathrm{new}}}$, projected into the same PCA space, using unconditional embeddings when $\mathbf{c}_{\mathrm{new}}$ is unavailable.

We compare $\mathcal{Z}_{\mathrm{new}}$ against each descriptor distribution using Sliced Wasserstein Distance (SWD) [29], converted into normalized relevance weights, $\tilde{w}_{k}=\text{SWD}\left(\mathcal{Z}_{\mathrm{new}},\mathcal{C}_{k}\right)^{-2}$ and $w_{k}=\tilde{w}_{k}/\sum_{j=1}^{K}\tilde{w}_{j}$. Descriptors are ranked by $w_{k}$, and the top-ranked set $\mathcal{N}_{\text{new}}$ whose cumulative weight exceeds $0.9$ is retained as the mobility descriptors used for downstream kinodynamic knowledge transfer.

We represent forward kinodynamics (Eqn. (1)) as a linear combination of $K_{b}$ neural ODE basis functions:

where each $G_{i}(\cdot;\theta_{i})$ is computed via a fourth-order Runge-Kutta (RK4) integrator, and $\boldsymbol{\alpha}=[\alpha_{1},\dots,\alpha_{K_{b}}]^{T}\in\mathbb{R}^{K_{b}}$ specializes the shared basis to a specific vehicle-terrain condition [13]. The trajectory and terrain tokens are first fused through cross-attention, and the resulting representation is provided as input to each basis function $G_{i}$, enabling terrain-conditioned kinodynamic modeling.

Given an example set of transitions $\{\tau_{1},\tau_{2},\dots,\tau_{M}\}$ from a single descriptor, the coefficients that best explain this data are obtained in closed form via ridge-regularized least squares,

where $G_{k}$ and $\Delta\mathbf{x}_{k}$ stack the predicted basis outputs and true state changes from the example set, and $\lambda$ and $I$ are the ridge regularization coefficient and identity matrix. We compute $\alpha^{*}_{k}$ for every descriptor identified in $\mathcal{N}_{\text{new}}$ and combine them using the weights $w_{k}$ from mobility latent space to obtain a coefficient prior for the novel vehicle $v_{\text{new}}$:

While $\alpha_{\text{prior}}$ provides an effective initialization, it reflects only the training fleet’s prior experience and does not account for the specific conditions $v_{\text{new}}$ encounters during deployment. We therefore periodically refine the coefficient vector using RLS, warm-started from the transferred prior, as summarized in Algorithm 1. At each control step, the observed transition $(\mathbf{x}_{t},\mathbf{u}_{t},\mathbf{e}_{t},\mathbf{x}_{t+1})$ is appended to a fixed-size buffer $\mathcal{B}$ (lines 2-3). Once the buffer contains $B$ transitions, the basis function outputs are stacked to form $G_{t}$, and the corresponding observed state changes are stacked into $y_{t}$ (lines 4-5). The covariance is discounted by the forgetting factor $\gamma$ (line 6), after which the innovation covariance and gain are computed in closed form (lines 7-8). The coefficients are then updated using the residual $y_{t}-G_{t}\alpha_{t-1}$, followed by the covariance update (lines 9-10). The buffer is cleared for the next update cycle (line 11), while the coefficients and covariance remain fixed between updates (lines 12-13). Because the basis functions and buffer size are fixed, the cost of each update does not grow with the deployment history, enabling efficient online refinement without gradient-based retraining.

We evaluate VertiAKD in the Verti-Bench simulator [18] and a physical testbed similar to Verti-Arena [30] using a heterogeneous fleet operating over geometrically and semantically diverse terrain. Each vehicle configuration is represented by $\mathbf{c}=[\alpha_{m},\mu_{f},\alpha_{s}]^{T},$ where $\alpha_{m}$ is the chassis mass scaling ratio, $\mu_{f}$ is the rigid tire friction coefficient, and $\alpha_{s}$ denotes the suspension spring stiffness scaling ratio. The training fleet contains five configurations sampled from $\alpha_{m}\sim[0.5,2.0]$, $\mu_{f}\sim[0.6,0.9]$, and $\alpha_{s}\sim[0.6,1.8]$.

Each vehicle collects trajectories through sinusoidal random exploration over terrain with diverse elevation and semantic properties. Steering is commanded as $\mathbf{u}_{\text{steer}}(t)=\sin(\omega_{s}t)$, with $\omega_{s}\sim[0.1,0.5]$ Hz, while speed follows $\mathbf{u}_{\text{speed}}(t)=v_{c}+A\sin(\omega_{v}t)$, with $\omega_{v}\sim[0.1,2.5]$ Hz. The minimum and maximum speeds are sampled as $v_{\text{min}}\sim[1,2]$ m/s and $v_{\text{max}}\sim[3,4]$ m/s. The velocity amplitude and center are then computed as $A=(v_{\text{max}}-v_{\text{min}})/2$ and $v_{c}=(v_{\text{max}}+v_{\text{min}})/2$. We record current state, commanded control, next state, and vehicle-aligned $128\times 128$ elevation and RGB semantic patches at $10$ Hz, yielding terrain-conditioned transitions across diverse vehicle-terrain interactions. For terrain feature extraction, separate convolutional autoencoders with identical encoder architectures map the 2.5D elevation and RGB semantic patches to $18\times 16\times 16$ spatial feature maps. These features are reshaped for cross-attention in Secs. III-B and III-D. Elevation maps are globally normalized to $[-1,1]$, while RGB semantic images are normalized channel-wise to the same range. Both autoencoders are trained independently with mean-squared reconstruction loss using Adam, a learning rate of $10^{-4}$, and a batch size of $64$.

Since vehicle kinodynamics are invariant to global translation and yaw, we express the vehicle state in a gravity-aligned body frame. At each timestep, the global position and yaw are reset to zero, while roll $\phi_{t}$ and pitch $\varphi_{t}$ are retained to preserve the vehicle’s orientation relative to gravity on uneven terrain. We further include the yaw rate $\dot{\eta}_{t}$ and longitudinal speed $v_{t}$ to capture rotational and momentum-dependent effects that become increasingly important at higher speeds. The resulting current state is $\mathbf{x}_{t}=[0,\,0,\,0,\,\phi_{t},\,\varphi_{t},\,0,\,\dot{\eta}_{t},\,v_{t}]^{T}\in\mathbb{R}^{8}.$ The corresponding next state describes the vehicle motion relative to the current body frame for vehicle position and yaw and to the gravity-aligned frame for roll and pitch: $\mathbf{x}_{t+1}=[\Delta x,\,\Delta y,\,\Delta z,\,\phi_{t+1},\,\varphi_{t+1},\,\Delta\eta]^{T}\in\mathbb{R}^{6}.$ Here, $\Delta x$, $\Delta y$, and $\Delta z$ denote the relative translation, and $\Delta\eta$ denotes the relative yaw change. In contrast, $\phi_{t+1}$ and $\varphi_{t+1}$ are represented as absolute roll and pitch angles, preserving the vehicle’s orientation with respect to gravity.

The mobility encoder consists of $4$ Transformer blocks with hidden dimension $d=32$ and $4$ attention heads. Each input trajectory window contains $L=64$ consecutive transitions $\mathbf{p}_{t}=[\mathbf{x}_{t},\mathbf{u}_{t},\mathbf{x}_{t+1}]\in\mathbb{R}^{18}$, linearly projected to $\mathbb{R}^{32}$. At each timestep, the corresponding elevation and semantic embeddings are jointly projected into a paired terrain token, forming a sequence temporally aligned with the transition tokens. This terrain sequence is fused with the transition token via cross-attention, before prepending the learnable CLS token and adding sinusoidal positional embeddings.

Vehicle configuration parameters $(\alpha_{m},\mu_{f},\alpha_{s})$ are min–max normalized to $[0,1]$. They are embedded into $\mathbb{R}^{32}$ by a two-layer Multi-Layer Perceptron (MLP) with dimensions $\{3,8,32\}$ and Tanh activations. The resulting embedding modulates the final Transformer block through AdaLN with a scale factor of $0.5$. During training, the configuration embedding is replaced with a learnable null embedding $\mathbf{e}_{\varnothing}\in\mathbb{R}^{32}$ with probability $0.1$, enabling unconditional inference when the physical configuration is unavailable.

For terrain-aware triplet sampling, each anchor trajectory window is compared with $32$ candidate windows drawn from a precomputed set for the same vehicle type. This set is periodically refreshed during training to improve trajectory diversity. Sample selection is guided by the symmetric KL divergence between the terrain signature of anchor and each candidate. Positives are drawn from the same vehicle under similar terrain (lower KL divergence), whereas negatives differ in vehicle, terrain (higher KL divergence), or both. We set the triplet margin to $\delta=2.0$ and use loss weights $w_{u}=1.0$, $w_{c}=1.0$, and $w_{v}=0.1$ for the unconditional, conditional, and variance-regularization terms.

The encoder is trained with Adam optimizer for up to 100K iterations using a learning rate of $10^{-4}$ and a batch size of $128$. Conditional embedding separation is evaluated on a held-out validation set every $1{,}000$ iterations, and training is terminated early if no improvement is observed for $10$ consecutive evaluations.

The function encoder comprises eight terrain-conditioned neural ODE basis functions. State and control inputs are independently mapped to $16$-dimensional features, while elevation and semantic embeddings are processed through separate cross-attention branches and fused into a $16$-dimensional terrain representation. The resulting features are concatenated and provided to each basis function, which uses separate MLP heads to predict $[\Delta x,\,\Delta y,\,\Delta z,\,\Delta\eta]^{T}$ and $[\phi_{t+1},\,\varphi_{t+1}]^{T}$ respectively.

The basis outputs are integrated using RK4 with a fixed timestep of $\Delta t=0.1$ s. Terrain-specific coefficients are estimated via ridge-regularized least squares (Eqn. (2)) with $\lambda=10^{-3}$. At each training step, we sample two vehicle-terrain mobility descriptors and $12$ trajectories from each descriptor. Three trajectories form the example set for coefficient estimation, while the remaining trajectories are used to optimize a $T_{\text{pred}}=16$-step rollout loss. During autoregressive rollout, terrain patches are recropped at the predicted poses and re-encoded at each step. The model is trained for $2{,}000$ gradient steps using Adam optimizer with a learning rate of $10^{-3}$.

For real-world validation, we deploy VertiAKD on several open-source 1/10th-scale Verti-4-Wheeler platforms [6], with vehicle states measured at 100 Hz via a motion-capture system. The training fleet comprises four configurations: Four-Wheeled Differential-Locked, Four-Wheeled Differential-Unlocked, Heavy-Payload, and Four-Tracked, with 20 minutes of trajectory data collected for each configuration. As the new platform, we introduce a Four-Wheeled with Trailer platform, which introduces coupled vehicle-trailer kinodynamics absent from the training fleet.