Neural Variable-Order Fractional Differential Equation Networks

Neural differential equation models have garnered significant attention in recent years for their effectiveness in machine learningthis http URLthese, fractional differential equations (FDEs) have emerged as a promising tool due to their ability to capture memory-dependent dynamics, which are often challenging to model with traditional integer-orderthis http URLexisting models have primarily focused on constant-order fractional derivatives, variable-order fractional operators offer a more flexible and expressive framework for modeling complex memory patterns. In this work, we introduce the Neural Variable-Order Fractional Differential Equation network (NvoFDE), a novel neural network framework that integrates variable-order fractional derivatives with learnable neuralthis http URLframework allows for the modeling of adaptive derivative orders dependent on hidden features, capturing more complex feature-updating dynamics and providing enhanced flexibility. We conduct extensive experiments across multiple graph datasets to validate the effectiveness of ourthis http URLresults demonstrate that NvoFDE outperforms traditional constant-order fractional and integer models across a range of tasks, showcasing its superior adaptability and performance.

@article{cui2025_2503.16207,
  title={ Neural Variable-Order Fractional Differential Equation Networks },
  author={ Wenjun Cui and Qiyu Kang and Xuhao Li and Kai Zhao and Wee Peng Tay and Weihua Deng and Yidong Li },
  journal={arXiv preprint arXiv:2503.16207},
  year={ 2025 }
}