On June 19, 2026, a paper titled 'ITNet: A Learnable Integral Transform That Subsumes Convolution, Attention, and Recurrence' was published on ArXiv.
This innovative framework aims to combine the advantages of various neural network architectures, including convolutional networks, recurrent networks, and transformers.
ITNet introduces a unique method for encoding inductive biases, which could have significant implications for the future of AI research.