A summary of architectures that make improvements around computational and memory efficiency of the original Transformer architecture. This is taken from the paper Efficient Transformers: A Survey, pu
This record introduces Fractiformers, a pioneering architecture that redefines traditional transformer models by incorporating fractal-based attention mechanisms, recursive processing, quantum-inspire
With the rapid development of intelligent transportation systems, especially in traffic image detection tasks, the introduction of the transformer architecture greatly promotes the improvement of mode
