Make a Long Image Short: Adaptive Token Length for Vision Transformers-Reference-Cited by-同舟云学术

Make a Long Image Short: Adaptive Token Length for Vision Transformers

Published:2023 Issue: Volume: Page:69-85
ISSN:0302-9743
Container-title:Machine Learning and Knowledge Discovery in Databases: Research Track
language:
Short-container-title:

Author:

Zhou Qiqi,Zhu Yichen

Publisher

Springer Nature Switzerland

Link

https://link.springer.com/content/pdf/10.1007/978-3-031-43415-0_5

Reference63 articles.

1. Arnab, A., Dehghani, M., Heigold, G., Sun, C., Lučić, M., Schmid, C.: Vivit: a video vision transformer. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 6836–6846 (2021)

2. Bao, H., Dong, L., Wei, F.: Beit: Bert pre-training of image transformers. arXiv preprint arXiv:2106.08254 (2021)

3. Beltagy, I., Peters, M.E., Cohan, A.: Longformer: the long-document transformer. arXiv preprint arXiv:2004.05150 (2020)

4. Bertasius, G., Wang, H., Torresani, L.: Is space-time attention all you need for video understanding? In: ICML, vol. 2, p. 4 (2021)

5. Bolya, D., Fu, C.Y., Dai, X., Zhang, P., Feichtenhofer, C., Hoffman, J.: Token merging: Your vit but faster. In: The Eleventh International Conference on Learning Representations (2023). https://openreview.net/forum?id=JroZRaRw7Eu

Cited by 2 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Student-t Process Prior Variational Autoencoder for Anomaly Detection in Time Series;Lecture Notes in Electrical Engineering;2024

2. Which Tokens to Use? Investigating Token Reduction in Vision Transformers;2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW);2023-10-02