Support SDPA & Flash Attention 2 for LayoutLMv3 #35467
Description
Feature request
Support SDPA & Flash Attention 2 for LayoutLMv3.
Motivation
Speed up document transformer training and inference.
Your contribution
I can add it.
{{ message }}
Support SDPA & Flash Attention 2 for LayoutLMv3.
Speed up document transformer training and inference.
I can add it.