Update vllm/model_executor/models/modernbert.py

Added dropout layer in forward, which should not have effect at inference, though, but I still kept it in case, and to match huggingface architecture so that weight loading is simplified.

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Signed-off-by: antrec <antoine.recanati@gmail.com>

Author: 2 people

vllm/model_executor/models/modernbert.py

@@ -448,6 +448,6 @@ def forward(
             inputs_embeds=inputs_embeds,
             intermediate_tensors=intermediate_tensors,
         )
-        hidden_states = self.head(hidden_states)
+        hidden_states = self.drop(self.head(hidden_states))
         hidden_states = hidden_states.to(self.head_dtype)
         return self.classifier(hidden_states)