Skip to content

Commit

Permalink
Fix for stochastic depth decay rule in the TimeSformer implementation (
Browse files Browse the repository at this point in the history
…#27875)

Update modeling_timesformer.py

Fixing typo to correct the stochastic depth decay rule
  • Loading branch information
atawari authored Dec 11, 2023
1 parent c0a354d commit 4b4b864
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -305,7 +305,7 @@ def __init__(self, config: TimesformerConfig, layer_index: int) -> None:
] # stochastic depth decay rule
drop_path_rate = drop_path_rates[layer_index]

self.drop_path = TimeSformerDropPath(config.drop_path_rate) if drop_path_rate > 0.0 else nn.Identity()
self.drop_path = TimeSformerDropPath(drop_path_rate) if drop_path_rate > 0.0 else nn.Identity()
self.attention = TimeSformerAttention(config)
self.intermediate = TimesformerIntermediate(config)
self.output = TimesformerOutput(config)
Expand Down

0 comments on commit 4b4b864

Please sign in to comment.