File tree 1 file changed +13
-0
lines changed
1 file changed +13
-0
lines changed Original file line number Diff line number Diff line change @@ -49,17 +49,30 @@ object InteractionGraphNegativeJob extends ScioBeamJob[InteractionGraphNegativeO
49
49
val endTs = opts.interval.getEndMillis
50
50
51
51
// read input datasets
52
+
53
+ // We only count blocks in the past 180 days to make sure we don't fall
54
+ // into any long-term cancellation effects in a tweeter.
55
+ // As an example, some accounts may have higher count of blocks because
56
+ // what they said is controversial in one period of time but it might be
57
+ // not in other (for example, @RWMaloneMD or others)
52
58
val blocks : SCollection [InteractionGraphRawInput ] =
53
59
GraphUtil .getFlockFeatures(
54
60
readSnapshot(FlockBlocksEdgesScalaDataset , sc),
55
61
FeatureName .NumBlocks ,
56
62
endTs)
63
+ .filter(_.age < 180 )
57
64
65
+ // We only count mutes in the past 180 days to make sure we don't fall
66
+ // into any long-term cancellation effects in a tweeter.
67
+ // As an example, some accounts may have higher count of blocks because
68
+ // what they said is controversial in one period of time but it might be
69
+ // not in other (for example, @RWMaloneMD or others)
58
70
val mutes : SCollection [InteractionGraphRawInput ] =
59
71
GraphUtil .getFlockFeatures(
60
72
readSnapshot(FlockMutesEdgesScalaDataset , sc),
61
73
FeatureName .NumMutes ,
62
74
endTs)
75
+ .filter(_.age < 180 )
63
76
64
77
val abuseReports : SCollection [InteractionGraphRawInput ] =
65
78
GraphUtil .getFlockFeatures(
You can’t perform that action at this time.
0 commit comments