Throttling doesn't apply to posts without webmentions

[jordanmerrick]

I've recently added webmentions to my Jekyll blog, which has ~800 posts going back a number of years. Only about four recent posts have received webmentions. My site's build time has jumped to around five minutes, but throttling seems to make no difference. I'm using the following throttling configuration:

  throttle_lookups:
    last_week: daily
    last_month: weekly
    last_year: every 2 weeks
    older: monthly

What I seem to be experiencing is that only posts which have received webmentions are throttled. So for all other posts that have no webmentions, they're checked every time. Is that right? If so, can there be a way to specify that throttling should apply to all posts, not just ones that have received webmentions previously? In my case, this could possibly decrease build times significantly.

[aarongustafson]

Good point. Let me get on that. I think I finally need to bust out the lookups into a separate file.

[aarongustafson]

This fix is in v2.9.5

[jordanmerrick]

Thank you!

[jordanmerrick]

@aarongustafson I've just updated but am running into the error

undefined method `dig' for nil:NilClass (NoMethodError)`

With --trace:

[jekyll-webmention_io] Beginning to gather webmentions of your posts. This may take a while. 
/var/lib/gems/2.3.0/gems/jekyll-webmention_io-2.9.5/lib/jekyll/generators/gather_webmentions.rb:61:in `check_for_webmentions': undefined method `dig' for nil:NilClass (NoMethodError)
from /var/lib/gems/2.3.0/gems/jekyll-webmention_io-2.9.5/lib/jekyll/generators/gather_webmentions.rb:42:in `block in generate'
from /var/lib/gems/2.3.0/gems/jekyll-webmention_io-2.9.5/lib/jekyll/generators/gather_webmentions.rb:41:in `each'
from /var/lib/gems/2.3.0/gems/jekyll-webmention_io-2.9.5/lib/jekyll/generators/gather_webmentions.rb:41:in `generate'
from /var/lib/gems/2.3.0/gems/jekyll-3.8.3/lib/jekyll/site.rb:175:in `block in generate'
from /var/lib/gems/2.3.0/gems/jekyll-3.8.3/lib/jekyll/site.rb:173:in `each'
from /var/lib/gems/2.3.0/gems/jekyll-3.8.3/lib/jekyll/site.rb:173:in `generate'
from /var/lib/gems/2.3.0/gems/jekyll-3.8.3/lib/jekyll/site.rb:70:in `process'
from /var/lib/gems/2.3.0/gems/jekyll-3.8.3/lib/jekyll/command.rb:28:in `process_site'
from /var/lib/gems/2.3.0/gems/jekyll-3.8.3/lib/jekyll/commands/build.rb:65:in `build'
from /var/lib/gems/2.3.0/gems/jekyll-3.8.3/lib/jekyll/commands/build.rb:36:in `process'
from /var/lib/gems/2.3.0/gems/jekyll-3.8.3/lib/jekyll/commands/serve.rb:93:in `block in start'
from /var/lib/gems/2.3.0/gems/jekyll-3.8.3/lib/jekyll/commands/serve.rb:93:in `each'
from /var/lib/gems/2.3.0/gems/jekyll-3.8.3/lib/jekyll/commands/serve.rb:93:in `start'
from /var/lib/gems/2.3.0/gems/jekyll-3.8.3/lib/jekyll/commands/serve.rb:75:in `block (2 levels) in init_with_program'
from /var/lib/gems/2.3.0/gems/mercenary-0.3.6/lib/mercenary/command.rb:220:in `block in execute'
from /var/lib/gems/2.3.0/gems/mercenary-0.3.6/lib/mercenary/command.rb:220:in `each'
from /var/lib/gems/2.3.0/gems/mercenary-0.3.6/lib/mercenary/command.rb:220:in `execute'
from /var/lib/gems/2.3.0/gems/mercenary-0.3.6/lib/mercenary/program.rb:42:in `go'
from /var/lib/gems/2.3.0/gems/mercenary-0.3.6/lib/mercenary.rb:19:in `program'
from /var/lib/gems/2.3.0/gems/jekyll-3.8.3/exe/jekyll:15:in `<top (required)>'
from /usr/local/bin/jekyll:23:in `load'
from /usr/local/bin/jekyll:23:in `<main>'

[aarongustafson]

Hmm. I'll look into it. Thanks for the heads up. Can you run it again with `debug: true` in the config and include any info right before that error?

…

[jordanmerrick]

@aarongustafson sure, here's the additional debug info:

 Incremental build: disabled. Enable with --incremental
      Generating... 
[jekyll-webmention_io] Beginning to gather webmentions of your posts. This may take a while. 
[jekyll-webmention_io] Checking for webmentions of /posts/185205195243. 
jekyll 3.8.3 | Error:  undefined method `dig' for nil:NilClass

[aarongustafson]

Try now. I added an additional conditional around the code I think is causing the issue for you. v2.9.6

[jordanmerrick]

@aarongustafson thanks for fixing, working fine now. And build time has dropped to less than two minutes, so a big improvement overall.