Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Major speed improvement: less HTTP requests #3

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

dolmen
Copy link

@dolmen dolmen commented Jan 23, 2016

Major speed improvements:

  • enable connection caching in LWP
  • sort links to better use of this connection caching: connections to the same host will be tested in sequence
  • check each URL only once (use a cache for responses accross files)
  • remove duplicated links from a file before checking them

On my project dolmen/github-keygen I have a 2.27x improvement: 18s instead of 41s.

dolmen added 5 commits May 6, 2015 00:27
... instead of creating a new one for each POD file.
Default keep_alive: 8 connections.
Links are sorted so that links to the same host/port will be processed
next to each other to maximize reuse of cached connections.
@dolmen
Copy link
Author

dolmen commented Jan 24, 2016

Cc: @karenetheridge

@dolmen
Copy link
Author

dolmen commented Oct 24, 2016

I would appreciate a review or co-maint rights on PAUSE.

@dolmen
Copy link
Author

dolmen commented Oct 24, 2016

The GitHub account @apocalypse shows no activity since November 4th, 2014. Last release on PAUSE is November 14th, 2014.

@dolmen
Copy link
Author

dolmen commented Oct 24, 2016

The repositories at BitBucket do not show more commit activity. https://bitbucket.org/Apocal/profile/repositories (the "Last updated 2015-05-30" is misleading).

Has something bad happened?

@karenetheridge
Copy link

+1. also requested in https://rt.cpan.org/Ticket/Display.html?id=105274.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants