Add normalize_url option

[hokaccha]

ref: #110

metainspector can't access This page.

Template:～ - Wikipedia

But, another HTTP Client can access it.

require 'metainspector'
require 'open-uri'
require 'httpclient'
require 'faraday'

url = 'http://ja.wikipedia.org/wiki/Template:%EF%BD%9E'

# metainspector
puts MetaInspector.new(url).response.status #=> 404

# open-uri
puts open(url).status #=> 200

# httpclient
puts HTTPClient.new.get(url).status #=> 200

# faraday
puts Faraday.new(url).get.status #=> 200

This issue is caused URL normalization. This patch allows you to disable URL normalization by option.

MetaInspector.new(url, normalize_url: false)

[jaimeiniesta]

Thanks @hokaccha, your PR is OK, but before we add this option let me ask at the Addressable project to see if this is a bug in normalization on their side. If not, I'll merge this.

[jaimeiniesta]

@hokaccha here's the issue I've opened upstream in case you want to participate in the conversation:

sporkmonger/addressable#182

[hokaccha]

@jaimeiniesta OK, Thank you for your report!

[jaimeiniesta]

No news from the addressable team yet, so I've merged this to be able to skip normalization.

Thanks @hokaccha 👍

[jaimeiniesta]

I've released v4.1.0 which includes this patch.

[hokaccha]

@jaimeiniesta Thanks 👍