Proxy support

Can not get to work new Firefox 47 / MarionetteDriver via socks proxy. Here is my code:

Proxy proxy = new Proxy();
proxy.setSocksProxy("localhost:22001");
DesiredCapabilities capability = new DesiredCapabilities();
capability.setCapability(CapabilityType.PROXY, proxy);
MarionetteDriver driver = new MarionetteDriver(capability);
driver.get("https://httpbin.org/ip");

But browser use my machine IP, not this socks. This socks proxy is absolutely working, when I set up it in Firefox 47 via Preferences -> Network manually it works fine.

How to set up socks proxy for Selenium MarionetteDriver?

[jgraham]

The proxy capability is not yet supported. You can currently provide a custom profile with the proxy settings in the prefs file as a workaround. Let me know if you need help with that.

[aimeerivers]

How do you provide a custom profile? We are having trouble doing that, Marionette is saying it's not a valid option.

[andreastt]

@sermoa Can you provide a reproducible test case? What input are you giving, what errors are you getting back?

[andreastt]

It looks like proxy support was added in https://hg.mozilla.org/mozilla-central/rev/27039dda138e as part of bug 1165449, so it would be interesting to find out why it does not work for you.

It should be possible to use a SOCKS proxy with the following capabilities (pseudo code):

capabilities = {
  "requiredCapabilities": {
    "proxy": {
      "proxyType": "manual",
      "socksProxy": url,
      "socksProxyPort": port,
      "socksVersion": 4,
      "socksUsername": "cake",
      "socksPassword": "made with cake"
    }
  }
}
driver = new_session(capabilities)

[Francis-Smith]

I'm using c# and would love to see an example of the proxy workaround mentioned by jgraham above.

Currently I've got:

            this.service = FirefoxDriverService.CreateDefaultService();
            this.service.FirefoxBinaryPath = @"C:\Program Files (x86)\Mozilla Firefox\firefox.exe";
            if (useProxy)
            {
                this.service.FirefoxBinaryPath += " -no-remote -P proxy_profile";
            }

            this.Driver = new FirefoxDriver(this.service);

and have setup the proxy_profile but the firefox instance that runs up does not use the proxy. When I manually run up firefox from a dos prompt using the same arguments, it uses the proxy fine.

[andreastt]

@serge-nikitin Can you provide more debug information? If you see my above comment, Marionette does have proxy support, and it works in our internal tests.

@andreastt

Code:

        Proxy proxy = new Proxy();
        proxy.setSocksProxy("localhost:22001");
        DesiredCapabilities capability = new DesiredCapabilities();
        capability.setCapability(CapabilityType.PROXY, proxy);
        MarionetteDriver driver = new MarionetteDriver(capability);
        driver.get("https://httpbin.org/ip");

Output in console:

1466694643996   Marionette  DEBUG   Marionette enabled via build flag and pref
1466694644107   Marionette  INFO    Listening on port 2828
1466694644199   Marionette  DEBUG   Marionette enabled via command-line flag
1466694644275   Marionette  DEBUG   Accepted connection conn0 from 127.0.0.1:64068
1466694644309   Marionette  TRACE   conn0 -> [0,1,"newSession",{"capabilities":{"desiredCapabilities":{"proxy":{"autodetect":false,"class":"org.openqa.selenium.Proxy","ftpProxy":null,"hCode":1297149880,"httpProxy":null,"noProxy":null,"proxyAutoconfigUrl":null,"proxyType":"MANUAL","socksPassword":null,"socksProxy":"localhost:22001","socksUsername":null,"sslProxy":null}},"requiredCapabilities":{}},"sessionId":null}]
1466694644310   Marionette  CONFIG  Changing capabilities: {"browserName":"Firefox","browserVersion":"47.0","platformName":"Darwin","platformVersion":"15.5.0","specificationLevel":0,"raisesAccessibilityExceptions":false,"rotatable":false,"acceptSslCerts":false,"takesElementScreenshot":true,"takesScreenshot":true,"proxy":{},"platform":"DARWIN","XULappId":"{ec8030f7-c20a-464f-9b0e-13a3a9e97384}","appBuildId":"20160604131506","device":"desktop","version":"47.0"}
1466694645028   Marionette  DEBUG   loaded listener.js
1466694645030   Marionette  DEBUG   loaded listener.js
1466694645114   Marionette  TRACE   conn0 <- [1,1,null,{"sessionId":"d5e38640-d980-bb46-a667-37e8e39303cd","capabilities":{"browserName":"Firefox","browserVersion":"47.0","platformName":"Darwin","platformVersion":"15.5.0","specificationLevel":0,"raisesAccessibilityExceptions":false,"rotatable":false,"acceptSslCerts":false,"takesElementScreenshot":true,"takesScreenshot":true,"proxy":{},"platform":"DARWIN","XULappId":"{ec8030f7-c20a-464f-9b0e-13a3a9e97384}","appBuildId":"20160604131506","device":"desktop","version":"47.0","command_id":1}}]
1466694645137   Marionette  TRACE   conn0 -> [0,2,"get",{"url":"https://httpbin.org/ip"}]
1466694645825   Marionette  TRACE   conn0 <- [1,2,null,{}]

Firefox 47.0, OS X 10.11.5.

So this Firefox via MarionetteDriver when opens https://httpbin.org/ip shows my IP, not the proxy.

When I input this proxy localhost:22001 in Firefox manually via Preferences -> Network manually it works fine.

[jleyba]

It looks like geckodriver only looks for proxy settings in the "requiredCapabilities" parameter.

Specifying a proxy via desiredCapabilities (notice the return session capabilities shows no proxy settings):

[2016-06-28T17:40:27Z] [FINER] [webdriver.http.Executor] >>>
POST /session HTTP/1.1
accept: application/json; charset=utf-8

{"desiredCapabilities":{"browserName":"firefox","proxy":{"proxyType":"manual","httpProxy":"127.0.0.1:47881"}}}
[2016-06-28T17:40:31Z] [FINER] [webdriver.http.Executor] <<<
HTTP/1.1 200
connection: close
date: Tue, 28 Jun 2016 17:40:31 GMT
content-type: application/json
content-length: 489

{"sessionId":"49f138f9-ac88-4a9f-b12a-06cc2dc862d4","value":{"XULappId":"{ec8030f7-c20a-464f-9b0e-13a3a9e97384}","acceptSslCerts":false,"appBuildId":"20160606114208","browserName":"Firefox","browserVersion":"47.0","command_id":1,"device":"desktop","platform":"LINUX","platformName":"Linux","platformVersion":"3.13.0-88-generic","proxy":{},"raisesAccessibilityExceptions":false,"rotatable":false,"specificationLevel":0,"takesElementScreenshot":true,"takesScreenshot":true,"version":"47.0"}}

Specifying a proxy using requiredCapabilities:

[2016-06-28T17:39:52Z] [FINER] [webdriver.http.Executor] >>>
POST /session HTTP/1.1
accept: application/json; charset=utf-8

{"desiredCapabilities":{"browserName":"firefox"},"requiredCapabilities":{"proxy":{"proxyType":"manual","httpProxy":"127.0.0.1:53477"}}}
[2016-06-28T17:39:55Z] [FINER] [webdriver.http.Executor] <<<
HTTP/1.1 200
content-length: 539
date: Tue, 28 Jun 2016 17:39:55 GMT
connection: close
content-type: application/json

{"sessionId":"4771d21f-bcd0-4b71-aaea-eb4723c62f57","value":{"XULappId":"{ec8030f7-c20a-464f-9b0e-13a3a9e97384}","acceptSslCerts":false,"appBuildId":"20160606114208","browserName":"Firefox","browserVersion":"47.0","command_id":1,"device":"desktop","platform":"LINUX","platformName":"Linux","platformVersion":"3.13.0-88-generic","proxy":{"httpProxy":"127.0.0.1:53477","proxyType":"manual"},"raisesAccessibilityExceptions":false,"rotatable":false,"specificationLevel":0,"takesElementScreenshot":true,"takesScreenshot":true,"version":"47.0"}}

[jgraham]

Yes, you are right[1]. We should work around this.

[1] https://dxr.mozilla.org/mozilla-central/source/testing/marionette/driver.js#601

[andreastt]

Filed bug 1282873.

[jleyba]

I also noticed marionette requires host and port be specified separately: {httpProxy: "127.0.0.1", httpProxyPort: 1234}. The W3C is a bit ambiguous on this (chromedriver accepts {httpProxy: "127.0.0.1:1234})

Marionette is probably doing the right thing, but would it be possible for it to return an error if httpProxy is set but not httpProxyPort? (and likewise for other proxy types)

[andreastt]

I believe Marionette (and the spec) is doing what FirefoxDriver used to do, and it looks like that only very recently changed by a commit from @juangj: SeleniumHQ/selenium@5d1741b

[juangj]

I don't think I changed how the proxy capabilities are read. As far as I can tell, FirefoxDriver has always read just the single 'httpProxy' value; I can't find any reference to 'httpProxyPort' in FirefoxDriver code, now or in the past.

The fact that ChromeDriver does the same thing makes me believe that this is just a difference between OSS and W3C, and not a behavior change in FirefoxDriver.