Add `--log-cdp` / `log_cdp=True` options for capturing CDP logs

[mdmintz]

Add --log-cdp / log_cdp=True options for capturing CDP logs

If enabled, this happens:

chrome_options.set_capability(
    "goog:loggingPrefs", {"performance": "ALL", "browser": "ALL"}
)

Then you can do something like this to display those logs: (Eg. driver.get_log("performance"))

from seleniumbase import Driver

driver = Driver(uc=True, log_cdp=True)
try:
    driver.get("https://seleniumbase.io")
    driver.sleep(3)
    print(driver.get_log("performance"))
finally:
    driver.quit()

Note that UC Mode also has separate --uc-cdp / uc_cdp=True options. That works differently. (See SeleniumBase/examples/uc_cdp_events.py for an example of that.)

[mdmintz]

This was resolved in 4.20.8 - https://github.com/seleniumbase/SeleniumBase/releases/tag/v4.20.8

[MovingW]

That's GREAT!!
Thanks for your quick response Michael.

[KeeonTabrizi]

@mdmintz so if i create a driver as follows

from seleniumbase import Driver

driver = Driver(uc=True, incognito=True, uc_cdp_events=True)

How can I look at a specific request and the response body for that request?

[mdmintz]

#2050 (comment) - To get the response body of a request, first get the requestId. Then, you'll want to execute the following: driver.execute_cdp_cmd("Network.getResponseBody", { "requestId": "<request id>" })

[KeeonTabrizi]

#2050 (comment) - To get the response body of a request, first get the requestId. Then, you'll want to execute the following: driver.execute_cdp_cmd("Network.getResponseBody", { "requestId": "<request id>" })

@mdmintz thanks so much! I'm trying to do something simple to debug...

URL = # define here

def callback(data):
    request_id = data['requestId']
    print(request_id)
    print(data)


driver.add_cdp_listener("*", callback)
driver.get(URL)

When I just use the callback to print(data) I see lots of different things captured (though I still can't find my outgoing request I'm targeting that I can see with seleniumwire. I figured I'd try to just print the requestIds but that portion doesn't seem to print.

With the command you also suggested

driver.execute_cdp_cmd("Network.getResponseBody", { "requestId": "<request id>" })

Where would I actually be able to look at the response body? When running the command would I expect something returned in my console/script? I basically want to store the response body for that particular request (asssuming I can find it) to a variable to then decode.

[mdmintz]

See https://stackoverflow.com/a/52636871/7058266 for details.