{"id":4196,"date":"2024-12-12T11:38:39","date_gmt":"2024-12-12T11:38:39","guid":{"rendered":"https:\/\/www.rcvtechnologies.com\/blog\/?p=4196"},"modified":"2024-12-13T11:31:27","modified_gmt":"2024-12-13T11:31:27","slug":"how-to-capture-network-log-in-selenium-4-using-cdpchrome-devtools-protocol","status":"publish","type":"post","link":"https:\/\/www.rcvtechnologies.com\/blog\/how-to-capture-network-log-in-selenium-4-using-cdpchrome-devtools-protocol\/","title":{"rendered":"How to capture Network log in Selenium 4 using CDP(Chrome DevTools Protocol)"},"content":{"rendered":"
\n\t\t\t
\n
\n
\n
<\/div>\n
<\/div>\n
<\/div>\n <\/div>\n
\n \n Copy Code<\/span>\n Copied<\/span>\n Use a different Browser<\/span><\/a>\n <\/div>\n <\/div>\n 
<\/p>\n
package testing;\r\nimport java.util.Optional;\r\nimport org.openqa.selenium.chrome.ChromeDriver;\r\nimport org.openqa.selenium.devtools.DevTools;\r\nimport org.openqa.selenium.devtools.v131.network.Network;\r\nimport org.openqa.selenium.devtools.v131.network.model.Request;\r\nimport org.testng.annotations.Test;\r\npublic class Networklog extends BaseTest {\r\n   @Test\r\n   public void captureNetworkRequestLogs() {\r\n      \r\n    DevTools devTools = ((ChromeDriver)driver).getDevTools();\r\n    devTools.createSession();\r\n   \r\n    devTools.send(Network.enable(Optional.empty(), Optional.empty(), Optional.empty()));\r\n   \r\n    devTools.addListener(Network.requestWillBeSent(), requestActivity ->{\r\n   \t   Request request = requestActivity.getRequest();\r\n   \t   System.out.println(request.getUrl());\r\n   \t         \r\n    });\r\n    driver.get(\"https:\/\/weatherstack.com\/\");\r\n   }\r\n}\r\n<\/pre>\n
<\/code><\/pre>\n\t\t\t<\/div>\n        <\/div>\n
Above Java code is using Selenium and Chrome DevTools Protocol (CDP) to capture network request details while visiting the specified webpage (<\/span>https:\/\/weatherstack.com\/<\/span>).<\/span><\/p>\n
In our Networklog\u00a0 class, the output result will be a list of URLs corresponding to the network requests made by the page <\/span>https:\/\/weatherstack.com\/<\/span> during the test execution.<\/span><\/p>\n
Here’s a breakdown of what happens:<\/span><\/p>\n
    \n
  1. DevTools Session<\/b>: A session is created using <\/span>devTools.createSession()<\/span>, which connects the Selenium WebDriver (ChromeDriver) to the Chrome DevTools Protocol. This allows you to interact with the browser’s internal mechanisms.<\/span><\/li>\n
  2. Network Monitoring<\/b>: The line <\/span>devTools.send(Network.enable(Optional.empty(), Optional.empty(), Optional.empty()))<\/span> enables the capture of network events, like requests and responses.<\/span><\/li>\n
  3. Listener for Requests<\/b>: The <\/span>devTools.addListener(Network.requestWillBeSent(), …)<\/span> sets up a listener for network requests that are sent during the page load. Every time a request is made, the listener is triggered.<\/span><\/li>\n
  4. Printing URLs<\/b>: The listener extracts the URL of the network request (<\/span>request.getUrl()<\/span>) and prints it to the console using <\/span>System.out.println(request.getUrl())<\/span>.<\/span><\/li>\n
  5. Webpage Load<\/b>: The line <\/span>driver.get(“https:\/\/weatherstack.com\/”);<\/span> causes Selenium to load the page <\/span>https:\/\/weatherstack.com\/<\/span>, and as the page loads, various network requests will be made (e.g., requests for images, scripts, stylesheets, API calls, etc.).<\/span><\/li>\n<\/ol>\n
     <\/p>\n
    Output :-\u00a0<\/strong><\/p>\n
    \"\"<\/p>\n
    Output Description:<\/b><\/p>\n
      \n
    1. Request URLs<\/b>: The console will output the URLs of all the network requests made by the browser when loading the <\/span>https:\/\/weatherstack.com\/<\/span> website.<\/span>\n
        \n
      • You will see URLs corresponding to:<\/span>\n
          \n
        • The main HTML page (e.g., <\/span>https:\/\/weatherstack.com\/<\/span>).<\/span><\/li>\n
        • API calls made to fetch data (e.g., JSON endpoints).<\/span><\/li>\n
        • Static resources like CSS files, JavaScript files, images, or fonts requested by the page.<\/span><\/li>\n<\/ul>\n<\/li>\n
        • Each URL will be printed on a new line as <\/span>System.out.println(request.getUrl());<\/span> is executed within the listener.<\/span><\/li>\n<\/ul>\n<\/li>\n
        • Timing<\/b>: <\/span>The requests will be logged in the order they are sent by the browser. The network listener captures the request before<\/b> it is sent, so the URLs will appear in real time as they are initiated by the page load.<\/li>\n<\/ol>\n
          Capturing Chrome DevTools (CDT) results, such as network requests, using Selenium offers several benefits for web automation, debugging, and performance analysis. Here are some key advantages:<\/span><\/p>\n
          \u00a0\u00a0\u00a0Network Traffic Monitoring:<\/b>–<\/span><\/p>\n
          \u00a0 \u00a01. Detailed Network Insights<\/b>: By capturing network requests, you can track all API calls, resources loaded (e.g., images, scripts), and responses. This is particularly useful for debugging issues related to resource loading or identifying failures in API requests.<\/span><\/p>\n
          \u00a0 \u00a02. Latency and Timing Analysis<\/b>: You can measure the time taken for different requests to complete, identify slow-loading resources, and optimize performance by analyzing the request and response times.<\/span><\/p>\n
          Monitoring External Services and API Interactions:-<\/b><\/p>\n
          API Testing<\/b>: You can monitor interactions with APIs, checking whether correct requests are made and ensuring that the expected responses are returned. This is especially important for applications that rely heavily on external services.<\/span><\/p>\n
          Validating API Responses<\/b>: You can also verify the data returned by APIs and ensure that it is correctly handled by the application (e.g., checking if the correct JSON data is parsed).<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"
          Above Java code is using Selenium and Chrome DevTools Protocol (CDP) to capture network request details while visiting the specified webpage (https:\/\/weatherstack.com\/). In our Networklog\u00a0 class, the output result will be a list of URLs corresponding to the network requests made by the page https:\/\/weatherstack.com\/ during the test execution. Here’s a breakdown of what happens: […]<\/p>\n","protected":false},"author":7,"featured_media":4202,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_uf_show_specific_survey":0,"_uf_disable_surveys":false,"footnotes":""},"categories":[331,173],"tags":[],"class_list":["post-4196","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-selenium","category-tech"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.rcvtechnologies.com\/blog\/wp-json\/wp\/v2\/posts\/4196","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rcvtechnologies.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.rcvtechnologies.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.rcvtechnologies.com\/blog\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rcvtechnologies.com\/blog\/wp-json\/wp\/v2\/comments?post=4196"}],"version-history":[{"count":5,"href":"https:\/\/www.rcvtechnologies.com\/blog\/wp-json\/wp\/v2\/posts\/4196\/revisions"}],"predecessor-version":[{"id":4204,"href":"https:\/\/www.rcvtechnologies.com\/blog\/wp-json\/wp\/v2\/posts\/4196\/revisions\/4204"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.rcvtechnologies.com\/blog\/wp-json\/wp\/v2\/media\/4202"}],"wp:attachment":[{"href":"https:\/\/www.rcvtechnologies.com\/blog\/wp-json\/wp\/v2\/media?parent=4196"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.rcvtechnologies.com\/blog\/wp-json\/wp\/v2\/categories?post=4196"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rcvtechnologies.com\/blog\/wp-json\/wp\/v2\/tags?post=4196"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}