Once installed through a secure, verified path, version 18.4 functions as a comprehensive diagnostic engine for your site's health. The system executes deep link crawling to build clear visual models of site performance.
: One of the most significant updates in the 18.x era is the ability to crawl URLs with fragment identifiers ( # ). The spider verifies that a specific ID exists in the HTML, allowing you to find broken bookmarks or "jump links" that would otherwise go unnoticed because they don't return a 404 status. screaming frog seo spider 184 neverb link
Standard crawling agents often fail to capture the full picture. They may see a link on the rendered DOM but fail to note that it is blocked by robots.txt, or they may index a URL without realizing that the on-page link contained a rel="nofollow" attribute. Screaming Frog 18.4 addresses this by treating the link not as a binary connection between Page A and Page B, but as a multi-layered object with distinct properties. The "neverb" link concept arises here—a link that technically exists in code but is functionally inert for SEO purposes due to directives, errors, or manipulation. Once installed through a secure, verified path, version 18
Select a URL and use the "Inlinks" tab in the lower pane to see exactly where this link is located on your website 1.2.3. Why "Neverb" Links Happen (and Should You Fix Them?) The spider verifies that a specific ID exists
When a web page returns a 184 NeverB status code, it can prevent search engine crawlers like Googlebot from accessing and indexing the page's content. This can lead to: