URL List Normalizer | DevAwesome

No crawling and no uploads. The browser parses the text without requesting any URL.Accepts full URLs, bare domains, and common list separators

URL list normalizer

Paste URLsNormalized crawl list

Read the input asUse Lines when a valid URL itself contains commas or semicolons.Query parametersTracking mode removes utm_*, gclid, fbclid, msclkid, and common email tags.

Output format

LinesCommasJSON

Scope hostLeave empty to accept every host.Host scopeProtocol scopeOutput group

Include patternsOptional glob patterns. A URL must match at least one.Exclude patternsMatching URLs remain in the exclusion export with the winning reason.

Add https:// to bare domains Remove #fragments Remove trailing slashes from paths

Ready

How it works

The sample contains the same page in several forms, plus one invalid row. Change the controls and watch which URLs merge.

01
Paste URLs as lines, spreadsheet cells, comma-separated values, or a mixed list. Markdown links are accepted too.
02
Choose parameter cleanup, host and protocol scope, and optional include or exclude patterns.
03
Review page and resource groups, then copy the selected group or download accepted and excluded URLs separately.

What gets normalized

HTTP and HTTPS URLs, including bare domains
Lowercase hostnames, default ports, fragments, and repeated URLs
Optional removal of tracking parameters, full query strings, fragments, and trailing path slashes
Markdown links, ordinary list numbers, and common separators
International domain names through the browser's URL parser
Exact-host, subdomain, protocol, include-pattern, and exclude-pattern boundaries
Separate page, resource, exclusion, and invalid groups with explicit reasons

What the tool cannot know

It does not request, crawl, redirect-check, or verify that a URL exists.
Removing parameters can merge URLs that serve different content. Review the result before crawling or importing it.
It does not decide which URL should be canonical for a website.

Technical reference

URL parsing and serialization use the browser implementation of the WHATWG URL Standard.

WHATWG URL StandardThe parsing and serialization model used by modern browsers.Workbench core contract · 28 August 2026Executable coverage for sitemap extraction, parameters, invalid rows, deduplication, and host grouping.