The built-in URL class provides a convenient interface for creating and parsing URLs.
There are no networking methods that require exactly a URL
object, strings are good enough. So technically we don???t have to use URL
. But sometimes it can be really helpful.
Creating a URL
The syntax to create a new URL
object:
new URL(url, [base])
url
??? the full URL or only path (if base is set, see below),base
??? an optional base URL: if set andurl
argument has only path, then the URL is generated relative tobase
.
For example:
let url = new URL('https://javascript.info/profile/admin');
These two URLs are same:
let url1 = new URL('https://javascript.info/profile/admin');
let url2 = new URL('/profile/admin', 'https://javascript.info');
alert(url1); // https://javascript.info/profile/admin
alert(url2); // https://javascript.info/profile/admin
We can easily create a new URL based on the path relative to an existing URL:
let url = new URL('https://javascript.info/profile/admin');
let newUrl = new URL('tester', url);
alert(newUrl); // https://javascript.info/profile/tester
The URL
object immediately allows us to access its components, so it???s a nice way to parse the url, e.g.:
let url = new URL('https://javascript.info/url');
alert(url.protocol); // https:
alert(url.host); // javascript.info
alert(url.pathname); // /url
Here???s the cheatsheet for URL components:
href
is the full url, same asurl.toString()
protocol
ends with the colon character:
search
??? a string of parameters, starts with the question mark?
hash
starts with the hash character#
- there may be also
user
andpassword
properties if HTTP authentication is present:http://login:password@site.com
(not painted above, rarely used).
URL
objects to networking (and most other) methods instead of a string
We can use a URL
object in fetch
or XMLHttpRequest
, almost everywhere where a URL-string is expected.
Generally, the URL
object can be passed to any method instead of a string, as most methods will perform the string conversion, that turns a URL
object into a string with full URL.
SearchParams ??????????
Let???s say we want to create a url with given search params, for instance, https://google.com/search?query=JavaScript
.
We can provide them in the URL string:
new URL('https://google.com/search?query=JavaScript')
???But parameters need to be encoded if they contain spaces, non-latin letters, etc (more about that below).
So there???s a URL property for that: url.searchParams
, an object of type URLSearchParams.
It provides convenient methods for search parameters:
append(name, value)
??? add the parameter byname
,delete(name)
??? remove the parameter byname
,get(name)
??? get the parameter byname
,getAll(name)
??? get all parameters with the samename
(that???s possible, e.g.?user=John&user=Pete
),has(name)
??? check for the existence of the parameter byname
,set(name, value)
??? set/replace the parameter,sort()
??? sort parameters by name, rarely needed,- ???and it???s also iterable, similar to
Map
.
An example with parameters that contain spaces and punctuation marks:
let url = new URL('https://google.com/search');
url.searchParams.set('q', 'test me!'); // added parameter with a space and !
alert(url); // https://google.com/search?q=test+me%21
url.searchParams.set('tbs', 'qdr:y'); // added parameter with a colon :
// parameters are automatically encoded
alert(url); // https://google.com/search?q=test+me%21&tbs=qdr%3Ay
// iterate over search parameters (decoded)
for(let [name, value] of url.searchParams) {
alert(`${name}=${value}`); // q=test me!, then tbs=qdr:y
}
Encoding
There???s a standard RFC3986 that defines which characters are allowed in URLs and which are not.
Those that are not allowed, must be encoded, for instance non-latin letters and spaces ??? replaced with their UTF-8 codes, prefixed by %
, such as %20
(a space can be encoded by +
, for historical reasons, but that???s an exception).
The good news is that URL
objects handle all that automatically. We just supply all parameters unencoded, and then convert the URL
to string:
// using some cyrillic characters for this example
let url = new URL('https://ru.wikipedia.org/wiki/????????');
url.searchParams.set('key', '??');
alert(url); //https://ru.wikipedia.org/wiki/%D0%A2%D0%B5%D1%81%D1%82?key=%D1%8A
As you can see, both ????????
in the url path and ??
in the parameter are encoded.
The URL became longer, because each cyrillic letter is represented with two bytes in UTF-8, so there are two %..
entities.
Encoding strings
In old times, before URL
objects appeared, people used strings for URLs.
As of now, URL
objects are often more convenient, but strings can still be used as well. In many cases using a string makes the code shorter.
If we use a string though, we need to encode/decode special characters manually.
There are built-in functions for that:
- encodeURI ??? encodes URL as a whole.
- decodeURI ??? decodes it back.
- encodeURIComponent ??? encodes a URL component, such as a search parameter, or a hash, or a pathname.
- decodeURIComponent ??? decodes it back.
A natural question is: ???What???s the difference between encodeURIComponent
and encodeURI
? When we should use either????
That???s easy to understand if we look at the URL, that???s split into components in the picture above:
https://site.com:8080/path/page?p1=v1&p2=v2#hash
As we can see, characters such as :
, ?
, =
, &
, #
are allowed in URL.
???On the other hand, if we look at a single URL component, such as a search parameter, these characters must be encoded, not to break the formatting.
encodeURI
encodes only characters that are totally forbidden in URL.encodeURIComponent
encodes same characters, and, in addition to them, characters#
,$
,&
,+
,,
,/
,:
,;
,=
,?
and@
.
So, for a whole URL we can use encodeURI
:
// using cyrillic characters in url path
let url = encodeURI('http://site.com/????????????');
alert(url); // http://site.com/%D0%BF%D1%80%D0%B8%D0%B2%D0%B5%D1%82
???While for URL parameters we should use encodeURIComponent
instead:
let music = encodeURIComponent('Rock&Roll');
let url = `https://google.com/search?q=${music}`;
alert(url); // https://google.com/search?q=Rock%26Roll
Compare it with encodeURI
:
let music = encodeURI('Rock&Roll');
let url = `https://google.com/search?q=${music}`;
alert(url); // https://google.com/search?q=Rock&Roll
As we can see, encodeURI
does not encode &
, as this is a legit character in URL as a whole.
But we should encode &
inside a search parameter, otherwise, we get q=Rock&Roll
??? that is actually q=Rock
plus some obscure parameter Roll
. Not as intended.
So we should use only encodeURIComponent
for each search parameter, to correctly insert it in the URL string. The safest is to encode both name and value, unless we???re absolutely sure that it has only allowed characters.
URL
Classes URL and URLSearchParams are based on the latest URI specification: RFC3986, while encode*
functions are based on the obsolete version RFC2396.
There are a few differences, e.g. IPv6 addresses are encoded differently:
// valid url with IPv6 address
let url = 'http://[2607:f8b0:4005:802::1007]/';
alert(encodeURI(url)); // http://%5B2607:f8b0:4005:802::1007%5D/
alert(new URL(url)); // http://[2607:f8b0:4005:802::1007]/
As we can see, encodeURI
replaced square brackets [...]
, that???s not correct, the reason is: IPv6 urls did not exist at the time of RFC2396 (August 1998).
Such cases are rare, encode*
functions work well most of the time.