• Home

Ivan Porto Carrero

thoughts.each { &:propagandise }

1. Beni November 29, 2009 at 12:59

   .asia ?
2. wilma November 30, 2009 at 17:57

   Nice work. But this regex doesn’t cover IP-Addresses as hostnames. Unfortunately i was unable to fix it in a good way.
3. Manasto December 3, 2009 at 08:12

   um…. i think you would absolutely be safe with something like (?:[a-zA-z}{2,8}) for Top Level Domains I don’t know what the max is, but i know the minimum is 2 characters for a dn.
4. Esben stien December 5, 2009 at 21:01

   Well, this is not a general URL regular expression

   I’ve never tried to create one myself, cause I believe the IETF or some friends of them has already done this.

   Btw, something like http/ftp should not be included in the regex. as long as it follow a general format of : it’s a URL
5. ivan December 5, 2009 at 23:00

   I think you missed the part of the post where it said what the purpose was. I’m sorry if URL isn’t used in the exact definition of the abbreviation URL. But lets not dwell on that.
6. testestest December 7, 2009 at 14:47

   what about domains with asian or russian characters? i think now there are even chinese or korean top level domains possible, for example “中国”…
7. smb January 7, 2010 at 17:37

   Don’t care about russian and asian characters. Before you validate an URL, you have to convert it to PunyCode, which only uses A-Z, 0-9 and -. So “中国” ain’t in URLs
8. petrelevich February 5, 2010 at 21:08

   What would you say about this?

   ^(?:(?:(?:http[s]?):\/\/)|(?:www.))(?:[-_0-9a-z] .) [-_0-9a-z]{2,4}[:0-9]*[\/]*$
9. J. Benitez February 7, 2010 at 05:16

   There’s no browser that can handle it
10. matapult February 8, 2010 at 11:55

    Nope, didn’t work for me. I tried this ultra-basic implementation in python

    —————————————————————
    #!/usr/bin/env python

    import re
    line =”this is an example of a url that someone might write in some text http://www.google.com test test test”
    urls = []

    urls.append( re.findall( r”^(?#Protocol)(?:(?:ht|f)tp(?:s?)\:\/\/|~\/|\/)?(?#Username:Password)(?:\w :\w @)?(?#Subdomains)(?:(?:[-\w] \.) (?#TopLevel Domains)(?:com|org|net|gov|mil|biz|info|mobi|name|aero|jobs|museum|travel|[a-z]{2}))(?#Port)(?::[\d]{1,5})?(?#Directories)(?:(?:(?:\/(?:[-\w~!$ |.,=]|%[a-f\d]{2}) ) |\/) |\?|#)?(?#Query)(?:(?:\?(?:[-\w~!$ |.,*:]|%[a-f\d{2}]) =?(?:[-\w~!$ |.,*:=]|%[a-f\d]{2})*)(?:&(?:[-\w~!$ |.,*:]|%[a-f\d{2}]) =?(?:[-\w~!$ |.,*:=]|%[a-f\d]{2})*)*)*(?#Anchor)(?:#(?:[-\w~!$ |.,*:=]|%[a-f\d]{2})*)?$”, line ) )

    print urls
    —————————————————

    and it didnt find anything, not even the basic google.com
11. Rene February 15, 2010 at 20:12

    I tried it with PHP and works flawlessly, I tried like 8 different ones from regexlibrary.com and this one killed them all. I’m just wondering if it will work with JS, I’ll keep you guys posted…
12. zerkms February 16, 2010 at 01:40

    what about “&” in urls?
13. zerkms February 16, 2010 at 01:42

    in the last comment i mean “& amp;” (without space)
14. Mina February 23, 2010 at 08:45

    Thanks a lot for this wonderful article
15. Alexey Novikov March 14, 2010 at 11:09

    I’ve enhanced it. Now it works with IPs
    Even if you write 1.01.001.000
    
^(?#Protocol)(?:(?:ht|f)tp(?:s?)\:\/\/|~\/|\/)?(?#Username:Password)(?:\w :\w @)?((?#Subdomains)(?:(?:[-\w] \.) (?#TopLevel Domains)(?:com|org|net|gov|mil|biz|info|mobi|name|aero|jobs|museum|travel|[a-z]{2}))|(?#IP)((\b25[0-5]\b|\b[2][0-4][0-9]\b|\b[0-1]?[0-9]?[0-9]\b)(\.(\b25[0-5]\b|\b[2][0-4][0-9]\b|\b[0-1]?[0-9]?[0-9]\b)){3}))(?#Port)(?::[\d]{1,5})?(?#Directories)(?:(?:(?:\/(?:[-\w~!$ |.,=]|%[a-f\d]{2}) ) |\/) |\?|#)?(?#Query)(?:(?:\?(?:[-\w~!$ |.,*:]|%[a-f\d{2}]) =?(?:[-\w~!$ |.,*:;=]|%[a-f\d]{2})*)(?:&(?:[-\w~!$ |.,*:]|%[a-f\d{2}]) =?(?:[-\w~!$ |.,*:;=]|%[a-f\d]{2})*)*)*(?#Anchor)(?:#(?:[-\w~!$ |.,*:;=]|%[a-f\d]{2})*)?$

16. Alexey Novikov March 14, 2010 at 18:21

    By the way, there can be slashes after the anchor symbol (octothorp or dies or sharp). For example, in some gmail links. So if we do not to mark such URLs as invalid, we should include slash in the last part of this regexp:

    
(?#Anchor)(?:#(?:[-\w~!$ |/.,*:;=]|%[a-f\d]{2})*)?$

17. anonymous May 6, 2010 at 00:55

    Thanks Ivan. You have really helped me with this extensive regular expression. I was wanting to validate a URL in Java and was surprised that there was no decent library to do this (Apache commons which has one doesn’t build properly and seems outdated – and anyway you have to import thousands of lines of code to validate a URL… yawn! lol).

    Here’s the Java code for anyone interested (where URL_REGEXP is your regular expression – don’t forget to replace all ‘\’ with ‘\\’ when setting it as a constant):
    
String url = "http://flanders.co.nz/2009/11/08/a-good-url-regular-expression-repost/";
if (!url.matches(URL_REGEXP))
{
// Invalid URL.
}
else
{
// Valid URL.
}

18. Anonymous May 6, 2010 at 01:59

    Here’s a Java class I wrote using your regular expression:

    
/**
* This class implements URL validation.
* @author Mike Youell (wrote class) + Ivan Porto Carrero (wrote regular expression).
* @date 06 May 2010
*/
public class URLValidator
{
// The regular expression which validates a URL.
// Found here: http://flanders.co.nz/2009/11/08/a-good-url-regular-expression-repost/
private static final String URL_VALIDATION_REG_EXP = "^(?:(?:ht|f)tp(?:s?)\\:\\/\\/|~\\/|\\/)?(?:\\w+:\\w+@)?(?:(?:[-\\w]+\\.)+(?:com|org|net|gov|mil|biz|info|mobi|name|aero|jobs|museum|travel|[a-z]{2}))(?::[\\d]{1,5})?(?:(?:(?:\\/(?:[-\\w~!$+|.,=]|%[a-f\\d]{2})+)+|\\/)+|\\?|#)?(?:(?:\\?(?:[-\\w~!$+|.,*:]|%[a-f\\d{2}])+=?(?:[-\\w~!$+|.,*:=]|%[a-f\\d]{2})*)(?:&(?:[-\\w~!$+|.,*:]|%[a-f\\d{2}])+=?(?:[-\\w~!$+|.,*:=]|%[a-f\\d]{2})*)*)*(?:#(?:[-\\w~!$+|.,*:=]|%[a-f\\d]{2})*)?$";

    /**
    * Is the URL valid?
    * @param[in] url - The URL to validate.
    * @return true if it's a valid URL, otherwise false.
    */
    static public boolean isValid(String url)
    {
    // Is the URL valid?
    if (url.matches(URL_VALIDATION_REG_EXP))
    {
    // yes.
    return true;
    }

    // no.
    return false;
    }
    }
    

    p.s. there’s a bug in your <code> tag – it removes all leading whitespace which messes up the indentation of code.
19. Vially May 12, 2010 at 02:13

    Thanks for this great regex.

    However I think there is a small mistake on line 4 column 37:
    %[a-f\d{2}]
    should actually be
    %[a-f\d]{2}

    Cheers!
20. Артём Курапов May 31, 2010 at 09:26

    Mine is simple – beginning should be a protocol and end should be space. And i manually add space to my data so that end would match too. I guess its simplest and most general

    /((http|https|ftp):\/\/([^ ]*)) /i
21. marc June 6, 2010 at 12:09

    Very nice regex. Thank You. But be careful, your last posts miss the plus “+” character.
    I don’t want to post the whole regex again, so replace every space character within this regex with “+”, then it works perfectly (also with python).
22. Marcin Smolka June 25, 2010 at 14:44

    Thanks for great regex. But not working with redirection urls:

    http://www.redirectme.com/redirector.php?url=http://toberedirected.com/files/1.html
23. droope July 11, 2010 at 23:46

    IMHO:

    $regexUrl = “/\b(([\w-]+:\/\/?|www[.]|(\w+\.))([^\s()]+(?:\([\w\d]+\)|([^[:punct:]\s]|\/))))/”;

    This one matches all kinds of links OK, even ones like asd.domain.com .

    Recommendation:

    function urls_to_links($originalString) {
    return preg_replace(“/\b(([\w-]+:\/\/?|(www[.]|\w+\.))([^\s()]+(?:\([\w\d]+\)|([^[:punct:]\s]|\/))))/”, ‘$1‘, $originalString);
    }
24. droope July 11, 2010 at 23:47

    ¡Ahh! how do you paste code?

    You can view my original blog post at http://droope.wordpress.com/2010/07/08/regexpara-convertir-urls-a-links/
25. jingle July 29, 2010 at 03:34

    But here I get stuck with the short url http://to./, which makes the provided regex failed, any ideas? thanks
26. MicE September 2, 2010 at 17:19

    Hi,
    just wanted to thank Ivan et al for the pattern – this is the most reasonable one that I’ve seen so far (I’m not counting monstrosities which validate international URIs or IPv6 addresses).

    I’ve made 3 modifications which I wanted to share back as thanks for the provided pattern:
    1.) added validation for IPv4 addresses
    2.) made the hostname part optional, thus allowing relative URLs (so make sure to validate for empty strings outside of the code below)
    3.) list of TLDs has been updated according to http://data.iana.org/TLD/tlds-alpha-by-domain.txt (incorporating newly approved TLDs)

    Note: single part hostnames (e.g. “localhost”) and non-ASCII URIs were kept unsupported.

    Here is the code for PHP (pattern should be language agnostic):

    function validate_uri( $uri ) {
    $pattern = ‘/^’
    .’(‘
    .’(?#Protocol)(?:(?:ht|f)tp(?:s?)\:\/\/|~\/|\/)?’
    .’(?#Username:Password)(?:\w+:\w+@)?’
    .’(‘ // allow domain name or IP address
    .’(?#Subdomains)(?:(?:[-\w]+\.)+’
    .’(?#TopLevelDomains)(?:aero|arpa|asia|biz|cat|com|coop|edu|gov|info|int|jobs|mil|mobi|museum|name|net|org|pro|tel|travel|[a-z]{2}))’
    .’|’
    .’(?#IpAddress)(?:(?:\d|[1-9]\d|1\d{2}|2[0-4][0-9]|25[0-5])\.){3}(?:\d|[1-9]\d|1\d{2}|2[0-4][0-9]|25[0-5])’
    .’)’
    .’(?#Port)(?::[\d]{1,5})?’
    .’)?’
    .’(?#Directories)(?:(?:(?:\/(?:[-\w~!$+|.,=]|%[a-f\d]{2})+)+|\/)+|\?|#)?’
    .’(?#Query)(?:(?:\?(?:[-\w~!$+|.,*:]|%[a-f\d{2}])+=?(?:[-\w~!$+|.,*:=]|%[a-f\d]{2})*)(?:&(?:[-\w~!$+|.,*:]|%[a-f\d{2}])+=?(?:[-\w~!$+|.,*:=]|%[a-f\d]{2})*)*)*’
    .’(?#Anchor)(?:#(?:[-\w~!$+|.,*:=]|%[a-f\d]{2})*)?’
    .’$/i’;

    $result = preg_match($pattern, $url);
    if($result > 0) {
    return true;
    }

    return false;
    }

    Thanks,
    M.
27. Shelby Moore September 15, 2010 at 23:04

    I am not admiring the regular expressions on this blog page.

    The standard RegEx is:

    http://labs.apache.org/webarch/uri/rfc/rfc3986.html#regexp

    (([^:/?#]+):)?(//([^/?#]*))?([^?#]*)(\?([^#]*))?(#(.*))?

    If you want to match only specific schemes, don’t want optional sheme or host, and you want to disallow spaces so that you can search in text, then use:

    ((http(s)?|ftp):)(//([^/?#\s]*))([^?#\s]*)(\?([^#\s]*))?(#([^\s]*))?

    If you want to allow for www. without the http(s)?:// then use:

    (?:(())(www\.([^/?#\s]*))|((http(s)?|ftp):)(//([^/?#\s]*)))([^?#\s]*)(\?([^#\s]*))?(#([^\s]*))?

    If you want to validate the host, then I suggest doing it as a separate RegEx, so at least the RegEx above won’t fail to match any valid urls.
28. Shelby Moore September 16, 2010 at 08:14

    An improved version.

    // http://labs.apache.org/webarch/uri/rfc/rfc3986.html#regexp
    //
    // (?:([^:/?#]+):)?(?://([^/?#]*))?([^?#]*)(\?([^#]*))?(#(.*))?
    //
    // $@ matches the entire url
    // $1 matches scheme (http, ftp, mailto, ym, mshelp, etc)
    // $2 matches authority (host, ftp user:pwd@host, etc)
    // $3 matches path
    // $4 matches query (http GET REST api, etc)
    // $5 matches fragment (html anchor, etc)
    //
    // Match specific schemes, non-optional authority, disallow white-space so can delimit in text, and allow ‘www.’ w/o scheme
    // Note the schemes must match ^[^|:/?#\s]+(?:\|[^|:/?#\s]+)*$
    //
    // (?:()(www\.[^/?#\s]+\.[^/?#\s]+)|(schemes)://([^/?#\s]*))([^?#\s]*)(\?([^#\s]*))?(#([^\s]*))?
    //
    // Validate the authority with an orthogonal RegEx, so at least the RegEx above won’t fail to match any valid urls.
    function urlRegEx ( schemes, flags )
    {
    if( !RegExp( ‘/^[^|:/?#\s]+(?:\|[^|:/?#\s]+)*$/’ ).test( schemes ) )
    throw TypeError( “Expected schemes” )
    return new RegExp( ‘(?:()(www\.[^/?#\s]+\.[^/?#\s]+)|(‘ + schemes + ‘)://([^/?#\s]*))([^?#\s]*)(\?([^#\s]*))?(#([^\s]*))?’, flags )
    }
29. kae September 27, 2010 at 20:28

    I use (s?https?|s?ftp|telnet|news|imap|mailto|mms|s?news|nntp|prospero|rsync|rtspu?|sips?|k?svn(\++(ssh|https?))?|telnet|wais) to match the protocol, which includes all those I’ve come across with. I’m sure there’s more; though it depends on how ridiculous you want to get.
30. Snippet: URL Regex | jbrooksuk blog - pingback on October 2, 2010 at 20:25
31. ppshoo October 13, 2010 at 17:37

    Thank you so much for making my search for the perfect URL regEx came to an end.

Copyright © 2012 Ivan Porto Carrero | Theme zBench | Powered by WordPress