c++ - Do C++11 regular expressions work with UTF-8 strings? -

-

if want use c++11's regular expressions unicode strings, work char* utf-8 or have convert them wchar_t* string?

you need test compiler , system using, in theory, supported if system has utf-8 locale. following test returned true me on clang/os x.

bool test_unicode() {     std::locale old;     std::locale::global(std::locale("en_us.utf-8"));      std::regex pattern("[[:alpha:]]+", std::regex_constants::extended);     bool result = std::regex_match(std::string("abcdéfg"), pattern);      std::locale::global(old);      return result; }

note: compiled in file utf-8 encoded.

just safe used string explicit hex versions. worked also.

bool test_unicode2() {     std::locale old;     std::locale::global(std::locale("en_us.utf-8"));      std::regex pattern("[[:alpha:]]+", std::regex_constants::extended);     bool result = std::regex_match(std::string("abcd\xc3\xa9""fg"), pattern);      std::locale::global(old);      return result; }

update test_unicode() still works me

$ file regex-test.cpp  regex-test.cpp: utf-8 unicode c program text  $ g++ --version configured with: --prefix=/applications/xcode-8.2.1.app/contents/developer/usr --with-gxx-include-dir=/usr/include/c++/4.2.1 apple llvm version 8.0.0 (clang-800.0.42.1) target: x86_64-apple-darwin15.6.0 thread model: posix installeddir: /applications/xcode-8.2.1.app/contents/developer/toolchains/xcodedefault.xctoolchain/usr/bin

Comments

Post a Comment

Popular posts from this blog

c# - SVN Error : "svnadmin: E205000: Too many arguments" -

-
i trying reposotries using c# code process svncommand = null; var psi = new processstartinfo("svnadmin"); psi.redirectstandardoutput = true; psi.redirectstandarderror = true; psi.useshellexecute = false; psi.arguments= @"dump c:\repositories\myrepo > c:\temp\myrepodumpfile.dump"; using (svncommand = process.start(psi)) { var myoutput = svncommand.standardoutput; var myerror = svncommand.standarderror; debug.write("output :" + environment.newline + environment.newline + myoutput.readtoend() + environment.newline + "error :" + environment.newline + environment.newline + myerror.readtoend()); svncommand.close(); } when use dump command commandline svnadmin dump c:\repositories\myrepo > c:\temp\myrepodumpfile.dump it works fine when try ...
Read more

c++ - Using OpenSSL in a multi-threaded application -

-
i have been writing soap client application in c++ on ubuntu using openssl https transport , pthreads threading. have number of threads - 1 central data acquisition thread periodically gets worker threads make soap requests via shared mutex protected queues. reading documentation openssl found is openssl thread-safe? in openssl faq describes mechanisms required ensure thread safety when using openssl. implemented , works fine. the reason question conceptual difficulty really. thinking implementing same functionality application has already, instead of using threads, create 2 seperate applications : 1 worker thread (of multiple copies running) , main data acquisition thread. use tcp sockets communicate between 2 rather mutex protected queues. may bad idea not important - confusing me would have implement same functions required ensure openssl thread safety in second approach or not? my guess not have , treated independent (indeed surely must many applications use openssl) re...
Read more

All overlapping substrings matching a java regex -

-
is there api method returns (possibly overlapping) substrings match regular expression? for example, have text string: string t = 04/31 412-555-1235; , , have pattern: pattern p = new pattern("\\d\\d+"); matches strings of 2 or more characters. the matches are: 04, 31, 412, 555, 1235. how overlapping matches? i want code return: 04, 31, 41, 412, 12, 55, 555, 55, 12, 123, 1235, 23, 235, 35. theoretically should possible -- there obvious o(n^2) algorithm enumerates , checks substrings against pattern. edit rather enumerating substrings, safer use region(int start, int end) method in matcher . checking pattern against separate, extracted substring might change result of match (e.g. if there non-capturing group or word boundary check @ start/end of pattern). edit 2 actually, it's unclear whether region() expect zero-width matches. specification vague, , experiments yield disappointing results. for example: string line = "xx90xx"; strin...
Read more