string - Sentences division -

-

i have divide text separated sentences.

ok. seem simple.

just search "." or "?" or "!" , add next sentence array.

but unfortunately not great , simple.

how can avoid situation when:

washington, d.c.

will splitted for: "washington, d" , "c".

or

“one time set off explosive under chair of our teacher, mrs. thurman."

is splitted on:

"one time set off explosive under chair of our teacher, mrs"

and

"thurman"

maybe database acronyms contains "." ?

thanks tips in advance!

check out nltk. has out-of-the-box solutions problems described


Comments

Post a Comment

Popular posts from this blog

All overlapping substrings matching a java regex -

-
is there api method returns (possibly overlapping) substrings match regular expression? for example, have text string: string t = 04/31 412-555-1235; , , have pattern: pattern p = new pattern("\\d\\d+"); matches strings of 2 or more characters. the matches are: 04, 31, 412, 555, 1235. how overlapping matches? i want code return: 04, 31, 41, 412, 12, 55, 555, 55, 12, 123, 1235, 23, 235, 35. theoretically should possible -- there obvious o(n^2) algorithm enumerates , checks substrings against pattern. edit rather enumerating substrings, safer use region(int start, int end) method in matcher . checking pattern against separate, extracted substring might change result of match (e.g. if there non-capturing group or word boundary check @ start/end of pattern). edit 2 actually, it's unclear whether region() expect zero-width matches. specification vague, , experiments yield disappointing results. for example: string line = "xx90xx"; strin...
Read more

c++ - Using OpenSSL in a multi-threaded application -

-
i have been writing soap client application in c++ on ubuntu using openssl https transport , pthreads threading. have number of threads - 1 central data acquisition thread periodically gets worker threads make soap requests via shared mutex protected queues. reading documentation openssl found is openssl thread-safe? in openssl faq describes mechanisms required ensure thread safety when using openssl. implemented , works fine. the reason question conceptual difficulty really. thinking implementing same functionality application has already, instead of using threads, create 2 seperate applications : 1 worker thread (of multiple copies running) , main data acquisition thread. use tcp sockets communicate between 2 rather mutex protected queues. may bad idea not important - confusing me would have implement same functions required ensure openssl thread safety in second approach or not? my guess not have , treated independent (indeed surely must many applications use openssl) re...
Read more

php - Deleting/Renaming a locked file -

-
with php, there way force unlock file (for renaming/deleting) locked running program on same server? more details: have image service running on server caches large pathology images web when try delete or rename images through php interface, cannot when image files locked , still being accessed web image service. i have no control on web service cannot tell close image. work around restart web service , delete/rename files cause service interruption other users trying access other images through web. os: windows server 2003
Read more