[erlang-questions] word filtering

Darius Bacon darius@REDACTED
Wed Jun 6 02:45:52 CEST 2007


"shehan" <shehan@REDACTED> wrote:
> Hi all,
> I want to write spam detecting (word filtering) function. I already know
> that regexp can be used for that & it is just string comparing & too
> slow when used in high volume usage.(ex: 500 text messages/sec) Can
> somebody tell me that, is there any method in Erlang to filter words
> faster than regexp? 

Joe Armstrong's new book includes an extended example of indexing text
for search. One module filters out words from a 'stop list'. This may
be just like what you want, though maybe not.

See the indexer_words module in the code resources downloadable from
http://www.pragmaticprogrammer.com/titles/jaerlang/

Darius



More information about the erlang-questions mailing list