problem with string:tokens

[Tim Fletcher]

> It is a general question of course ! the tokens function cannot
> separate the tokens with a composite string unfortunately (here ",,")

As its name suggests, it *doesn't* behave like the more common "split"
function in other languages.

Have you tried the re module? For example:

  > re:split("A,,C,D", ",", [{return,list}]).
  ["A",[],"C","D"]

  > re:split("A,B,,D", ",", [{return,list}]).
  ["A","B",[],"D"]