concordia-server/resources/tokenizer/stop_symbols.txt

\\tab
\\emdash
\&lt;
\&gt;
\&amp;
\&quot;
\&dash;
\&nbsp;
<
>
=
\+
„
”
\"
…
\.
\,
\?
!
'
\(
\)
\{
\}
\@
\#
\$
\%
\^
\&
\*
\[
\]
\\
\~
&#\d+
initial commit 2015-06-09 13:01:42 +02:00			`\\tab`
			`\\emdash`
			`\<`
			`\>`
			`\&`
			`\"`
			`\&dash;`
			`\ `
			`<`
			`>`
			`=`
			`\+`
			`„`
			`”`
			`\"`
			`…`
			`\.`
			`\,`
			`\?`
			`!`
			`'`
			`\(`
			`\)`
			`\{`
			`\}`
			`\@`
			`\#`
			`\$`
			`\%`
			`\^`
			`\&`
			`\*`
			`\[`
			`\]`
			`\\`
			`\~`
			`&#\d+`