a g: @sfdZddlmZddlmZdadadeeeeeeeed d d Z deeeeeeedddZ dS)z Where's the Point? Self-Supervised Multilingual Punctuation-Agnostic Sentence Segmentation GitHub: https://github.com/bminixhofer/wtpsplit )List)WtPNth wtp-bert-minisentence?newline)text lang_codemodeltokenizeparagraph_thresholdstylereturncCsvt|krt|da|a|dkr,tj||dS|dkrFtj||d|dS|dkrbtj||d||dStd |d dS) N)Zmodel_name_or_modelr)r rT)r do_paragraph_segmentationr Zopus100)r r thresholdrzSegmentation style "zS" not found. It might be a typo; if not, please consult our document.) _MODEL_NAMEr_MODELsplit ValueError)r r r r r rrD/usr/local/lib/python3.9/dist-packages/pythainlp/tokenize/wtsplit.py _tokenizes.   rmini)r sizer r rrcCsDd}|dkrd}n |dkr d}n|dkr.d}nd}t|||||d S) NZtinyz wtp-bert-tinybasezwtp-canine-s-1lZlargezwtp-canine-s-12lr)r r r r)r)r rr r rZ _model_loadrrrr 7sr )rrrrr)rrrr) __doc__typingrZwtpsplitrrrstrfloatrr rrrrs<   )