a gE@sddlmZddlmZddlmZddlmZddl m Z ddl m Z dZ ee e e Zeeedd d Ze d d feeeeeed d dZdS))stderr)List)segment) load_dict)_THAI_WORDS_FILENAME)path_pythainlp_corpusZ _67a47bf9) file_path dict_namereturncCs(t||d\}}tdur$t|td|S)aLoad a dictionary file into an in-memory dictionary collection. The loaded dictionary will be accessible through the assigned dict_name. *** This function does not override an existing dict name. *** :param file_path: Path to a dictionary file :type file_path: str :param dict_name: A unique dictionary name, used for reference. :type dict_name: str :return bool :See Also: * https://github.com/PyThaiNLP/nlpo3 )rr F)file)nlpo3_load_dictboolprintr)rr msgsuccessrB/usr/local/lib/python3.9/dist-packages/pythainlp/tokenize/nlpo3.pyrs rF)text custom_dict safe_mode parallel_moder cCst||||dS)aVBreak text into tokens. Python binding for nlpO3. It is newmm engine in Rust. :param str text: text to be tokenized :param str custom_dict: dictionary name, as assigned with load_dict(), defaults to pythainlp/corpus/common/words_th.txt :param bool safe_mode: reduce chance for long processing time for long text with many ambiguous breaking points, defaults to False :param bool parallel_mode: Use multithread mode, defaults to False :return: list of tokens :rtype: List[str] :See Also: * https://github.com/PyThaiNLP/nlpo3 )rr safeparallel) nlpo3_segment)rrrrrrrr(s rN)sysrtypingrZnlpo3rrrr Zpythainlp.corpus.commonrZpythainlp.corpusrZ_NLPO3_DEFAULT_DICT_NAMEZ_NLPO3_DEFAULT_DICTstrr rrrrs(