Skip to content

Releases: hyunwoongko/kss

v3.5.5

21 Aug 05:27
Compare
Choose a tag to compare

Hot Fix

  • Modify mecab installation script

v3.5.4

21 Aug 02:10
Compare
Choose a tag to compare
  • Add auto for the number of workers

v3.5.3

21 Aug 01:55
Compare
Choose a tag to compare

Hot Fix

  • modify mecab installation script

v3.5.1

20 Aug 23:56
Compare
Choose a tag to compare

3.5.1

  • Use mecab backend as default if mecab is available else use pynori as default.
  • Set num_workers to 1 when the input was string.

v3.4.3

22 Mar 09:45
Compare
Choose a tag to compare

Fix bracket processing related bugs

v3.4.2

19 Mar 16:21
Compare
Choose a tag to compare

Quick fix of 3.4.1.

v3.4.1

19 Mar 16:10
Compare
Choose a tag to compare
  • Apply improvements from #39.

v3.4

15 Feb 21:47
Compare
Choose a tag to compare

Fix bracket processing related bugs

Modify caching key

v3.3.1

29 Oct 06:33
Compare
Choose a tag to compare

Do not use multiprocessing if length of input list is 1.

v3.3.0

22 Oct 19:46
Compare
Choose a tag to compare
  • Fix emoji bug reported in #23.
  • Add improvements reported in #24.
    • Lazy initialization of Pynori.
    • Do not access multiprocessing module when num_workers was 0 or 1.
  • Add none backend for users that want to fast segmentation without mecab.
    • none backend works like kss 2.5.1 (do not use morpheme analyzer)
    • But if you use none backend, performance will be decreased.
  >>> split_sentences(text, backend="pynori")
  ['λΆ€λ”” λ§Œμˆ˜λ¬΄κ°• ν•˜μ˜΅μ†Œμ„œ', '천천히 κ°€μ„Έμš©~', 'λ„ˆ λ°₯을 λ¨ΉλŠ”κ΅¬λ‚˜', '응 λ§žμ•„ λ‚œ 근데 μ–΄μ œ μ΄μ‚¬ν–ˆμŒ', 'κ·Έλž¬κ΅¬λ‚˜ 이제 λ§ˆμ§€λ§‰μž„', '응응']

  >>> split_sentences(text, backend="mecab")
  ['λΆ€λ”” λ§Œμˆ˜λ¬΄κ°• ν•˜μ˜΅μ†Œμ„œ', '천천히 κ°€μ„Έμš©~', 'λ„ˆ λ°₯을 λ¨ΉλŠ”κ΅¬λ‚˜', '응 λ§žμ•„ λ‚œ 근데 μ–΄μ œ μ΄μ‚¬ν–ˆμŒ', 'κ·Έλž¬κ΅¬λ‚˜ 이제 λ§ˆμ§€λ§‰μž„', '응응']

  >>> split_sentences(text, backend="none")  # <--- it is same with kss 2.5.1 
  ['λΆ€λ”” λ§Œμˆ˜λ¬΄κ°• ν•˜μ˜΅μ†Œμ„œ 천천히 κ°€μ„Έμš©~', 'λ„ˆ λ°₯을 λ¨ΉλŠ”κ΅¬λ‚˜ 응 λ§žμ•„ λ‚œ 근데 μ–΄μ œ μ΄μ‚¬ν–ˆμŒ κ·Έλž¬κ΅¬λ‚˜ 이제 λ§ˆμ§€λ§‰μž„ 응응'