Package: NUSS 0.1.0

Oskar Kosch

NUSS: Mixed N-Grams and Unigram Sequence Segmentation

Segmentation of short text sequences - like hashtags - into the separated words sequence, done with the use of dictionary, which may be built on custom corpus of texts. Unigram dictionary is used to find most probable sequence, and n-grams approach is used to determine possible segmentation given the text corpus.

Authors:Oskar Kosch [aut, cre]

NUSS_0.1.0.tar.gz
NUSS_0.1.0.zip(r-4.5)NUSS_0.1.0.zip(r-4.4)NUSS_0.1.0.zip(r-4.3)
NUSS_0.1.0.tgz(r-4.4-x86_64)NUSS_0.1.0.tgz(r-4.4-arm64)NUSS_0.1.0.tgz(r-4.3-x86_64)NUSS_0.1.0.tgz(r-4.3-arm64)
NUSS_0.1.0.tar.gz(r-4.5-noble)NUSS_0.1.0.tar.gz(r-4.4-noble)
NUSS_0.1.0.tgz(r-4.4-emscripten)NUSS_0.1.0.tgz(r-4.3-emscripten)
NUSS.pdf |NUSS.html✨
NUSS/json (API)

# Install 'NUSS' in R:

install.packages('NUSS', repos = c('https://theogrost.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/theogrost/nuss/issues

Uses libs:

c++– GNU Standard C++ Library v3

Datasets:

base_dictionary - Base dictionary with unigrams

On CRAN:

3.00 score 8 scripts 111 downloads 6 exports 46 dependencies

Last updated 3 months agofrom:2e104423fa. Checks:OK: 9. Indexed: yes.

Target	Result	Date
Doc / Vignettes	OK	Oct 27 2024
R-4.5-win-x86_64	OK	Oct 27 2024
R-4.5-linux-x86_64	OK	Oct 27 2024
R-4.4-win-x86_64	OK	Oct 27 2024
R-4.4-mac-x86_64	OK	Oct 27 2024
R-4.4-mac-aarch64	OK	Oct 27 2024
R-4.3-win-x86_64	OK	Oct 27 2024
R-4.3-mac-x86_64	OK	Oct 27 2024
R-4.3-mac-aarch64	OK	Oct 27 2024

Exports:igrepl ngrams_dictionary ngrams_segmentation nuss unigram_dictionary unigram_sequence_segmentation

Dependencies:BH cli cpp11 data.table digest dplyr dtt english fansi float generics glue lattice lexicon lgr lifecycle magrittr Matrix MatrixExtra mgsub mlapi NLP pillar pkgconfig purrr qdapRegex R6 Rcpp RcppArmadillo RhpcBLASctl rlang rsparse slam stringi stringr syuzhet text2vec textclean textshape tibble tidyr tidyselect utf8 vctrs withr zoo

Citation

Development and contributors

Readme and manuals

Help Manual

Help page	Topics
Base dictionary with unigrams	base_dictionary
Perform inverse regex search (C++)	igrepl
Create n-grams dictionary	ngrams_dictionary
Segmenting sequences with n-grams.	ngrams_segmentation
Mixed N-Grams and Unigram Sequence Segmentation (NUSS) function	nuss
Create unigram dictionary	unigram_dictionary
Segmenting sequences with unigrams	unigram_sequence_segmentation