| Name : perl-Text-Similarity
| |
| Version : 0.13
| Vendor : obs://build_opensuse_org/devel:languages:perl
|
| Release : lp155.1.1
| Date : 2023-07-20 18:39:17
|
| Group : Development/Libraries/Perl
| Source RPM : perl-Text-Similarity-0.13-lp155.1.1.src.rpm
|
| Size : 0.12 MB
| |
| Packager : https://www_suse_com/
| |
| Summary : Measure the pair-wise Similarity of Files or Strings
|
Description :
This module is a superclass for other modules and provides generic services
such as stop word removal, compound identification, and text cleaning or
sanitizing.
It\'s important to realize that additional methods of measuring similarity
can be added to this package. Text::Similarity::Overlaps is just one
possible way of measuring similarity, others can be added.
Subroutine sanitizeString carries out text cleaning. Briefly, it removes
nearly all punctuation except for underscores and embedded apostrophes,
converts all text to lower case, and collapes multiple white spaces to a
single space.
This module is where compounds are identified (although currently
disabled). When implemented it will check a list of compounds provided by
the user, and then when a compound is found in the text it will be
desigated via an underscore (e.g., white house might be converted to
white_house).
Stop words are removed here. The length of the documents reported does not
include the stop words. Overlaps are found after stopword removal. By
including a word in the stoplist, you are saying that the word never
existed in your input (in effect).
|
RPM found in directory: /packages/linux-pbone/ftp5.gwdg.de/pub/opensuse/repositories/devel:/languages:/perl:/CPAN-T/15.5/noarch |
