com.hpe.caf.languagedetection.cld2

Interface Cld2Library

All Superinterfaces:

com.sun.jna.Library

public interface Cld2Library
extends com.sun.jna.Library

JNA Interface to access the C++ CLD2 methods

Nested Class Summary

Nested classes/interfaces inherited from interface com.sun.jna.Library

com.sun.jna.Library.Handler

Field Summary

Fields inherited from interface com.sun.jna.Library

OPTION_ALLOW_OBJECTS, OPTION_CALLING_CONVENTION, OPTION_CLASSLOADER, OPTION_FUNCTION_MAPPER, OPTION_INVOCATION_MAPPER, OPTION_OPEN_FLAGS, OPTION_STRING_ENCODING, OPTION_STRUCTURE_ALIGNMENT, OPTION_TYPE_MAPPER

Method Summary

Modifier and Type	Method and Description
String	_ZN4CLD212LanguageCodeENS_8LanguageE(int language) To get language code from kLanguageToCode array in CLD2
String	_ZN4CLD212LanguageNameENS_8LanguageE(int language) To get language name from kLanguageToName array in CLD2
int	_ZN4CLD219GetLanguageFromNameEPKc(String name) To get language number from kNameToLanguage array in CLD2
int	DetectLanguageSummaryWithHints(byte[] buffer, int buffer_length, boolean is_plain_text, String tld_hint, int encoding_hint, int language_hint, int[] language3, int[] percent3, int[] text_bytes, boolean[] is_reliable) this is the method used in CLD2 to detect the language, passing in the hints and references (as java arrays) of the text buffer, language3, percent3, text_bytes and is_reliable fields

Method Detail

DetectLanguageSummaryWithHints

int DetectLanguageSummaryWithHints(byte[] buffer,
                                   int buffer_length,
                                   boolean is_plain_text,
                                   String tld_hint,
                                   int encoding_hint,
                                   int language_hint,
                                   int[] language3,
                                   int[] percent3,
                                   int[] text_bytes,
                                   boolean[] is_reliable)

this is the method used in CLD2 to detect the language, passing in the hints and references (as java arrays) of the text buffer, language3, percent3, text_bytes and is_reliable fields

Parameters:

buffer - - Bytes of text to be queried

buffer_length - - The length of buffer

is_plain_text - - States whether the text passed in is plain-text or not

tld_hint - - Encoding hint, it is from an encoding detector applied to an input

encoding_hint - - Detector hint, such as "en" "en,it", ENGLISH

language_hint - - The language code specifying a possible language that may be in the text.

language3 - - Contains the top three languages found

percent3 - - The confidence percentage for each of the top three languages found

text_bytes - - The amount of non-tag/letters-only text found

is_reliable - - Determines the confidence in the findings - True if the returned language is some amount more probable than the second best.

Returns:

integer value for language corresponding to value in Cld2Language. language3 array contains the top three languages found percent3 array contains the confidence for each of the top three languages found, that they are correct text_bytes array contains the amount of non-tag/letters-only text found is_reliable, which is set true if the returned language is some amount more probable than the second best language. Calculation is a complex function of the length of the text and the different-script runs of text.

_ZN4CLD212LanguageNameENS_8LanguageE

String _ZN4CLD212LanguageNameENS_8LanguageE(int language)

To get language name from kLanguageToName array in CLD2

Parameters:

language - - The language number

Returns:

-The language name

_ZN4CLD212LanguageCodeENS_8LanguageE

String _ZN4CLD212LanguageCodeENS_8LanguageE(int language)

To get language code from kLanguageToCode array in CLD2

Parameters:

language - - The language number

Returns:

- The language code

_ZN4CLD219GetLanguageFromNameEPKc

int _ZN4CLD219GetLanguageFromNameEPKc(String name)

To get language number from kNameToLanguage array in CLD2

Parameters:

name - - The name of the language to be queried

Returns:

-The language number