Apache Solr Language Identifier

Apache Solr Language Identifier

This module is intended to be used while indexing documents. It is implemented as an UpdateProcessor to be placed in an UpdateChain. Its purpose is to identify language from documents and tag the document with language code.

Compile зависимости (110)

Группа / Артифакт Версия Более новая версия
org.slf4j » slf4j-api 1.7.7 2.0.12
org.apache.lucene » lucene-suggest 6.0.1 9.9.1
org.apache.lucene » lucene-sandbox 6.0.1 9.9.1
org.bouncycastle » bcprov-jdk15 1.45 1.46
org.apache.commons » commons-exec 1.3 Нет
org.bouncycastle » bcmail-jdk15 1.45 1.46
de.l3s.boilerpipe » boilerpipe 1.1.0 Нет
org.apache.lucene » lucene-analyzers-common 6.0.1 8.10.1
org.eclipse.jetty » jetty-webapp 9.3.8.v20160314 9.4.44.v20210927
org.apache.lucene » lucene-analyzers-phonetic 6.0.1 8.10.1
org.eclipse.jetty » jetty-servlet 9.3.8.v20160314 10.0.12
org.apache.lucene » lucene-join 6.0.1 9.9.1
org.apache.lucene » lucene-highlighter 6.0.1 9.9.1
org.apache.lucene » lucene-misc 6.0.1 9.9.1
org.apache.lucene » lucene-codecs 6.0.1 9.9.1
org.apache.lucene » lucene-analyzers-kuromoji 6.0.1 8.10.1
org.aspectj » aspectjrt 1.8.0 1.9.21.2
org.slf4j » jcl-over-slf4j 1.7.7 2.0.12
org.eclipse.jetty » jetty-security 9.3.8.v20160314 9.4.44.v20210927
org.eclipse.jetty » jetty-server 9.3.8.v20160314 9.4.44.v20210927
org.slf4j » jul-to-slf4j 1.7.7 2.0.12
org.eclipse.jetty » jetty-jmx 9.3.8.v20160314 9.4.44.v20210927
org.eclipse.jetty » jetty-xml 9.3.8.v20160314 9.4.44.v20210927
org.slf4j » slf4j-log4j12 1.7.7 2.0.12
org.eclipse.jetty » jetty-io 9.3.8.v20160314 9.4.44.v20210927
org.eclipse.jetty » jetty-http 9.3.8.v20160314 10.0.6
org.eclipse.jetty » jetty-util 9.3.8.v20160314 9.4.44.v20210927
com.google.protobuf » protobuf-java 2.5.0 3.25.3
org.apache.poi » poi 3.11 5.0.0
org.apache.poi » poi-scratchpad 3.11 5.0.0
org.apache.poi » poi-ooxml 3.11 5.0.0
org.apache.poi » poi-ooxml-schemas 3.11 4.1.2
org.antlr » antlr4-runtime 4.5.1-1 4.13.1
org.apache.tika » tika-core 1.7 1.27
org.ow2.asm » asm-commons 5.0.4 9.2
org.apache.tika » tika-parsers 1.7 1.27
org.apache.tika » tika-xmp 1.7 1.27
com.fasterxml.jackson.dataformat » jackson-dataformat-smile 2.5.4 2.17.1
rome » rome 1.0 Нет
org.apache.tika » tika-java7 1.7 1.27
org.codehaus.woodstox » woodstox-core-asl 4.4.1 Нет
javax.servlet » javax.servlet-api 3.1.0 4.0.1
org.gagravarr » vorbis-java-core 0.6 0.8
net.sourceforge.jmatio » jmatio 1.0 Нет
commons-configuration » commons-configuration 1.6 1.10
org.ow2.asm » asm 5.0.4 9.2
org.apache.httpcomponents » httpclient 4.4.1 4.5.11
org.apache.httpcomponents » httpmime 4.4.1 4.5.12
com.facebook.presto » presto-parser 0.122 0.286
org.codehaus.woodstox » stax2-api 3.1.4 4.2.1
org.gagravarr » vorbis-java-tika 0.6 0.8
org.ccil.cowan.tagsoup » tagsoup 1.2.1 Нет
org.apache.zookeeper » zookeeper 3.4.6 3.6.3
org.apache.httpcomponents » httpcore 4.4.1 4.4.15
com.google.guava » guava 14.0.1 33.0.0-jre
com.carrotsearch » hppc 0.7.1 0.9.0
org.locationtech.spatial4j » spatial4j 0.6 0.8
com.adobe.xmp » xmpcore 5.1.2 6.1.11
org.apache.james » apache-mime4j-dom 0.7.2 0.8.4
org.restlet.jee » org.restlet 2.3.0 Нет
org.apache.james » apache-mime4j-core 0.7.2 0.8.4
org.restlet.jee » org.restlet.ext.servlet 2.3.0 Нет
com.ibm.icu » icu4j 56.1 73.1
com.pff » java-libpst 0.8.1 0.9.3
com.drewnoakes » metadata-extractor 2.6.2 2.16.0
org.tukaani » xz 1.5 1.9
jdom » jdom 1.0 1.1
joda-time » joda-time 2.2 2.12.7
io.airlift » slice 0.10 2.0
com.cybozu.labs » langdetect 1.1-20120112 Нет
org.apache.commons » commons-compress 1.8.1 1.21
org.apache.hadoop » hadoop-common 2.6.0 3.3.1
org.apache.hadoop » hadoop-auth 2.6.0 3.3.1
log4j » log4j 1.2.17 Нет
org.apache.hadoop » hadoop-annotations 2.6.0 3.3.1
org.apache.xmlbeans » xmlbeans 2.6.0 5.0.1
commons-io » commons-io 2.4 2.11.0
com.github.ben-manes.caffeine » caffeine 1.0.1 3.1.8
com.fasterxml.jackson.core » jackson-core 2.5.4 2.17.1
net.arnx » jsonic 1.2.7 1.3.10
commons-codec » commons-codec 1.10 1.15
org.eclipse.jetty » jetty-rewrite 9.3.8.v20160314 10.0.11
commons-cli » commons-cli 1.2 1.4
org.apache.hadoop » hadoop-hdfs 2.6.0 3.3.1
org.htrace » htrace-core 3.0.4 Нет
org.apache.pdfbox » jempbox 1.8.8 1.8.16
com.tdunning » t-digest 3.1 3.3
org.noggit » noggit 0.6 0.8
org.eclipse.jetty » jetty-deploy 9.3.8.v20160314 10.0.6
commons-lang » commons-lang 2.6 Нет
org.apache.pdfbox » fontbox 1.8.8 3.0.0-alpha2
xerces » xercesImpl 2.9.1 RELEASE
org.apache.solr » solr-solrj 6.0.1 9.6.0
org.apache.pdfbox » pdfbox 1.8.8 3.0.0-alpha2
org.apache.solr » solr-core 6.0.1 9.6.0
dom4j » dom4j 1.6.1 1.4-dev-8
org.eclipse.jetty » jetty-servlets 9.3.8.v20160314 10.0.11
org.eclipse.jetty » jetty-continuation 9.3.8.v20160314 9.4.44.v20210927
com.googlecode.juniversalchardet » juniversalchardet 1.0.3 Нет
commons-collections » commons-collections 3.2.2 Нет
org.apache.lucene » lucene-grouping 6.0.1 9.9.1
com.googlecode.mp4parser » isoparser 1.0.2 1.1.22
org.apache.lucene » lucene-memory 6.0.1 9.9.1
org.apache.lucene » lucene-expressions 6.0.1 9.9.1
commons-fileupload » commons-fileupload 1.3.1 1.4
org.apache.lucene » lucene-spatial-extras 6.0.1 9.9.1
org.apache.lucene » lucene-core 6.0.1 9.9.1
org.apache.lucene » lucene-backward-codecs 6.0.1 9.9.1
org.apache.lucene » lucene-queryparser 6.0.1 9.9.1
org.apache.lucene » lucene-queries 6.0.1 9.9.1

Test зависимости (4)

Группа / Артифакт Версия Более новая версия
junit » junit 4.10 4.13.2
com.carrotsearch.randomizedtesting » randomizedtesting-runner 2.3.2 2.7.8
org.apache.solr » solr-test-framework 6.0.1 9.6.0
org.apache.lucene » lucene-test-framework 6.0.1 9.9.1