Apache Solr Language Identifier

Apache Solr Language Identifier

This module is intended to be used while indexing documents. It is implemented as an UpdateProcessor to be placed in an UpdateChain. Its purpose is to identify language from documents and tag the document with language code.

Compile зависимости (178)

Группа / Артифакт Версия Более новая версия
org.apache.commons » commons-collections4 4.4 RELEASE
com.fasterxml.jackson.core » jackson-annotations 2.12.3 2.17.1
com.fasterxml.jackson.core » jackson-core 2.12.3 2.17.1
com.jayway.jsonpath » json-path 2.4.0 2.6.0
org.antlr » antlr4-runtime 4.5.1-1 4.13.1
com.fasterxml.jackson.core » jackson-databind 2.12.3 2.17.1
org.apache.xmlbeans » xmlbeans 3.1.0 5.0.1
org.bitbucket.b_c » jose4j 0.6.5 0.9.3
org.apache.kerby » kerb-util 1.0.1 2.0.1
org.apache.tika » tika-core 1.24.1 Нет
org.apache.commons » commons-exec 1.3 Нет
com.rometools » rome-utils 1.12.2 1.16.0
org.slf4j » jul-to-slf4j 1.7.24 2.0.12
org.slf4j » jcl-over-slf4j 1.7.24 2.0.12
io.sgr » s2-geometry-library-java 1.0.0 1.0.1
org.apache.kerby » kerb-core 1.0.1 2.0.1
org.apache.tika » tika-parsers 1.24.1 1.27
org.ccil.cowan.tagsoup » tagsoup 1.2.1 Нет
com.rometools » rome 1.12.2 1.16.0
org.aspectj » aspectjrt 1.8.0 1.9.21.2
org.apache.poi » poi-ooxml 4.1.2 5.0.0
org.eclipse.jetty » jetty-io 9.4.41.v20210516 9.4.44.v20210927
com.healthmarketscience.jackcess » jackcess 3.0.1 4.0.6
org.apache.poi » poi-ooxml-schemas 4.1.2 Нет
org.apache.poi » poi-scratchpad 4.1.2 5.0.0
com.esri.geometry » esri-geometry-api 2.2.0 2.2.4
org.eclipse.jetty » jetty-security 9.4.41.v20210516 9.4.44.v20210927
org.eclipse.jetty » jetty-servlet 9.4.41.v20210516 10.0.12
org.eclipse.jetty » jetty-server 9.4.41.v20210516 9.4.44.v20210927
net.hydromatic » eigenbase-properties 1.1.5 1.1.6
org.eclipse.jetty » jetty-webapp 9.4.41.v20210516 9.4.44.v20210927
com.ibm.icu » icu4j 62.1 73.1
org.ow2.asm » asm 8.0.1 9.2
org.ow2.asm » asm-commons 8.0.1 9.2
org.eclipse.jetty » jetty-xml 9.4.41.v20210516 9.4.44.v20210927
org.apiguardian » apiguardian-api 1.1.0 1.1.2
org.apache.commons » commons-configuration2 2.1.1 2.7
org.apache.logging.log4j » log4j-layout-template-json 2.14.1 Нет
org.apache.pdfbox » fontbox 2.0.19 3.0.0-alpha2
io.netty » netty-transport-native-epoll 4.1.50.Final 4.1.94.Final
com.googlecode.juniversalchardet » juniversalchardet 1.0.3 Нет
org.apache.hadoop » hadoop-hdfs-client 3.2.2 3.3.1
org.apache.commons » commons-math3 3.6.1 Нет
org.apache.hadoop » hadoop-annotations 3.2.2 3.3.1
org.apache.hadoop » hadoop-auth 3.2.2 3.3.1
org.apache.james » apache-mime4j-dom 0.8.3 0.8.4
org.bouncycastle » bcprov-jdk15on 1.65 1.70
org.apache.james » apache-mime4j-core 0.8.3 0.8.4
org.bouncycastle » bcpkix-jdk15on 1.65 1.70
com.google.re2j » re2j 1.2 1.6
org.apache.commons » commons-text 1.6 1.9
xml-apis » xml-apis 1.4.01 Нет
com.github.zafarkhaja » java-semver 0.9.0 Нет
org.bouncycastle » bcmail-jdk15on 1.65 1.69
org.apache.pdfbox » pdfbox-tools 2.0.19 2.0.24
com.zaxxer » SparseBitSet 1.2 Нет
io.netty » netty-handler 4.1.50.Final 4.1.108.Final
org.apache.opennlp » opennlp-tools 1.9.2 1.9.3
org.apache.tika » tika-java7 1.24.1 1.27
org.apache.kerby » kerby-pkix 1.0.1 2.0.1
org.apache.logging.log4j » log4j-1.2-api 2.14.1 2.17.2
org.apache.kerby » kerby-asn1 1.0.1 2.0.1
org.apache.logging.log4j » log4j-api 2.14.1 2.19.0
org.apache.tika » tika-xmp 1.24.1 1.27
org.apache.poi » poi 4.1.2 5.0.0
org.slf4j » slf4j-api 1.7.24 2.0.12
org.apache.logging.log4j » log4j-slf4j-impl 2.14.1 2.19.0
io.netty » netty-common 4.1.50.Final 4.1.108.Final
de.l3s.boilerpipe » boilerpipe 1.1.0 Нет
org.gagravarr » vorbis-java-tika 0.8 Нет
org.tallison » isoparser 1.9.41.2 1.9.41.7
org.apache.hadoop » hadoop-common 3.2.2 3.3.1
org.apache.logging.log4j » log4j-web 2.14.1 2.13.1
commons-io » commons-io 2.8.0 2.11.0
javax.servlet » javax.servlet-api 3.1.0 4.0.1
org.gagravarr » vorbis-java-core 0.8 Нет
io.netty » netty-codec 4.1.50.Final 4.1.108.Final
io.netty » netty-transport 4.1.50.Final 4.1.108.Final
io.netty » netty-resolver 4.1.50.Final 4.1.108.Final
io.netty » netty-buffer 4.1.50.Final 4.1.108.Final
org.apache.lucene » lucene-classification 8.10.0 9.9.1
org.apache.lucene » lucene-codecs 8.10.0 9.9.1
com.github.virtuald » curvesapi 1.06 Нет
org.apache.lucene » lucene-core 8.10.0 9.9.1
org.apache.lucene » lucene-expressions 8.10.0 9.9.1
org.apache.lucene » lucene-analyzers-kuromoji 8.10.0 8.10.1
org.xerial.snappy » snappy-java 1.1.7.6 1.1.10.4
org.apache.lucene » lucene-analyzers-nori 8.10.0 8.10.1
commons-cli » commons-cli 1.4 Нет
org.apache.lucene » lucene-analyzers-phonetic 8.10.0 8.10.1
com.lmax » disruptor 3.4.2 3.4.4
org.apache.lucene » lucene-backward-codecs 8.10.0 9.9.1
org.checkerframework » checker-qual 3.10.0 3.43.0
org.codehaus.woodstox » stax2-api 4.2.1 Нет
org.apache.lucene » lucene-analyzers-common 8.10.0 8.10.1
org.apache.htrace » htrace-core4 4.1.0-incubating 4.2.0-incubating
com.google.protobuf » protobuf-java 3.11.0 3.25.3
org.apache.solr » solr-solrj 8.10.0 9.6.0
net.arnx » jsonic 1.2.7 1.3.10
com.github.ben-manes.caffeine » caffeine 2.9.2 3.1.8
com.fasterxml.jackson.dataformat » jackson-dataformat-smile 2.12.3 2.17.1
org.apache.pdfbox » pdfbox 2.0.19 3.0.0-alpha2
org.apache.lucene » lucene-spatial-extras 8.10.0 9.9.1
org.apache.lucene » lucene-spatial3d 8.10.0 9.9.1
org.apache.lucene » lucene-suggest 8.10.0 9.9.1
org.apache.solr » solr-core 8.10.0 9.6.0
org.apache.lucene » lucene-misc 8.10.0 9.9.1
org.apache.lucene » lucene-queries 8.10.0 9.9.1
com.carrotsearch » hppc 0.8.1 0.9.0
org.apache.lucene » lucene-queryparser 8.10.0 9.9.1
org.apache.lucene » lucene-sandbox 8.10.0 9.9.1
org.apache.calcite » calcite-linq4j 1.27.0 Нет
org.apache.lucene » lucene-grouping 8.10.0 9.9.1
com.pff » java-libpst 0.9.3 Нет
org.apache.lucene » lucene-highlighter 8.10.0 9.9.1
org.apache.lucene » lucene-join 8.10.0 9.9.1
org.apache.calcite » calcite-core 1.27.0 Нет
org.apache.lucene » lucene-memory 8.10.0 9.9.1
org.apache.httpcomponents » httpclient 4.5.12 4.5.11
com.google.guava » guava 25.1-jre 33.0.0-jre
org.brotli » dec 0.1.2 Нет
org.apache.httpcomponents » httpcore 4.4.14 4.4.15
io.dropwizard.metrics » metrics-jetty9 4.1.5 4.2.23
io.dropwizard.metrics » metrics-jmx 4.1.5 4.2.23
commons-lang » commons-lang 2.6 Нет
org.apache.commons » commons-csv 1.8 1.9.0
io.dropwizard.metrics » metrics-jvm 4.1.5 4.2.23
org.locationtech.spatial4j » spatial4j 0.7 0.8
io.dropwizard.metrics » metrics-graphite 4.1.5 4.2.23
org.apache.logging.log4j » log4j-core 2.14.1 2.18.0
io.dropwizard.metrics » metrics-core 4.1.5 4.2.23
org.eclipse.jetty » jetty-alpn-client 9.4.41.v20210516 9.4.43.v20210629
org.apache.curator » curator-recipes 2.13.0 5.2.0
org.apache.curator » curator-framework 2.13.0 5.2.0
org.eclipse.jetty.http2 » http2-client 9.4.41.v20210516 9.4.44.v20210927
org.apache.curator » curator-client 2.13.0 5.2.0
org.apache.commons » commons-compress 1.20 1.21
org.eclipse.jetty.http2 » http2-server 9.4.41.v20210516 9.4.44.v20210927
io.opentracing » opentracing-util 0.33.0 Нет
commons-collections » commons-collections 3.2.2 Нет
com.healthmarketscience.jackcess » jackcess-encrypt 3.0.0 4.0.2
org.jdom » jdom2 2.0.6 Нет
org.eclipse.jetty » jetty-alpn-java-server 9.4.41.v20210516 9.4.44.v20210927
org.rrd4j » rrd4j 3.5 3.8
org.eclipse.jetty » jetty-alpn-java-client 9.4.41.v20210516 10.0.6
org.apache.zookeeper » zookeeper 3.6.2 3.6.3
xerces » xercesImpl 2.12.0 RELEASE
org.apache.calcite.avatica » avatica-core 1.18.0 Нет
org.tallison » jmatio 1.5 Нет
org.eclipse.jetty » jetty-alpn-server 9.4.41.v20210516 9.4.44.v20210927
org.eclipse.jetty » jetty-continuation 9.4.41.v20210516 9.4.44.v20210927
commons-codec » commons-codec 1.13 1.15
org.apache.zookeeper » zookeeper-jute 3.6.2 3.6.3
com.tdunning » t-digest 3.1 3.3
com.fasterxml.woodstox » woodstox-core 6.2.4 6.5.1
com.epam » parso 2.0.11 2.0.14
org.eclipse.jetty.http2 » http2-common 9.4.41.v20210516 9.4.44.v20210927
org.eclipse.jetty » jetty-http 9.4.41.v20210516 10.0.6
org.apache.pdfbox » jempbox 1.8.16 Нет
org.eclipse.jetty.http2 » http2-http-client-transport 9.4.41.v20210516 9.4.44.v20210927
org.eclipse.jetty.http2 » http2-hpack 9.4.41.v20210516 9.4.43.v20210629
io.opentracing » opentracing-api 0.33.0 Нет
org.codehaus.janino » commons-compiler 3.0.9 3.1.6
org.apache.commons » commons-lang3 3.10 3.12.0
org.tukaani » xz 1.8 1.9
org.codehaus.janino » janino 3.0.9 3.1.7
com.cybozu.labs » langdetect 1.1-20120112 Нет
io.opentracing » opentracing-noop 0.33.0 Нет
org.tallison » metadata-extractor 2.13.0 2.15.0.1
io.netty » netty-transport-native-unix-common 4.1.50.Final 4.1.108.Final
org.eclipse.jetty » jetty-client 9.4.41.v20210516 9.4.44.v20210927
org.eclipse.jetty » jetty-jmx 9.4.41.v20210516 9.4.44.v20210927
org.eclipse.jetty » jetty-deploy 9.4.41.v20210516 10.0.6
org.tallison.xmp » xmpcore-shaded 6.1.10 6.1.11
org.apache.httpcomponents » httpmime 4.5.12 Нет
org.eclipse.jetty » jetty-util 9.4.41.v20210516 9.4.44.v20210927
org.eclipse.jetty » jetty-rewrite 9.4.41.v20210516 10.0.11
org.eclipse.jetty » jetty-servlets 9.4.41.v20210516 10.0.11