esu
esupar
pypi i esupar
esu

esupar

Tokenizer POS-Tagger and Dependency-parser with BERT/RoBERTa/DeBERTa models for Japanese and other languages

by Koichi Yasuoka

1.3.7 (see all)License:MIT
pypi i esupar
Readme

Current PyPI packages

esupar

Tokenizer, POS-tagger, and dependency-parser with Transformers and SuPar.

Basic usage

>>> import esupar
>>> nlp=esupar.load("ja")
>>> doc=nlp("太郎は花子が読んでいる本を次郎に渡した")
>>> print(doc)
1   太郎  _   PROPN   _   _   12  nsubj   _   SpaceAfter=No
2   は   _   ADP _   _   1   case    _   SpaceAfter=No
3   花子  _   PROPN   _   _   5   nsubj   _   SpaceAfter=No
4   が   _   ADP _   _   3   case    _   SpaceAfter=No
5   読ん  _   VERB    _   _   8   acl _   SpaceAfter=No
6   で   _   SCONJ   _   _   5   mark    _   SpaceAfter=No
7   いる  _   AUX _   _   5   aux _   SpaceAfter=No
8   本   _   NOUN    _   _   12  obj _   SpaceAfter=No
9   を   _   ADP _   _   8   case    _   SpaceAfter=No
10  次郎  _   PROPN   _   _   12  obl _   SpaceAfter=No
11  に   _   ADP _   _   10  case    _   SpaceAfter=No
12  渡し  _   VERB    _   _   0   root    _   SpaceAfter=No
13  た   _   AUX _   _   12  aux _   _

>>> import deplacy
>>> deplacy.render(doc,Japanese=True)
太郎 PROPN ═╗<════════╗ nsubj(主語)
は   ADP   <╝         ║ case(格表示)
花子 PROPN ═╗<══╗     ║ nsubj(主語)
が   ADP   <╝   ║     ║ case(格表示)
読ん VERB  ═╗═╗═╝<╗   ║ acl(連体修飾節)
で   SCONJ <╝ ║   ║   ║ mark(標識)
いる AUX   <══╝   ║   ║ aux(動詞補助成分)
本   NOUN  ═╗═════╝<╗ ║ obj(目的語)
を   ADP   <╝       ║ ║ case(格表示)
次郎 PROPN ═╗<╗     ║ ║ obl(斜格補語)
に   ADP   <╝ ║     ║ ║ case(格表示)
渡し VERB  ═╗═╝═════╝═╝ root(親)
た   AUX   <╝           aux(動詞補助成分)

esupar.load(model) loads a natural language processor pipeline, working on Universal Dependencies. Available model options are:

Installation for Linux

pip3 install esupar --user

Installation for Cygwin64

Make sure to get python37-devel python37-pip python37-cython python37-numpy python37-wheel gcc-g++ mingw64-x86_64-gcc-g++ git curl make cmake, and then:

curl -L https://raw.githubusercontent.com/KoichiYasuoka/CygTorch/master/installer/supar.sh | sh
pip3.7 install esupar

Installation for Google Colaboratory

!pip install esupar

Try notebook.

Author

Koichi Yasuoka (安岡孝一)

GitHub Stars

12

LAST COMMIT

5mos ago

MAINTAINERS

1

CONTRIBUTORS

1

OPEN ISSUES

0

OPEN PRs

0
VersionTagPublished
1.3.7
7d ago
1.3.6
7d ago
1.3.5
7d ago
1.3.4
25d ago
No alternatives found
No tutorials found
Add a tutorial