finalfrontier-utils
cargo install finalfrontier-utils

finalfrontier-utils

Context-sensitive word embeddings with subwords. In Rust.

by finalfusion

0.6.2 (see all)License:Apache-2.0
cargo install finalfrontier-utils
Readme

Crate Docs Build Status

finalfrontier

Introduction

finalfrontier is a Rust program for training word embeddings. finalfrontier currently has the following features:

  • Models:
    • skip-gram (Mikolov et al., 2013)
    • structured skip-gram (Ling et al., 2015)
    • directional skip-gram (Song et al., 2018)
    • dependency (Levy and Goldberg, 2014)
  • Output formats:
    • finalfusion
    • fastText
    • word2vec binary
    • word2vec text
    • GloVe text
  • Noise contrastive estimation (Gutmann and Hyvärinen, 2012)
  • Subword representations (Bojanowski et al., 2016)
  • Hogwild SGD (Recht et al., 2011)
  • Quantized embeddings through the finalfusion quantize command.

The trained embeddings can be stored in the versatile finalfusion format, which can be read and used with the finalfusion crate and the finalfusion Python module.

The minimum required Rust version is currently 1.40.

Where to go from here

GitHub Stars

64

LAST COMMIT

8mos ago

MAINTAINERS

3

CONTRIBUTORS

9

OPEN ISSUES

3

OPEN PRs

1
VersionTagPublished
0.6.2
3yrs ago
0.6.1
3yrs ago
0.6.0
3yrs ago
0.5.0
3yrs ago
No alternatives found
No tutorials found
Add a tutorial