dlr

dlr

pypi i dlr

11 Versions

1.10.0

1 year ago

Release 1.10.0 can be used to run models compiled using the release-1.10.0 branch of neo-ai/TVM.

This release implements support for TF2 frontend parser, support for TF2 models was the major driving factor behind this release.

It also fixes bugs for TRT memory leak, TRT performance, weights doubled after TRT compilation, and also fix for RelayVM fails on Windows.

This release upgrades TreeLite to version 1.2.0.

It also adds support for KERAS dense 3D inputs and nested model.

Pre-built wheels can be installed via pip install link-to-wheel. If you don't see your platform in the table, see Installing DLR for instructions to build from source.

ManufacturerDevice NameWheel URL
AcerTV AISagehttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.10.0/aisage/dlr-1.10.0-py3-none-any.whl
AmazonAWS p2/p3/g4https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.10.0/gpu/dlr-1.10.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.3https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.10.0/jetpack4.3/dlr-1.10.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.4https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.10.0/jetpack4.4/dlr-1.10.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.5https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.10.0/jetpack4.5/dlr-1.10.0-py3-none-any.whl
RaspberryRasp3bhttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.10.0/rasp3b/dlr-1.10.0-py3-none-any.whl
RaspberryRasp4bhttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.10.0/rasp4b/dlr-1.10.0-py3-none-any.whl
RockchipsRK3399https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.10.0/rk3399/dlr-1.10.0-py3-none-any.whl

1.9.0

1 year ago

Release 1.9.0 can be used to run models compiled using the release-1.9.0 branch of neo-ai/TVM.

This Release fixes bug for CUDA NMS implementation affecting MXNet models, and fix for RelayVM for 32 bit platforms.

It also adds support for TF2.x.

Pre-built wheels can be installed via pip install link-to-wheel. If you don't see your platform in the table, see Installing DLR for instructions to build from source.

ManufacturerDevice NameWheel URL
AcerTV AISagehttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.9.0/aisage/dlr-1.9.0-py3-none-any.whl
AmazonAWS p2/p3/g4https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.9.0/gpu/dlr-1.9.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.2https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.9.0/jetpack4.2/dlr-1.9.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.3https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.9.0/jetpack4.3/dlr-1.9.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.4https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.9.0/jetpack4.4/dlr-1.9.0-py3-none-any.whl
RaspberryRasp3bhttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.9.0/rasp3b/dlr-1.9.0-py3-none-any.whl
RaspberryRasp4bhttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.9.0/rasp4b/dlr-1.9.0-py3-none-any.whl
RockchipsRK3399https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.9.0/rk3399/dlr-1.9.0-py3-none-any.whl

1.8.0

2 years ago

Release 1.8.0 can be used to run models compiled using the release-1.8.0 branch of neo-ai/TVM.

This Release provides better performance on PyTorch object detection and TensorFlow object detection models on GPU devices.

Pre-built wheels can be installed via pip install link-to-wheel. If you don't see your platform in the table, see Installing DLR for instructions to build from source.

ManufacturerDevice NameWheel URL
AcerTV AISagehttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.8.0/aisage/dlr-1.8.0-py3-none-any.whl
AmazonAWS p2/p3/g4https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.8.0/gpu/dlr-1.8.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.2https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.8.0/jetpack4.2/dlr-1.8.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.3https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.8.0/jetpack4.3/dlr-1.8.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.4https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.8.0/jetpack4.4/dlr-1.8.0-py3-none-any.whl
RaspberryRasp3bhttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.8.0/rasp3b/dlr-1.8.0-py3-none-any.whl
RaspberryRasp4bhttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.8.0/rasp4b/dlr-1.8.0-py3-none-any.whl
RockchipsRK3399https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.8.0/rk3399/dlr-1.8.0-py3-none-any.whl

1.7.0

2 years ago

Release 1.7.0 can be used to run models compiled using the release-1.7.0 branch of neo-ai/TVM.

This Release supports PyTorch object detection models on GPU.

Loading of Multiple DLR is available.

It also supports YOLO v5 in PyTorch.

Pre-built wheels can be installed via pip install link-to-wheel. If you don't see your platform in the table, see Installing DLR for instructions to build from source.

ManufacturerDevice NameWheel URL
AcerTV AISagehttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.7.0/aisage/dlr-1.7.0-py3-none-any.whl
AmazonAWS p2/p3/g4https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.7.0/gpu/dlr-1.7.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.2https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.7.0/jetpack4.2/dlr-1.7.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.3https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.7.0/jetpack4.3/dlr-1.7.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.4https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.7.0/jetpack4.4/dlr-1.7.0-py3-none-any.whl
RaspberryRasp3bhttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.7.0/rasp3b/dlr-1.7.0-py3-none-any.whl
RaspberryRasp4bhttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.7.0/rasp4b/dlr-1.7.0-py3-none-any.whl
RockchipsRK3399https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.7.0/rk3399/dlr-1.7.0-py3-none-any.whl

1.6.0

2 years ago

Release 1.6.0 can be used to run models compiled using the release-1.6.0 branch of neo-ai/TVM.

It enables specifying individual TVM artifacts to CreateDLRModel API and add APIs to use DLTensors for SetInput/GetOutput. It provides missing DLR C++ APIs to GraphRuntime & VMRuntime. Version 1.6.0 skips loading tvm artifacts from disk and allows passing in data directly for graph, params and relay_exec.

This Release supports Pytorch object detection models on CPU. Additional TensorFlow object detection models on GPU are supported like ssd mobilenet,mask_rcnn_resnet, faster_rcnn_resnet, etc.

It also supports NonMaxSuppressionV5 aka tf.image.non_max_suppression_with_scores which returns scores in addition to indices and size.

Pre-built wheels can be installed via pip install link-to-wheel. If you don't see your platform in the table, see Installing DLR for instructions to build from source.

ManufacturerDevice NameWheel URL
AcerTV AISagehttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.6.0/aisage/dlr-1.6.0-py3-none-any.whl
AmazonAWS p2/p3/g4https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.6.0/gpu/dlr-1.6.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.2https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.6.0/jetpack4.2/dlr-1.6.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.3https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.6.0/jetpack4.3/dlr-1.6.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.4https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.6.0/jetpack4.4/dlr-1.6.0-py3-none-any.whl
RaspberryRasp3bhttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.6.0/rasp3b/dlr-1.6.0-py3-none-any.whl
RaspberryRasp4bhttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.6.0/rasp4b/dlr-1.6.0-py3-none-any.whl
RockchipsRK3399https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.6.0/rk3399/dlr-1.6.0-py3-none-any.whl

1.5.0

2 years ago

Release 1.5.0 can be used to run models compiled using the release-1.5.0 branch of neo-ai/TVM.

This update enables support for TensorFlow object detection models on GPU. For these particular models, since part of the model runs on CPU while the other part runs on GPU, the model might have to be loaded with dev_type='cpu'. The DeviceType field in the metadata file will now tell you which device type is required. This can be queried using GetDLRDeviceType.

Pre-built wheels can be installed via pip install link-to-wheel. If you don't see your platform in the table, see Installing DLR for instructions to build from source.

ManufacturerDevice NameWheel URL
AcerTV AISagehttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.5.0/aisage/dlr-1.5.0-py3-none-any.whl
AmazonAWS p2/p3/g4https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.5.0/gpu/dlr-1.5.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.2https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.5.0/jetpack4.2/dlr-1.5.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.2.2https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.5.0/jetpack4.2.2/dlr-1.5.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.3https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.5.0/jetpack4.3/dlr-1.5.0-py3-none-any.whl
NVIDIAJetson device with JetPack 4.4https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.5.0/jetpack4.4/dlr-1.5.0-py3-none-any.whl
RaspberryRasp3bhttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.5.0/rasp3b/dlr-1.5.0-py3-none-any.whl
RockchipsRK3399https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.5.0/rk3399/dlr-1.5.0-py3-none-any.whl

1.4.0

2 years ago

Release 1.4.0 can be used to run models compiled using the release-1.4.0 branch of neo-ai/TVM.

This update brings support for TensorFlow object detection models for CPU, and some PyTorch object detection models.


1.3.0

2 years ago

Release 1.3.0 can be used to run models compiled using the release-1.3.0 branch of neo-ai/TVM

Pre-built wheels can be installed via pip install link-to-wheel. If you don't see your platform in the table, see Installing DLR for instructions to build from source.

ManufacturerDevice NameWheel URL
AcerTV AISagehttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.3.0/acer-aarch64-linaro4_4_154-glibc2_24-libstdcpp3_4/dlr-1.3.0-py3-none-any.whl
AmazonAWS a1https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.3.0/a1-aarch64-ubuntu18_04-glibc2_27-libstdcpp3_4/dlr-1.3.0-py3-none-any.whl
AmazonAWS p2/p3/g4https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.3.0/p3-x86_64-cu10-ubuntu18_04-glibc2_27-libstdpp3_4/dlr-1.3.0-py2.py3-none-any.whl
RockchipsRK3399https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.3.0/firefly-aarch64-mali-ubuntu16_04-glibc2_23-libstdcpp3_4/dlr-1.3.0-py3-none-any.whl
NVIDIAJetson TX1 (JetPack 4.3)https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.3.0/jetsontx1-aarch64-cu10-ubuntu18_04-glibc2_27-libstdcpp3_4/dlr-1.3.0-py3-none-any.whl
NVIDIAJetson TX2 (JetPack 4.3)https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.3.0/jetsontx2-aarch64-cu10-ubuntu18_04-glibc2_27-libstdcpp3_4/dlr-1.3.0-py3-none-any.whl
NVIDIAJetson Nano (JetPack 4.2)https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.3.0/jetsonnano-aarch64-cu10-ubuntu18_04-glibc2_27-libstdcpp3_4/dlr-1.3.0-py3-none-any.whl
NVIDIAJetson Xavier (JetPack 4.4)https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.3.0/jetsonxavier-aarch64-cu102-ubuntu18_04-glibc2_27-libstdcpp3_4/dlr-1.3.0-py3-none-any.whl
RaspberryRasp3bhttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.3.0/pi-armv7l-raspbian4.14.71-glibc2_24-libstdcpp3_4/dlr-1.3.0-py3-none-any.whl

1.2.0

2 years ago

Release 1.2.0 can be used to run models compiled using the release-1.2.0 branch of neo-ai/TVM

Pre-built wheels can be installed via pip install link-to-wheel. If you don't see your platform in the table, see Installing DLR for instructions to build from source.

ManufacturerDevice NameWheel URL
AcerTV AISagehttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.2.0/acer-aarch64-linaro4_4_154-glibc2_24-libstdcpp3_4/dlr-1.2.0-py2.py3-none-any.whl
AmazonAWS a1https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.2.0/a1-aarch64-ubuntu18_04-glibc2_27-libstdcpp3_4/dlr-1.2.0-py2.py3-none-any.whl
AmazonAWS p2/p3/g4https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.2.0/p3-x86_64-cu10-ubuntu18_04-glibc2_27-libstdpp3_4/dlr-1.2.0-py2.py3-none-any.whl
AmazonDeeplenshttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.1.0/deeplens-x86_64-igp-ubuntu16_04-glibc2_23-libstdcpp3_4/dlr-1.1.0-py2.py3-none-any.whl
RockchipsRK3399https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.2.0/firefly-aarch64-mali-ubuntu16_04-glibc2_23-libstdcpp3_4/dlr-1.2.0-py2.py3-none-any.whl
NVIDIAJetson TX1 (JetPack 4.3)https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.2.0/jetsontx1-aarch64-cu10-ubuntu18_04-glibc2_27-libstdcpp3_4/dlr-1.2.0-py2.py3-none-any.whl
NVIDIAJetson TX2 (JetPack 4.3)https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.2.0/jetsontx2-aarch64-cu10-ubuntu18_04-glibc2_27-libstdcpp3_4/dlr-1.2.0-py2.py3-none-any.whl
NVIDIAJetson Nano (JetPack 4.2)https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.2.0/jetsonnano-aarch64-cu10-ubuntu18_04-glibc2_27-libstdcpp3_4/dlr-1.2.0-py2.py3-none-any.whl
NVIDIAJetson Xavier (JetPack 4.3)https://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.2.0/jetsonxavier-aarch64-cu10-ubuntu18_04-glibc2_27-libstdcpp3_4/dlr-1.2.0-py2.py3-none-any.whl
RaspberryRasp3bhttps://neo-ai-dlr-release.s3-us-west-2.amazonaws.com/v1.2.0/pi-armv7l-raspbian4.14.71-glibc2_24-libstdcpp3_4/dlr-1.2.0-py2.py3-none-any.whl

1.1

3 years ago

1.0

4 years ago

11 Versions

TagPublished
1.10.01yr ago
1.9.01yr ago
1.8.02yrs ago
1.7.02yrs ago
1.6.02yrs ago
1.5.02yrs ago
1.4.02yrs ago
1.3.02yrs ago
1.2.02yrs ago
1.13yrs ago
1.04yrs ago