yolort

This release is mainly compatibility updates for PyTorch 1.11.0 (#359) and to support loading the checkpoints trained with AutoAnchor mechanism in YOLOv5 (#285, #352).

Besides, we

• Move bias initializations from private methods to constructors (#351)
• Upgrade PyTorch minimal version to 1.8.0 (#359)
• Added support for Python 3.10 (only works with PyTorch 1.11) (#359)
• Remove lightning strong dependencies (#355, #358)
• Update tutorials with Visualizer (#354)
• Small grammar and spelling fixes (#357)

We're grateful for our community, which helps us improving yolort by submitting issues and PRs, and providing feedback and suggestions. The following persons have contributed patches for this release:

@mattpopovich @zhiqwang

Full Changelog: https://github.com/zhiqwang/yolov5-rt-stack/compare/v0.6.1...v0.6.2

This release adds an example to showcase how to use the model banks provided by TorchVision to build a new YOLOv5 model, introduces Visualizer to display the predictions and fixes an incompatible bug in YOLOv5 Detect Layer.

Highlights

Build a new YOLOv5 model via TorchVision's model banks

We add an example to showcase how to construct a YOLOv5-Lite model with TorchVision's pre-trained MobileNetV3-Small FPN as the backbone.

import torch
from yolort.models.yolo_lite import yolov5_mobilenet_v3_small_fpn

model = yolov5_mobilenet_v3_small_fpn()
model = model.eval()

images = torch.rand(4, 3, 640, 640)
out = model(images)

• Use C3 following the model specification of YOLOv5 (#343)
• Construct YOLOv5 models with TorchVision MobileNetV3 backbone (#342)

Introduce a new visualization interface

from torchvision.io import read_image
from yolort.models import yolov5n6
from yolort.utils import Visualizer

model = yolov5n6(pretrained=True, score_thresh=0.45)
model = model.eval()
img_path = "bus.jpg"
preds = model.predict(img_path)

metalabels_path = "coco.names"
image = read_image(img_path)
v = Visualizer(image, metalabels=metalabels_path)
v.draw_instance_predictions(preds[0])
v.imshow(scale=0.5)

• Add Visualizer for visualization (#341)

Bugfixes

• Fix YOLOv5 AnchorGenerator compatibility (#345)
• Add missing version param in export_tensorrt (#335)

Code Quality

• Update Visualizer in docs and PR Recommendations (#346)
• Bump versions on GH Action (#344, #338, #337)

Contributors

We're grateful for our community, which helps us improving yolort by submitting issues and PRs, and providing feedback and suggestions. The following persons have contributed patches for this release:

@Luwill6, @zhiqwang

Full Changelog: https://github.com/zhiqwang/yolov5-rt-stack/compare/v0.6.0...v0.6.1

This release provides TensorRT deployment support both for Python and C++ interface and supports pre-processing alignment with the official yolov5.

Highlights

Use yolort to deploy YOLOv5 on TensorRT

Unlike other pipelines that deal with YOLOv5 on TensorRT, we embed the whole post-processing into the serialized engine with TensorRT's EfficientNMS_TRT plugin. This pipeline could simplify deployment and gain in speed due to TensorRT's efficient implementation of this plugin. Check out this tutorial detailing yolort's model conversion and use cases. Here is a Python pipeline to deploy YOLOv5 on TensorRT.

import torch
from yolort.runtime import PredictorTRT

# Load the serialized TensorRT engine
engine_path = "yolov5n6.engine"
device = torch.device("cuda")
y_runtime = PredictorTRT(engine_path, device=device)

# Perform inference on an image file
predictions = y_runtime.predict("bus.jpg")

• Support exporting yolort to TensorRT serialized engine (#238, #242, #243, #252, #254, #263, #275, #288, #311, #312, #326)
• Add TensorRT Python inference pipeline (#251, #253, #256, #259, #283, #290, #307, #309)
• Add TensorRT C++ inference example (#245, #257, #258, #261, #262, #305, #321, #323, #324)

Alignment with the official yolov5 Pre-Processing

Pre-processing misalignment has been an obstacle to getting yolort to land, and we've fixed that in this release.

• Fix the consistency of pre-processing with yolov5 (#293)
• Support fixed shape inference in pre-processing (#301)
• Fix pre-processing for TVM VM inference (#302)

Backwards Incompatible Changes

• Rename relaying to relay (#313)
• Move Lightning wrapper into trainer (#314)
• Deprecate the methods run_on_image function in PredictorORT (#327)

Improvement

• Support loading the latest version of yolov5 (#235)
• Formal documentation support (#224, #225, #292)
• Cleanup AnchorGenerator and PostProcess (#203)
• Revert SPPF to SPP for downstream compatible (#240)
• Support custom image size when exporting ONNX models (#250, #264, #269)
• Upgrade with latest PyTorch version in GH Actions (#255)
• Update PyTorch to 1.10 in TVM relay VM tutorial (#287)
• Enhance PredictorORT to adapt to more scenarios (#319, #320, #327)
• Support publishing 🐍 to PyPI.org 📦 with GH Actions (#229, #241, #306, #328, #329)

Bugfixes

• Small fixes to CONTRIBUTING guide (#218)
• Fix type casting in ONNX Runtime C++ example (#221)
• Fix TorchScript exporting for custom checkpoints (#267)
• Fix non-agnostic parameter in tutorial (#284)
• Fix a bug and document RandomZoomOut (#289)
• Compatible with Windows for LibTorch deployment (#303)

Documentation improvements

• Add comparison docs for yolov5 & yolort (#300)
• Update Docs and Readme (#223, #299, #304, #308, #315)
• Add Fidan and Shiquan as co-authors for great contributions (#231, #258)

Code Quality

• Update to .clang-format (#222)
• Enable pip cache dependencies in GH Actions (#226)
• Move CONTRIBUTING and CODE_OF_CONDUCT into .github (#228)
• Cleanup unit-test (#246)
• Fixed some spelling/typos (#276)
• Set OpenCV as optional (#286)
• [pre-commit.ci] pre-commit autoupdate (#244, #249, #260, #270)
• Install yolort in GH Actions (#294)
• Replaced to_tensor() with pil_to_tensor() + convert_image_dtype() (#298)
• Remove CLI tools for detection and training temporarily (#325)

Contributors

We're grateful for our community, which helps us improving yolort by submitting issues and PRs, and providing feedback and suggestions. The following persons have contributed patches for this release:

@datumbox @lzmisscc @mattpopovich @ncnnnnn @ShiquanYu @triple-Mu @yang-gis @zhiqwang @2428513107

Special thanks to @ShiquanYu for his great contributions on TensorRT C++ example!

This release mainly supports upstream YOLOv5 v6.0 models.

Highlights

We set the model to r6.0 by default, and rest of the usage interface is the same as before.

from yolort.models import yolov5n6

# Load model
model = yolov5n6(upstream_version="r6.0", pretrained=True, score_thresh=0.45)
model.eval()

# Perform inference on an image file
predictions = model.predict("bus.jpg")
# Perform inference on a list of image files
predictions = model.predict(["bus.jpg", "zidane.jpg"])

New Features

• Fully support upstream YOLOv5 v6.0 models (#194, #195, #196, #199, #204, #206, #213, #215) Thanks @deepage
• Support PyTorch 1.10 (#207)
• Support skipping preprocess when exporting ONNX (#193)

Backwards Incompatible Changes

• Set main as the base branch (#200)
• Rename _yolov5_darknet_pan to build_model (#198)

Improvement

• Use torch.jit.trace in unit-test for easier use in downstream (#205) Thanks @nihui
• Update model graph visualization images (#212)
• [pre-commit.ci] pre-commit autoupdate (#191, #197)

Bugfixes

• Fix non-renderable images on PyPI (#209, #210)
• Fix the anchor configuration mechanism (#201, #202)
• Small fixes to the docstrings (#208)