# vision-process-webui **Repository Path**: he_peng1992/vision-process-webui ## Basic Information - **Project Name**: vision-process-webui - **Description**: No description available - **Primary Language**: Unknown - **License**: Apache-2.0 - **Default Branch**: main - **Homepage**: None - **GVP Project**: No ## Statistics - **Stars**: 0 - **Forks**: 0 - **Created**: 2024-05-23 - **Last Updated**: 2024-05-23 ## Categories & Tags **Categories**: Uncategorized **Tags**: None ## README # vision-process-webui ![](https://user-images.githubusercontent.com/59380685/265589543-e255edad-11a9-4be4-8a8d-870dcd00cc08.png) ![GitHub watchers](https://img.shields.io/github/watchers/isLinXu/vision-process-webui.svg?style=social) ![GitHub stars](https://img.shields.io/github/stars/isLinXu/vision-process-webui.svg?style=social) ![GitHub forks](https://img.shields.io/github/forks/isLinXu/vision-process-webui.svg?style=social) ![GitHub followers](https://img.shields.io/github/followers/isLinXu.svg?style=social) [![Build Status](https://img.shields.io/endpoint.svg?url=https%3A%2F%2Factions-badge.atrox.dev%2Fatrox%2Fsync-dotenv%2Fbadge&style=flat)](https://github.com/isLinXu/vision-process-webui) ![img](https://badgen.net/badge/icon/learning?icon=deepscan&label)![GitHub repo size](https://img.shields.io/github/repo-size/isLinXu/vision-process-webui.svg?style=flat-square) ![GitHub language count](https://img.shields.io/github/languages/count/isLinXu/vision-process-webui) ![GitHub last commit](https://img.shields.io/github/last-commit/isLinXu/vision-process-webui) ![GitHub](https://img.shields.io/github/license/isLinXu/vision-process-webui.svg?style=flat-square)![img](https://hits.dwyl.com/isLinXu/vision-process-webui.svg) **language**: [en | [中文](README_zh.md)] --- # 🎤介绍 由于计算机视觉理论和模型的复杂性不断增加,为了方便直观理解和复现,降低使用与复现门槛,并快速验证图像的算法处理效果, 受stable-diffusion-webui项目在扩散模型应用推广方面的启发,一些基于目标检测、图像分割和图像分类等任务的模型被部署并展示在Gradio上进行推理。 **本项目也欢迎更多人贡献、使用以及推广!** ## 📂 特性与功能 - [x] 支持基于本项目app文件进行本地部署,以及移动到其他平台进行部署; - [x] 支持视觉库多个模型的简单配置与选择,无需复杂地选择`config`以及`checkpoint`文件,直接在下拉框或复选框中选择即可; - [x] 支持多种模型与多任务的在线推理,包括`OpenMMLab系列`、`detectron2`、`detrex`、`timm`、`torchvision`、`modelscope&AdaDet`等等; - [x] 支持开源社区进行部署接入,包括`OpenXLab`、`ModelScope`、`huggingface`; - [ ] 支持多app整合到一个界面中,方便用户进行对比与选择;[![building](https://badgen.net/badge/icon/building?&label)]() - [ ] 支持自定义上传权重文件,并输出推理结果及模型指标;[![building](https://badgen.net/badge/icon/building?&label)]() # 🛜在线推理演示 - ❗️目前本仓库支持的gradio应用,已部署在![OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)[**OpenXLab**](https://openxlab.org.cn/apps),![ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)[**ModelScope**](https://www.modelscope.cn/studios) 和 Open in Spaces[**huggingface**](https://huggingface.co/) . 欢迎测试与使用. ## OpenMMLab - [x] 📦[**MMYOLO**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/mmyolo-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/mmdetection-weibui/summary) Open in Spaces - [x] 📦[**MMDetection**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/mmdetection-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/mmdetection-weibui/summary) Open in Spaces - [ ] 📦[**MMDetection3D**](): [![building](https://badgen.net/badge/icon/building?&label)]() - [x] 📦[**MMSegmentation**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/mmsegmentation-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/mmsegmentation-webui/summary) Open in Spaces - [x] 📦[**MMOCR**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/mmocr-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/mmocr-webui/summary) Open in Spaces - [x] 📦[**MMRotate**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/mmrotate-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/mmrotate-webui/summary) Open in Spaces - [ ] 📦[**MMHuman3D**](): [![building](https://badgen.net/badge/icon/building?&label)]() - [x] 📦[**MMAction2**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/mmaction-webui) Open in Spaces - [x] 📦[**MMTracking**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/mmtracking-webui) Open in Spaces - [x] 📦[**MMPreTrain**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/mmpretrain-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/mmpretrain-webui/summary) Open in Spaces - [x] 📦[**MMPose**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/mmpose-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/mmpose-webui/summary) Open in Spaces - [x] 📦[**MMagic**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/mmagic-image-webui) Open in Spaces - [ ] 📦[**MMGeneration**](): [![building](https://badgen.net/badge/icon/building?&label)]() - [ ] 📦[**MMEditing**](): [![building](https://badgen.net/badge/icon/building?&label)]() - [ ] 📦[**MMFlow**](): [![building](https://badgen.net/badge/icon/building?&label)]() ## detectron2 - [x] 📦[**detectron2**](): [![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/detectron2_webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/detectron2-webui/summary) Open in Spaces ## detrex - [x] 📦[**detrex**](): [![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/detrex-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/detrex-webui/summary) Open in Spaces ## modelscope&AdaDet - [x] 📦[**DAMO-YOLO**](): [![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/damo-yolo-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/damo-yolo-webui/summary) Open in Spaces - [x] 📦[**DAMO-FD**](): [![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/damo-facedet-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/damo-facedet-webui/summary) Open in Spaces - [x] 📦[**DAMO-OCR**](): [![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/damo-ocr-webui) Open in Spaces ## detection - [x] 📦[**yolov8-app**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/yolov8-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/yolov8-webui/summary) Open in Spaces - [x] 📦[**yolov5-app**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/yolov5-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/yolov5-webui/summary) Open in Spaces - [x] 📦[**yolov3-app**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/yolov3-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/yolov3-webui/summary) Open in Spaces - [x] 📦[**yolox-app**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/yolox-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/yolox-webui/summary) Open in Spaces - [x] 📦[**yolonas-app**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/yolonas-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/yolonas-webui/summary) Open in Spaces - [x] 📦[**ppyoloe-app**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/ppyoloe_webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/ppyoloe-webui/summary) Open in Spaces - [x] 📦[**torchvision-detection-webui**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/torchvision-detection-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/torchvision-detection-webui/summary) Open in Spaces ## classification - [x] 📦[**torchvision-classification-app**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/torchvision-classification-webui#build-configuration)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/torchvision-cls-app/summary) Open in Spaces - [x] 📦[**timm-classification-webui**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/timm-classification-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/timm-classification-webui/summary) Open in Spaces ## segmentation - [x] 📦[**torchvision-segmentation-app**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/torchvision-segmention-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/torchvision_seg_app/summary) Open in Spaces - [x] 📦[**mobile-sam-app**]():[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/app-center/openxlab_app.svg)](https://openxlab.org.cn/apps/detail/gatilin/mobile-sam-webui)[![Open in ModelScope](https://badgen.net/badge/icon/modelscope?icon=deepscan&label)](https://www.modelscope.cn/studios/isLinXu/mobile_sam_webui/summary) Open in Spaces # 🤖模型支持列表 # 🧙performance&demo ## 🔨OpenMMLab | [![](https://user-images.githubusercontent.com/59380685/266564924-9bf09e70-9c3c-4970-9d99-91b8409e95d3.png)](https://openxlab.org.cn/apps/detail/gatilin/mmpretrain-webui) | [![](https://user-images.githubusercontent.com/59380685/266564614-9a6a296c-cdf5-4d11-9458-49501d88f1bc.png)](https://openxlab.org.cn/apps/detail/gatilin/mmyolo-webui) | [![](https://user-images.githubusercontent.com/59380685/266564542-3b198cfd-6aa0-4676-8b4e-12a0f8c04de9.png)](https://openxlab.org.cn/apps/detail/gatilin/mmdetection-webui) | [![](https://user-images.githubusercontent.com/59380685/266565159-831cc038-a841-4c53-9503-42daf78fcea2.png)](https://openxlab.org.cn/apps/detail/gatilin/mmpose-webui) | | :----------------------------------------------------------: | :----------------------------------------------------------: | :----------------------------------------------------------: | :----------------------------------------------------------: | | [**MMPreTrain**](https://github.com/open-mmlab/mmpretrain) | [**MMYOLO**](https://github.com/open-mmlab/mmyolo) | [**MMDetection**](https://github.com/open-mmlab/mmdetection) | [**MMPose**](https://github.com/open-mmlab/mmpose) | | [![](https://user-images.githubusercontent.com/59380685/266798007-f91c6dbd-4385-4fb9-bc1f-8fc4099e9368.png)](https://openxlab.org.cn/apps/detail/gatilin/mmsegmentation-webui) | [![](https://user-images.githubusercontent.com/59380685/266800686-9317f836-a3e0-4722-9701-76f246fc16d7.png)](https://openxlab.org.cn/apps/detail/gatilin/mmrotate-webui) | [![](https://user-images.githubusercontent.com/59380685/266822288-3a466298-f44b-42f0-b749-fbd04a55020b.png)](https://openxlab.org.cn/apps/detail/gatilin/mmocr-webui) | [![](https://user-images.githubusercontent.com/59380685/267196543-54fa664a-c45e-455f-b093-b1a6759e4913.png)](https://openxlab.org.cn/apps/detail/gatilin/mmaction-webui) | | [**MMSegmentation**](https://github.com/open-mmlab/mmsegmentation) | [**MMRotate**](https://github.com/open-mmlab/mmrotate) | [**MMOCR**](https://github.com/open-mmlab/mmocr) | [**MMAction2**](https://github.com/open-mmlab/mmaction2) | | | | | | | | | | | | | | | | | | | | | ## 🔨detectron2 | ![](https://user-images.githubusercontent.com/59380685/268517889-4ff3f3c5-83ef-45f8-a4e6-ffed69ce7a21.png) | ![](https://user-images.githubusercontent.com/59380685/268518389-da51a1ce-5438-4032-bbe2-4afd657d757d.png) | | | | ------------------------------------------------------------ | ------------------------------------------------------------ | ---- | ---- | | | | | | | | | | | ## 🔨classification | ![](https://user-images.githubusercontent.com/59380685/265667039-ce3f2122-4317-4c57-9bab-9ebc792ca23b.png) | | ------------------------------------------------------------ | | ![](https://user-images.githubusercontent.com/59380685/265667095-6a0d4513-cb21-42ff-b77c-723da474d0fe.png) | | ![](https://user-images.githubusercontent.com/59380685/265667360-20438bef-91ee-4847-a5e2-16ef4e658935.png) | --- ## 🔨detection | ![](https://user-images.githubusercontent.com/59380685/265492490-9353cd87-052d-4dcb-9115-afb7954c00dd.png) | ![](https://user-images.githubusercontent.com/59380685/265493664-939d5c5f-f571-4a84-b6e9-6193f4613f37.png) | ![](https://user-images.githubusercontent.com/59380685/265493715-e920d82e-c85d-43e1-a7ae-c0a706c0bb95.png) | ![](https://user-images.githubusercontent.com/59380685/265493821-19954089-befb-4cec-baac-688427a84589.png) | | :----------------------------------------------------------: | :----------------------------------------------------------: | :----------------------------------------------------------: | :----------------------------------------------------------: | | YOLOv8-det | YOLOv8-seg | YOLOv8-seg | YOLOv8-seg | | ![](https://user-images.githubusercontent.com/59380685/265312963-41d535a2-f920-443e-a048-6428983fac46.png) | ![](https://user-images.githubusercontent.com/59380685/265313403-9e4937bc-a497-4806-ab9c-99a3b864f2d9.png) | ![](https://user-images.githubusercontent.com/59380685/265313486-6a3785ee-0202-4a4f-9816-23dbb0a3588c.png) | | :----------------------------------------------------------: | :----------------------------------------------------------: | :----------------------------------------------------------: | | | | | | | | | | YOLOv3 | YOLOv5 | YOLOX | | ![](https://user-images.githubusercontent.com/59380685/265494398-e053e543-11ec-4fc7-81ad-32bb97983fc0.png) | ![](https://user-images.githubusercontent.com/59380685/265494778-5262fb37-40f2-46df-b31e-089775d9223c.png) | ![](https://user-images.githubusercontent.com/59380685/265507024-baa0f476-4800-4bba-9129-5e2744468495.png) | | YOLO-NAS | PP-YOLOE | RT-Detr | --- ## 🔨segmentation | [![](https://user-images.githubusercontent.com/59380685/265508535-ce1820d2-e161-4ddf-bd7a-70c5306ee5d5.png)]() | ![](https://user-images.githubusercontent.com/59380685/265508607-9c07e74c-a083-4df7-bd31-38d1bb402b25.png) | |:--------------------------------------------------------------------------------------------------------------:| :----------------------------------------------------------: | | ![](https://user-images.githubusercontent.com/59380685/265508557-bc5baa23-f5a0-408e-88b6-c112f9891dd8.png) | ![](https://user-images.githubusercontent.com/59380685/265508693-189b0990-149a-4fe6-bada-bb8ae7c09042.png) | | mobile-sam[point] | mobile-sam[bbox] | --- # 🆕News - [x] (2023-09-29): update README.md - [x] (2023-09-20): `detrex、damo-yolo、easy-face` - [x] (2023-09-18): `detectron2` - [x] (2023-09-16): `mmagic` - [x] (2023-09-14): `mmtracking` - [x] (2023-09-12): `mmaction2` - [x] (2023-09-10): `mmocr、mmroate、mmsegmentation` - [x] (2023-09-08): `mmyolo、mmpretrain、mmdetection、mmpose` - [x] (2023-09-07): `yolov3、yolov5、yolov8、yolo_nas、yolox、torchvision-detection、mobile-sam、timm-classification` - [x] (2023-09-02): repo init. # 🗓support list | Model | Nums | list | | :-------------: | :--: | :------------------------------------------------: | | yolov3 | 3 | [model_list](models/list/yolo_model_list.py) | | yolov5 | 4 | [model_list](models/list/yolo_model_list.py) | | yolox | 5 | [model_list](models/list/yolo_model_list.py) | | yolonas | 3 | [model_list](models/list/yolo_model_list.py) | | yolov8 | 4 | [model_list](models/list/yolo_model_list.py) | | timm | 20 | [model_list](models/list/timm_cls_list.py) | | torchvision_cls | 14 | [model_list](models/list/torchvision_cls_list.py) | | torchvision_det | 6 | [model_list](models/list/torchvision_det_list.py) | | detectron2 | 36 | [model_list](models/list/detectron2_model_list.py) | | detrex | 61 | [model_list](models/list/detrex_model_list.py) | | mmpretrain | 545 | [model_list](models/list/mmpretrain_model_list.py) | | mmyolo | 74 | [model_list](models/list/mmyolo_model_list.py) | | mmdetection | 559 | [model_list](models/list/mmdet_model_list.py) | | mmsegmentation | 622 | [model_list](models/list/mmseg_model_list.py) | | mmocr | 17 | [model_list](models/list/mmocr_model_list.py) | | mmaction2 | 180 | [model_list](models/list/mmaction2_model_list.py) | | mmrorate | 50 | [model_list](models/list/mmrotate_model_list.py) | | mmpose | 10 | [model_list](models/list/mmpose_model_list.py) | | mmagic | 14 | [model_list](models/list/mmagic_model_list.py) | | damo_face | 4 | [model_list](models/list/damo_face_list.py) | | damo_yolo | 8 | [model_list](models/list/yolo_model_list.py) | | | | | | | | | ## 🔨classification - [x] **VGG16**([src](https://arxiv.org/abs/1409.1556) | [code](webui/cls/torchvision_cls_ui.py)) - [x] **AlexNet**([src](https://arxiv.org/abs/1404.5997) | [code](webui/cls/torchvision_cls_ui.py)) - [x] **ResNet18**([src](https://arxiv.org/abs/1512.03385) | [code](webui/cls/torchvision_cls_ui.py)) - [x] **ResNet50**([src](https://arxiv.org/abs/1512.03385) | [code](webui/cls/torchvision_cls_ui.py)) - [x] **ResNet101**([src](https://arxiv.org/abs/1512.03385) | [code](webui/cls/torchvision_cls_ui.py)) - [x] **ResNet152**([src](https://arxiv.org/abs/1512.03385) | [code](webui/cls/torchvision_cls_ui.py)) - [x] **GoogLeNet**([src](https://arxiv.org/abs/1409.4842) | [code](webui/cls/torchvision_cls_ui.py)) - [x] **DenseNet121**([src](https://arxiv.org/abs/1608.06993) | [code](webui/cls/torchvision_cls_ui.py)) - [x] **MobileNetV2**([src](https://arxiv.org/abs/1801.04381) | [code](webui/cls/torchvision_cls_ui.py)) - [x] **SqueezeNet**([src]() | [code](webui/cls/torchvision_cls_ui.py)) - [x] **WideResNet50**([src]() | [code](webui/cls/torchvision_cls_ui.py)) - [x] **WideResNet101**([src]() | [code](webui/cls/torchvision_cls_ui.py)) - [x] **InceptionV3**([src]() | [code](webui/cls/torchvision_cls_ui.py)) ## 🔨detection - [x] **yolov3**([src](https://docs.ultralytics.com/models/yolov3/) | [code](webui/det/yolov3_ui.py)) - [ ] **yolov4**([src](https://docs.ultralytics.com/models/yolov4/) | [code](webui/det/yolov4_ui.py)) - [x] **yolov5**([src](https://docs.ultralytics.com/models/yolov5/) | [code](webui/det/yolov5_ui.py)) - [ ] **yolov6**([src](https://docs.ultralytics.com/models/yolov6/) | [code](webui/det/yolov6_ui.py)) - [ ] **yolov7**([src](https://docs.ultralytics.com/models/yolov7/) | [code](webui/det/yolov7_ui.py)) - [x] **yolox**([src](https://github.com/Deci-AI/super-gradients/blob/master/src/super_gradients/training/models/detection_models/yolox.py) | [code](webui/det/yolox_ui.py))) - [x] **ppyoloe**([src](https://github.com/Deci-AI/super-gradients/tree/master/src/super_gradients/training/models/detection_models/pp_yolo_e) | [code](webui/det/ppyoloe_ui.py))) - [x] **yolo-nas**([src](https://github.com/Deci-AI/super-gradients/blob/master/YOLONAS.md) | [code](webui/det/yolonas_ui.py))) - [x] **yolov8**([src](https://docs.ultralytics.com/models/yolov8/) | [code](webui/det/yolov8_ui.py)) - [x] **rtdetr-l**([src](https://docs.ultralytics.com/models/rtdetr/) | [code](webui/det/rt_detr_ui.py))) - [x] **fasterrcnn_resnet50_fpn**([src]() | [code](webui/det/torchvision_det_ui.py))) - [x] **maskrcnn_resnet50_fpn**([src]() | [code](webui/det/torchvision_det_ui.py))) - [x] **keypointrcnn_resnet50_fpn**([src]() | [code](webui/det/torchvision_det_ui.py))) - [x] **retinanet_resnet50_fpn**([src]() | [code](webui/det/torchvision_det_ui.py))) --- ## 🔨segmentation - [x] **mobile_sam**([src](https://docs.ultralytics.com/models/mobile-sam/) | [code](webui/seg/mobilesam_ui.py)) - [x] **fast_sam**([src](https://docs.ultralytics.com/models/fast-sam/) | [code](webui/seg/fastsam_ui.py)) - [x] **DeepLabv3**([src]() | [code](webui/seg/torchvision_seg_ui.py)) - [x] **DeepLabv3+**([src]() | [code](webui/seg/torchvision_seg_ui.py)) - [x] **FCN-ResNet50**([src]() | [code](webui/seg/torchvision_seg_ui.py)) - [x] **FCN-ResNet101**([src]() | [code](webui/seg/torchvision_seg_ui.py)) - [x] **LRR**([src]() | [code](webui/seg/torchvision_seg_ui.py)) - [x] UNet() # 📢实际意义与作用 这是一个包含主要视觉任务与开源视觉库的Gradio推理仓库,它的总体意义和作用如下: - 方便性:为开发者和研究者提供了一个方便的平台,他们可以在其中测试和比较不同的模型和算法。同时,用户可以通过上传图像来测试不同的视觉任务,而无需自己编写代码。 - 教育性:可以帮助用户更好地理解和使用视觉库,并且可以作为学习深度学习和计算机视觉的教育资源。 - 社区性:可以促进开源社区的发展和知识共享,因为它集成了多个开源视觉库,用户可以轻松地比较和测试不同的库和模型。 - 实用性:包含了常见的视觉任务,如图像分类、目标检测、语义分割、人脸识别等,这些任务都是在实际应用中非常有用的。 - 开放性:是开源的,任何人都可以访问和使用它,这意味着它可以被不同的人和组织使用和扩展,从而进一步推动计算机视觉和深度学习的发展。 - 速度和效率:使用 Gradio 进行推理,这意味着用户可以快速地上传图像并查看模型的预测结果,而无需等待长时间的训练和推理过程。 - 可重复性:提供了一个可重复的测试平台,用户可以使用相同的数据和模型来测试不同的库和算法,从而比较它们的性能和准确性。 - 可扩展性:可以轻松地扩展到其他视觉任务和库,因为它是基于 Gradio 和开源视觉库构建的。 - 可视化:可以帮助用户更好地理解模型的预测结果,因为它可以将预测结果可视化为图像或其他形式的输出,从而使用户更容易理解和解释模型的行为。 # 📖Usage ## 1. install ```shell git clone https://github.com/isLinXu/vision-process-webui.git cd vision-process-webui pip install -r requirements.txt ``` ## 2. download weights ```shell cd weights cd [model_name] sh download_weights.sh ``` model_name=xxxx ## 3. run ```shell python webui/model_app.py ``` model_app=classification|detection|segmentation or ```shell cd webui/app python [model_app].py ``` model_app=yolov3|yolov5|yolov8|yolonas|ppyoloe|torchvision-detection|torchvision-classification|torchvision-segmentation|mobile-sam|fast-sam # 🧾TODO ## support more models and libraries ### OpenMMLab - [x] 📦[**MMYOLO**]() - [x] 📦[**MMDetection**]() - [ ] 📦[**MMDetection3D**](): - [x] 📦[**MMSegmentation**](): - [x] 📦[**MMOCR**](): - [ ] 📦[**MMHuman3D**](): - [x] 📦[**MMAction2**](): - [x] 📦[**MMTracking**](): - [x] 📦[**MMRotate**](): - [x] 📦[**MMPreTrain**](): - [x] 📦[**MMPose**](): - [x] 📦[**MMagic**](): - [ ] 📦[**MMGeneration**](): - [ ] 📦[**MMEditing**](): - [ ] 📦[**MMFlow**](): ### detectron2 series - [x] 📦[**detectron2**](): - [x] 📦[**detrex**](): ## EasyCV - [ ] 📦[**Classification**](https://github.com/alibaba/EasyCV/blob/master/docs/source/model_zoo_cls.md): - [ ] 📦[**Detection**](https://github.com/alibaba/EasyCV/blob/master/docs/source/model_zoo_det.md): - [ ] 📦[**Segmentation**](https://github.com/alibaba/EasyCV/blob/master/docs/source/model_zoo_seg.md): - [ ] 📦[**Pose Estimation**](https://github.com/alibaba/EasyCV/blob/master/docs/source/model_zoo_pose.md) ## AdaDet - [x] 📦[**DAMO-YOLO**](): - [x] 📦[**DAMO-FD**](): - [ ] building... ## gluon-cv - [ ] building... ## PaddleDetection - [ ] building... ## docker image build - [ ] building... ## merge all ui.py in one - [ ] building... # 📢实际意义与作用 这是一个包含主要视觉任务与开源视觉库的Gradio推理仓库,它的总体意义和作用如下: - 方便性:为开发者和研究者提供了一个方便的平台,他们可以在其中测试和比较不同的模型和算法。同时,用户可以通过上传图像来测试不同的视觉任务,而无需自己编写代码。 - 教育性:可以帮助用户更好地理解和使用视觉库,并且可以作为学习深度学习和计算机视觉的教育资源。 - 社区性:可以促进开源社区的发展和知识共享,因为它集成了多个开源视觉库,用户可以轻松地比较和测试不同的库和模型。 - 实用性:包含了常见的视觉任务,如图像分类、目标检测、语义分割、人脸识别等,这些任务都是在实际应用中非常有用的。 - 开放性:是开源的,任何人都可以访问和使用它,这意味着它可以被不同的人和组织使用和扩展,从而进一步推动计算机视觉和深度学习的发展。 - 速度和效率:使用 Gradio 进行推理,这意味着用户可以快速地上传图像并查看模型的预测结果,而无需等待长时间的训练和推理过程。 - 可重复性:提供了一个可重复的测试平台,用户可以使用相同的数据和模型来测试不同的库和算法,从而比较它们的性能和准确性。 - 可扩展性:可以轻松地扩展到其他视觉任务和库,因为它是基于 Gradio 和开源视觉库构建的。 - 可视化:可以帮助用户更好地理解模型的预测结果,因为它可以将预测结果可视化为图像或其他形式的输出,从而使用户更容易理解和解释模型的行为。 # 🌸Reference - [**stable-diffusion-webui**](https://github.com/AUTOMATIC1111/stable-diffusion-webui): Stable Diffusion web UI - [**torchvision**](https://github.com/pytorch/vision): Datasets, Transforms and Models specific to Computer Vision - [**timm**](https://github.com/huggingface/pytorch-image-models): PyTorch image models, scripts, pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNet-V3/V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more - [**yolov3**](https://github.com/ultralytics/yolov3): YOLOv3 in PyTorch > ONNX > CoreML > TFLite - [**yolov5**](https://github.com/ultralytics/yolov5): YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite - [**ultralytics**](https://github.com/ultralytics/ultralytics): NEW - YOLOv8 🚀 in PyTorch > ONNX > OpenVINO > CoreML > TFLite - [**super-gradients**](https://github.com/Deci-AI/super-gradients): Easily train or fine-tune SOTA computer vision models with one open source training library. The home of Yolo-NAS. - [**MMEngine**](https://github.com/open-mmlab/mmengine): OpenMMLab foundational library for training deep learning models. - [**MMCV**](https://github.com/open-mmlab/mmcv): OpenMMLab foundational library for computer vision. - [**MMPreTrain**](https://github.com/open-mmlab/mmpretrain): OpenMMLab pre-training toolbox and benchmark. - [**MMagic**](https://github.com/open-mmlab/mmagic): Open**MM**Lab **A**dvanced, **G**enerative and **I**ntelligent **C**reation toolbox. - [**MMDetection**](https://github.com/open-mmlab/mmdetection): OpenMMLab detection toolbox and benchmark. - [**MMDetection3D**](https://github.com/open-mmlab/mmdetection3d): OpenMMLab's next-generation platform for general 3D object detection. - [**MMRotate**](https://github.com/open-mmlab/mmrotate): OpenMMLab rotated object detection toolbox and benchmark. - [**MMYOLO**](https://github.com/open-mmlab/mmyolo): OpenMMLab YOLO series toolbox and benchmark. - [**MMSegmentation**](https://github.com/open-mmlab/mmsegmentation): OpenMMLab semantic segmentation toolbox and benchmark. - [**MMOCR**](https://github.com/open-mmlab/mmocr): OpenMMLab text detection, recognition, and understanding toolbox. - [**MMPose**](https://github.com/open-mmlab/mmpose): OpenMMLab pose estimation toolbox and benchmark. - [**MMHuman3D**](https://github.com/open-mmlab/mmhuman3d): OpenMMLab 3D human parametric model toolbox and benchmark. - [**MMSelfSup**](https://github.com/open-mmlab/mmselfsup): OpenMMLab self-supervised learning toolbox and benchmark. - [**MMRazor**](https://github.com/open-mmlab/mmrazor): OpenMMLab model compression toolbox and benchmark. - [**MMFewShot**](https://github.com/open-mmlab/mmfewshot): OpenMMLab fewshot learning toolbox and benchmark. - [**MMAction2**](https://github.com/open-mmlab/mmaction2): OpenMMLab's next-generation action understanding toolbox and benchmark. - [**MMTracking**](https://github.com/open-mmlab/mmtracking): OpenMMLab video perception toolbox and benchmark. - [**MMFlow**](https://github.com/open-mmlab/mmflow): OpenMMLab optical flow toolbox and benchmark. - [**MMEditing**](https://github.com/open-mmlab/mmediting): OpenMMLab image and video editing toolbox. - [**MMGeneration**](https://github.com/open-mmlab/mmgeneration): OpenMMLab image and video generative models toolbox. - [**MMDeploy**](https://github.com/open-mmlab/mmdeploy): OpenMMLab model deployment framework. - [**MIM**](https://github.com/open-mmlab/mim): MIM installs OpenMMLab packages. - [**MMEval**](https://github.com/open-mmlab/mmeval): OpenMMLab machine learning evaluation library. - [**Playground**](https://github.com/open-mmlab/playground): A central hub for gathering and showcasing amazing projects built upon OpenMMLab. - [**detectron2**](https://github.com/facebookresearch/detectron2): Detectron2 is a platform for object detection, segmentation and other visual recognition tasks. - [**detrex**](https://github.com/IDEA-Research/detrex): detrex is a research platform for DETR-based object detection, segmentation, pose estimation and other visual recognition tasks. - [**gluon-cv**](https://github.com/dmlc/gluon-cv):Gluon CV Toolkit - [**autogluon**](https://github.com/autogluon/autogluon): AutoGluon: AutoML for Image, Text, Time Series, and Tabular Data - [**EasyCV**](https://github.com/alibaba/EasyCV): An all-in-one toolkit for computer vision - [**AdaDet**](https://github.com/modelscope/AdaDet):AdaDet: A Development Toolkit for Object Detection based on ModelScope - [**mediapipe**](https://developers.google.com/mediapipe):MediaPipe Solutions provides a suite of libraries and tools for you to quickly apply artificial intelligence (AI) and machine learning (ML) techniques in your applications. - [**dlib**](https://github.com/davisking/dlib):A toolkit for making real world machine learning and data analysis applications in C++