Home › Image Tools › ComfyUI-Florence2

ComfyUI-Florence2 - AI Image Tools Tool

Overview

ComfyUI-Florence2 integrates Microsoft’s Florence-2 vision foundation model into ComfyUI, enabling prompt-based vision and vision-language workflows. Supported tasks include captioning, object detection, segmentation, and Document Visual Question Answering (DocVQA) on scanned documents.

Key Features

  • Integrates Microsoft Florence-2 into ComfyUI for vision and vision-language workflows
  • Prompt-based image captioning
  • Object detection outputs usable in ComfyUI pipelines
  • Image segmentation support for region-level analysis
  • Document Visual QA (DocVQA) on scanned documents
  • Open-source GitHub repository with integration code

Ideal Use Cases

  • Generate descriptive captions for image datasets
  • Detect and label objects in photos or frames
  • Create segmentation masks for image editing or analysis
  • Answer questions about scanned documents using DocVQA
  • Prototype vision-language pipelines within ComfyUI

Getting Started

  • Visit the project's GitHub repository to read the README
  • Clone or download the repository locally
  • Install ComfyUI and any dependencies listed in the README
  • Place or configure Florence-2 model files as instructed
  • Launch ComfyUI and load the Florence-2 integration nodes

Pricing

Not disclosed in the repository.

Key Information

  • Category: Image Tools
  • Type: AI Image Tools Tool
Visit Official Website

Related Tools

AI Image Upscaler With Super Resolution

An image upscaling tool using Real-ESRGAN, designed to improve image resolution and quality, available on Replicate.
AI Image & Photo Restoration

A collection of AI-powered tools on Replicate designed for restoring and enhancing images, including models like CodeFormer and others for upscaling, colorization, and noise removal.
AI Image Generator – Text to Image Models

A platform that hosts various AI models for generating images from text prompts using advanced techniques such as Stable Diffusion and FLUX.1, showcasing models with capabilities including realistic text generation, SVG creation, and high-quality image outputs.
InvokeAI

InvokeAI is an open-source creative engine based on Stable Diffusion models that empowers professionals, artists, and enthusiasts to generate high-quality visual media using AI-driven technologies. It features a user-friendly WebUI and serves as a foundation for various commercial and creative products.
ComfyUI

A powerful and modular GUI, API, and backend for diffusion models that allows users to design and execute advanced stable diffusion pipelines using a graph/node/flowchart-based interface. It supports image, video, audio models, and various optimizations.
SD.Next

SD.Next is an all-in-one AI generative image tool implemented as a GitHub repository. It provides a robust diffusion-based framework for text-to-image generation, supporting multiple UIs and a wide range of models and platforms including CUDA, ROCm, DirectML, and more. It features advanced processing optimizations such as model compile, quantization and compression as well as built-in queue management and installer for updates.