Plant phenotyping via PlantCV — returns traits plus the segmentation overlay they came from
PlantCV MCP Server
This MCP server (io.github.musharna/plantcv-mcp) performs plant phenotyping using PlantCV. It returns extracted traits along with the segmentation overlay that those traits were measured from. The project is associated with model-context-protocol (MCP) and is positioned for bioinformatics, computer vision, and image analysis workflows focused on plant science.
🛠️ Key Features
Plant phenotyping via PlantCV
Trait outputs
Segmentation overlay included with results
🚀 Use Cases
Quantifying plant traits from images
Linking computed traits to the segmentation regions used
⚡ Developer Benefits
Fits MCP (Model Context Protocol) integrations
Supports image-analysis and computer-vision pipelines for plant phenotyping
⚠️ Limitations
Limited information provided in available source data about supported inputs, tools, or runtime behavior
PlantCV as an MCP measurement instrument: it returns plant trait
numbers and the picture they were computed from, and refuses to return numbers when the
segmentation is degenerate.
Unofficial. Not affiliated with, endorsed by, or sponsored by the Donald
Danforth Plant Science Center or the PlantCV maintainers. See NOTICE.
Why you are handed the overlay
Both images below come from the same file and the same threshold method — the only difference
is one parameter.
✅ channel="a", object_type="dark"
❌ channel="s", object_type="dark"
Mask covers 3.1% of the frame, 9 components. area=32427
Mask covers 96.1% — it is the background. area=1007829
The failure on the right is what this server exists to prevent. Without the picture, both
runs return seventeen traits with correct units and entirely believable magnitudes. The one
on the right is measuring the wall behind the plants.
Red marks the pixels that were measured; a cyan line traces the mask's own boundary, drawn on
the mask's edge pixels so it never touches anything unmasked (the tint alone was invisible on
a photo of red beans).
segment() returns the overlay and diagnostics but no traits. measure() requires the
session_id that segment() mints, so a single-image measurement cannot be made without
first being handed the image it came from. Batch mode is the exception: measure_images()
applies one recipe to up to 200 images and returns no overlays. You are meant to settle that
recipe on one image's overlay first, but the server does not check that you did. What it does
check is that every image passes the same guards as segment(); an image that trips a
blocking guard comes back with no traits.
That is not a style preference. Measured with PlantCV 4.11.3 on a synthetic render (the
first row: tests/fixtures/multi_specimen.png) and on photographs:
failure
what you get without the overlay
four-view render, whole-image ROI
17 plausible traits describing four merged plants
plant clipped by the frame
size traits that are silently lower bounds
empty mask
17 traits of zeros, with PlantCV reporting in_bounds=True
All three produce entirely believable numbers with correct units.
Install
No install is needed if the host has uv: uvx plantcv-mcp
fetches the current release into its own environment and runs it. Otherwise:
bash
pip install plantcv-mcp
segment_leaves_sam() is the one optional tool: pip install "plantcv-mcp[sam]" adds torch,
torchvision and segment-anything. Without the extra every other tool works and that one
refuses with that command.
Requires Python 3.11+. Installing pulls PlantCV and its scientific stack, so the first
install (or first uvx run) is not fast. From a checkout: uv add /path/to/plantcv-mcp.
With a pip install, use "command": "plantcv-mcp" (and drop uvx from the claude mcp add
line); from a checkout, "command": "uv", "args": ["run", "--directory", "/path/to/plantcv-mcp", "plantcv-mcp"]. Verify with list_methods().
Flags: --root DIR (repeatable, or PLANTCV_MCP_ROOTS) confines every read, and every file
the server keeps (see Security), to your imagery: plantcv-mcp --root /data/phenotyping. --no-isolate (or
PLANTCV_MCP_ISOLATE=0) runs analyses in-process instead of in the crash-containing worker.
Tools
tool
returns
suggest_segmentation(image_path, channel, method)
contact sheets, and what each object_type would yield
segment(image_path, channel, method, ...)
overlay + diagnostics + warnings — no traits
refine(session_id, ops)
a NEW session with a cleaned-up mask, plus its overlay
measure(session_id, analyses, px_per_mm, ...)
traits, or a raised error on a degenerate mask
calibrate_scale_from_marker(image_path, x, y, w, h, marker_length_mm)
an HSI session from a spectral-index threshold + pseudo-RGB overlay
measure_spectral(session_id, indices, ...)
index statistics (and, opt-in, per-band reflectance)
segment_thermal(path, min_c, max_c, ...)
a thermal session from a °C band + grey-frame overlay
measure_thermal(session_id, ...)
max/min/mean/median °C under the mask
list_methods()
channels, methods, object types, pinned PlantCV version
Typical loop: suggest_segmentation → segment → look at the overlay → segment again
with a different channel, method or polarity if it is wrong (or refine if it is nearly
right) → measure. Pass color_correct=true to segment when a ColorChecker is in the
frame: colours are corrected to the reference before segmenting and measuring, and the card
itself is excluded from the mask (exclude_color_card=true does only the exclusion).
Each guard below was added after a specific failure, and each names the next action.
Several of those failures were first seen on photographs that are not distributed with this
repository (the sorghum photo below is one); the tests reproduce them on synthetic images and
the committed fixtures. Blocking guards withhold numbers; advisories travel with them.
Inverted mask (implausible_coverage) — the right-hand image above: 96% of the frame
selected, seventeen believable traits, all describing the wall.
Nothing selected, or fill_size deleted the specimen (empty_mask,
fill_erased_mask) — PlantCV returns seventeen zeros with in_bounds=True.
Background texture (noisy_segmentation) — a sorghum photo (not distributed; the
tests use a synthetic stand-in) measured as one 650,000-px plant made of 118 chamber-wall
specks.
Several plants in one mask (multi_specimen) — the number describes the group; use
measure_regions(), which measures each plant and numbers the overlay.
Wrong scale, wrong kind, changed file — a marker measured 4.35× wrong by PlantCV's own
ROI method; a thermal session handed to an RGB measurer; an image edited after
segmentation. Each is refused naming the right tool.
A lens calibration the boards do not determine — a set whose focal length the fit
leaves undetermined is refused naming the number, and one that determines it only loosely
is accepted with the looseness said. That judgement is made per view, because the fit's
uncertainty falls as frames are added whether or not the geometry improves: re-saving the
same photographs, or shooting more of the same angle, buys nothing. A frame that fits far
worse than the rest, or that moves the answer far more than the others allow, is dropped
by name and the camera refitted.
No colour card when one was asked for — color_correct=true raises rather than
returning colour traits that look corrected and are not.
This server reads image files the host user can read and returns them to the model as
images; with no --root there is no allow-list. It writes:
the corrected image from correct_lens_distortion, next to its input (replacing an
earlier run's output of the same name) or at an output_path that must not exist yet —
under the same roots, never through a symlink;
the Segment Anything checkpoint (375 MB), only when segment_leaves_sam is called with
download_checkpoint=true, into $XDG_CACHE_HOME/plantcv-mcp (default
~/.cache/plantcv-mcp; PLANTCV_MCP_SAM_CACHE moves it), which must lie under a root
when roots are set;
short-lived private copies of hyperspectral (ENVI) and FLIR thermal inputs in the system
temporary directory, deleted once the file is decoded.
Run it as a user whose read
access you are comfortable exposing, set --root, and do not run it as root. PlantCV/OpenCV
analyses run in a worker subprocess, so a native crash is a tool error, not a dead server.
Details:
security · read roots ·
crash containment · limitations.
Attribution and licensing
This project is MIT licensed. It depends on
PlantCV, which is licensed under the
Mozilla Public License 2.0. No PlantCV source is vendored or redistributed
here — it is an ordinary runtime dependency — so the MIT license applies to this
project's own files. See NOTICE for the full statement.