Perception for living systems

AI systems from the physical world.

During my PhD, I built robotic and computer-vision systems to solve problems in real agricultural fields.

01 · Autonomous UAV sensing

A flight stack built for the places GPS cannot reach.

  1. From sim to real

  2. Autonomous mission execution

  3. Turning a mission into a 3D scene

Real world ↔ Gazebo · one autonomy stack
Onboard views · estimated trajectory
UAV | SfM | 3DGS · one camera path

02 · 3D plant phenotyping

From an autonomous flight to organ-level growth curves.

  1. Individual plant extraction and reconstruction

    precision 0.933 · mIoU 0.890

  2. 3D organ segmentation

    PTv3 point clouds · mean AP50 0.924

  3. Across-days monitoring

    198 plant-days · logistic R² 0.998

Row B · plant 01 · 3DGS · DAT 24

03 · High-resolution pest sensing

An imaging system that makes pest management measurable.

  1. Image analysis for sub-millimetre pests

    targets under 1 mm · scanners that vary from user to user

  2. A recognition system built to keep iterating

    built with cross-domain experts · simple enough to run on site

A sticky-trap scan zoomed down to a one-millimetre insect, and a schematic of the same insect as two different scanners deliver it before it is normalised to one scale

real scan above · schematic below

04 · Cattle edge intelligence

From a tracked face to an individual behavior record.

  1. Cattle identity at the edge

    tracked ROI · 512-D face embedding · temporal identity vote

  2. Field system architecture

    multi-camera + IoT · local inference · event-only telemetry

tracked ROI → 512-D embedding → identity match

At a glance

Research depth, product habits.

Ongoing projects

  • Individual-level temporal phenotyping of greenhouse vine cropsmanuscript in preparation
  • Video-to-3DGS reconstruction toolframes → SfM → Gaussian Splatting, CLI + GUI
  • Shared visual canvas for coding agentsthink through a project on one board with an agent

Field deployments

  • Greenhouse muskmelon, NTU experimental farmautonomous UAV + 3DGS phenotyping, multi-season, 198 plant-days
  • Pest imagingscanner-based sticky-trap pipeline, built to run on site
  • Cattle barnmulti-camera edge system, video never leaves the site

Stack

3DGS · COLMAP · SAM3 · PyTorch · Point Transformer · ROS2 · PX4 · FastAPI · PyQt · Docker

Education

PhD, Bio-Industrial Mechatronics Engineering, National Taiwan University (2026). Advisor: Ta-Te Lin. Research spanned autonomous UAV sensing, visual SLAM, and 3D plant phenotyping from Gaussian Splatting reconstructions, taken from simulation to working greenhouse deployments.