Segmentation and size estimation of tomatoes from sequences of paired images

Ujjwal Verma, Florence Rossant, Isabelle Bloch

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

In this paper, we present a complete system to monitor the growth of tomatoes from images acquired in open fields. This is a challenging task because of the severe occlusion and poor contrast in the images. We approximate the tomatoes by spheres in the 3D space, hence by ellipses in the image space. The tomatoes are first identified in the images using a segmentation procedure. Then, the size of the tomatoes is measured from the obtained segmentation and camera parameters. The shape information combined with temporal information, given the limited evolution from an image to the next one, is used throughout the system to increase the robustness with respect to occlusion and poor contrast. The segmentation procedure presented in this paper is an extension of our previous work based on active contours. Here, we present a method to update the position of the tomato by comparing the SIFT descriptors computed at predetermined points in two consecutive images. This leads to a very accurate estimation of the tomato position, from which the entire segmentation procedure benefits. The average error between the automatic and manual segmentations is around 4 % (expressed as the percentage of tomato size) with a good robustness with respect to occlusion (up to 50 %). The size estimation procedure was evaluated by calculating the size of tomatoes under a controlled environment. In this case, the mean percentage error between the actual radius and the estimated size is around 2.35 % with a standard deviation of 1.83 % and is less than 5 % in most (91 %) cases. The complete system was also applied to estimate the size of tomatoes cultivated in open fields.

Original languageEnglish
Article number33
Pages (from-to)1-23
Number of pages23
JournalEurasip Journal on Image and Video Processing
Volume2015
Issue number1
DOIs
Publication statusPublished - 01-12-2015

Fingerprint

Cameras

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Information Systems
  • Electrical and Electronic Engineering

Cite this

Verma, Ujjwal ; Rossant, Florence ; Bloch, Isabelle. / Segmentation and size estimation of tomatoes from sequences of paired images. In: Eurasip Journal on Image and Video Processing. 2015 ; Vol. 2015, No. 1. pp. 1-23.
@article{70d4db383028410b9a1210e00a4f55e4,
title = "Segmentation and size estimation of tomatoes from sequences of paired images",
abstract = "In this paper, we present a complete system to monitor the growth of tomatoes from images acquired in open fields. This is a challenging task because of the severe occlusion and poor contrast in the images. We approximate the tomatoes by spheres in the 3D space, hence by ellipses in the image space. The tomatoes are first identified in the images using a segmentation procedure. Then, the size of the tomatoes is measured from the obtained segmentation and camera parameters. The shape information combined with temporal information, given the limited evolution from an image to the next one, is used throughout the system to increase the robustness with respect to occlusion and poor contrast. The segmentation procedure presented in this paper is an extension of our previous work based on active contours. Here, we present a method to update the position of the tomato by comparing the SIFT descriptors computed at predetermined points in two consecutive images. This leads to a very accurate estimation of the tomato position, from which the entire segmentation procedure benefits. The average error between the automatic and manual segmentations is around 4 {\%} (expressed as the percentage of tomato size) with a good robustness with respect to occlusion (up to 50 {\%}). The size estimation procedure was evaluated by calculating the size of tomatoes under a controlled environment. In this case, the mean percentage error between the actual radius and the estimated size is around 2.35 {\%} with a standard deviation of 1.83 {\%} and is less than 5 {\%} in most (91 {\%}) cases. The complete system was also applied to estimate the size of tomatoes cultivated in open fields.",
author = "Ujjwal Verma and Florence Rossant and Isabelle Bloch",
year = "2015",
month = "12",
day = "1",
doi = "10.1186/s13640-015-0087-0",
language = "English",
volume = "2015",
pages = "1--23",
journal = "Eurasip Journal on Image and Video Processing",
issn = "1687-5176",
publisher = "Springer Publishing Company",
number = "1",

}

Segmentation and size estimation of tomatoes from sequences of paired images. / Verma, Ujjwal; Rossant, Florence; Bloch, Isabelle.

In: Eurasip Journal on Image and Video Processing, Vol. 2015, No. 1, 33, 01.12.2015, p. 1-23.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Segmentation and size estimation of tomatoes from sequences of paired images

AU - Verma, Ujjwal

AU - Rossant, Florence

AU - Bloch, Isabelle

PY - 2015/12/1

Y1 - 2015/12/1

N2 - In this paper, we present a complete system to monitor the growth of tomatoes from images acquired in open fields. This is a challenging task because of the severe occlusion and poor contrast in the images. We approximate the tomatoes by spheres in the 3D space, hence by ellipses in the image space. The tomatoes are first identified in the images using a segmentation procedure. Then, the size of the tomatoes is measured from the obtained segmentation and camera parameters. The shape information combined with temporal information, given the limited evolution from an image to the next one, is used throughout the system to increase the robustness with respect to occlusion and poor contrast. The segmentation procedure presented in this paper is an extension of our previous work based on active contours. Here, we present a method to update the position of the tomato by comparing the SIFT descriptors computed at predetermined points in two consecutive images. This leads to a very accurate estimation of the tomato position, from which the entire segmentation procedure benefits. The average error between the automatic and manual segmentations is around 4 % (expressed as the percentage of tomato size) with a good robustness with respect to occlusion (up to 50 %). The size estimation procedure was evaluated by calculating the size of tomatoes under a controlled environment. In this case, the mean percentage error between the actual radius and the estimated size is around 2.35 % with a standard deviation of 1.83 % and is less than 5 % in most (91 %) cases. The complete system was also applied to estimate the size of tomatoes cultivated in open fields.

AB - In this paper, we present a complete system to monitor the growth of tomatoes from images acquired in open fields. This is a challenging task because of the severe occlusion and poor contrast in the images. We approximate the tomatoes by spheres in the 3D space, hence by ellipses in the image space. The tomatoes are first identified in the images using a segmentation procedure. Then, the size of the tomatoes is measured from the obtained segmentation and camera parameters. The shape information combined with temporal information, given the limited evolution from an image to the next one, is used throughout the system to increase the robustness with respect to occlusion and poor contrast. The segmentation procedure presented in this paper is an extension of our previous work based on active contours. Here, we present a method to update the position of the tomato by comparing the SIFT descriptors computed at predetermined points in two consecutive images. This leads to a very accurate estimation of the tomato position, from which the entire segmentation procedure benefits. The average error between the automatic and manual segmentations is around 4 % (expressed as the percentage of tomato size) with a good robustness with respect to occlusion (up to 50 %). The size estimation procedure was evaluated by calculating the size of tomatoes under a controlled environment. In this case, the mean percentage error between the actual radius and the estimated size is around 2.35 % with a standard deviation of 1.83 % and is less than 5 % in most (91 %) cases. The complete system was also applied to estimate the size of tomatoes cultivated in open fields.

UR - http://www.scopus.com/inward/record.url?scp=84946147079&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84946147079&partnerID=8YFLogxK

U2 - 10.1186/s13640-015-0087-0

DO - 10.1186/s13640-015-0087-0

M3 - Article

VL - 2015

SP - 1

EP - 23

JO - Eurasip Journal on Image and Video Processing

JF - Eurasip Journal on Image and Video Processing

SN - 1687-5176

IS - 1

M1 - 33

ER -