1. Introduction
Corrugated board as a material commonly used in the packaging industry has many advantages in comparison to the other packing materials. One can notice its strength, lightweight, ease of customization, recyclable, and relatively low costs. It can effectively protect goods during their shipping, storage and handling.
In single-walled corrugated boards, its structure consists of one flute and two liners. The latter are often manufactured from kraft paper, a kind of paper that comes from wood pulp. It is known from its durability, strength and resistance to puncturing or tearing. These properties make it an ideal material for packaging applications, in particular for the outer layers like liners. The strength, cushioning or smooth surface of the corrugated board are related to the geometry of the internal layer, that is the flute, including its height. The formation of the fluted sheet in the corrugated board involves the paper being fed through a sequence of fluting rollers, resulting in the distinctive ridges and valleys. The higher flutes provide enhanced strength and cushioning, while the smaller flutes are more suitable for printing purpose due to the smoother surface of the resulting corrugated board. The most common flute types are:
A-flute: its approximated height is 5 mm. A-flute is commonly used for heavy goods packaging, i.e., furniture, due to its strength and cushioning properties.
B-flute: its approximated height is 3 mm. B-flute has quite universal properties. It is very often used for retail packing or shipping boxes.
C-flute: its approximated height is 4 mm. It is the most commonly used type of flute and has similar applications to B-flute.
E-flute: its approximated height is 1.6 mm. It offers a smooth surface, which is appropriate for printing purposes. This type of flute is commonly used for retail packaging and small boxes.
F-flute: its approximated height is 0.8 mm. It can be applied, similarly to E-flute, for small boxes and retail packing providing good printing properties due to smooth surface of the corrugated board.
The choice of flute type depends on its final specific application. However, it is possible to improve the corrugated board properties by applying the double-walled structure, e.g., to combine cushioning and printing quality or to increase their strength properties. Every kind of flute has particular advantages and is appropriate for certain packing purposes. Manufacturers have the ability to incorporate several flutes in order to produce customized corrugated boards that satisfy certain criteria for strength, cushioning, and printing properties. Double walls available on the market are often composed of BC (5–7 mm), EB (3.5–5 mm), or EC (4–5.5 mm) flutes.
Figure 1 presents these examples of flutes combinations in the double-walled corrugated board.
The corrugated board is susceptible to warping both during manufacture and subsequent stages, such as storage, transit, and usage, which may lead to deformation. The origins of these phenomena are attributed to fluctuations in temperature and humidity, as well as mechanical stress. There are two sorts of defects in the corrugated board: global imperfections and local imperfections. Beck and Ficherauer developed and explained a model that accounts for the organized, extensive bending of the cardboard [
3]. The writers of this paper mainly focused on local issues. In 1995, Nordstrand conducted a study to investigate how the magnitude of imperfections affects the compressive strength of boxes produced from the corrugated board [
4]. In 2004, the author studied local flaws by examining the nonlinear buckling of Rhodes and Harvey orthotropic plates [
5]. Lu et al. [
6] analyzed the mechanical characteristics of corrugated cardboards, explicitly focusing on the effects of imperfections during compression. Garbowski and Knitter-Piątkowska [
7] conducted a detailed analysis of the bending properties of double-walled corrugated cardboard. Mrówczyński et al. [
8] suggested a technique to analyze single-walled corrugated cardboard by including original flaws. Cillie and Coetzee conducted a study on corrugated cardboards that had both global and local defects and subjected them to in-plane compression [
9]. In a recent study, Mrówczyński and Garbowski introduced a straightforward approach to compute the effective stiffness of the corrugated board with geometric imperfections. This technique utilizes the finite element method and representative volumetric element [
10].
Image processing is rarely employed in the study of corrugated boards. Nevertheless, the most prevalent instance is to the development of an automated garbage sorting system. Liu et al. created a novel trash classification model using transfer learning and model fusion [
11]. Rahman et al. devised a system for categorizing recyclable waste paper based on template matching [
12]. A further use of the image processing approach involves calculating the number of layers in the corrugated board. Cebeci used conventional image processing techniques to automate the numbering of the corrugated board [
13]. In a similar manner, Suppitaksakul and Rattakorn used a machine vision system and image processing methods to quantify the number of corrugated boards accurately [
14]. Subsequently, Suppitaksakul and Suwannakit proposed an algorithm for merging corrugated board pictures [
15].
Classification of various materials and cross-section geometrical features evaluation based on images can be found in the literature. Caputo et al. used the support vector machine algorithm to categorize items by analyzing their photos under different lighting and positioning scenarios [
16]. Iqbal Hussain et al. used a convolutional neural network, namely the ResNet-50 architecture, to identify and categorize woven materials [
17]. Wyder and Lipson investigated the use of convolutional neural networks to identify the static and dynamic characteristics of cantilever beams using their unprocessed cross-section pictures [
18]. Li et al. used a range of deep learning methods to examine the geometric characteristics of a self-piercing riveting cross-section [
19]. The authors demonstrated that the SOLOv2 and U-Net topologies provide the most optimal outcomes. Ma et al. examined the geometric characteristics of crushed cross-sections of thin-walled tubes made of carbon fiber-reinforced polymer [
20].
The genetic algorithm is an optimization method that takes inspiration from the natural processes of selection and genetics [
21]. These algorithms use the concepts of evolution, including selection, crossover, and mutation. The fundamental concept behind genetic algorithms is to generate a group of individuals that reflect potential solutions to a considering issue. Each individual is represented by a collection of characteristics, referred to as chromosomes or genomes, that may be seen as the genetic material. These chromosomes undergo operations such as selection, crossover, and mutation, which mimic the genetic processes of reproduction and variation. John Henry Holland [
22] is renowned as the founding figure in the field of genetic algorithms, which have shown remarkable effectiveness across various domains including optimization, scheduling, and artificial intelligence. These algorithms are particularly adept at navigating complex, multidimensional search spaces where conventional optimization methods might struggle. In the realm of corrugated boards, genetic algorithms have found unique applications. Shoukat combined these algorithms with mixed integer linear programming to optimize cost and greenhouse gas emissions in papermaking [
23], while Hidetaka and Masakazu utilized them for scheduling in corrugated board production [
24].
This paper introduces a novel approach to ascertain the geometric features of corrugated board using a specialized acquisition device and an algorithm combining image processing with genetic algorithms, focusing on flute geometry. This methodology could lay the groundwork for automatically modeling corrugated board geometry from cross-sectional images. This research stands as a important contribution to the field, offering practical and innovative solutions for the packaging industry. By harnessing the power of genetic algorithms for geometric analysis, it opens new avenues for efficient and accurate corrugated board production, potentially revolutionizing current practices and sustainability in the corrugated packaging sector.2. Materials and Methods
2.1. Corrugated Board Cross-Section Images Acquisition
The images of the corrugated board cross-section have been acquired using the device engineered specifically for this purpose. Its precise description can be found in [
25]. Images depicting sample cross-sections were taken under uniform conditions, i.e., with controlled LED-sourced illumination and a camera axis perpendicular to the plane of the sample face.
Figure 2a presents a 3D model of the device, whereas
Figure 2b shows the mutual position of the camera and analyzed corrugated board sample. In the case of double-walled cardboard, placing the sample in the device holder is necessary to ensure that the higher flute is above the finer one. In the following study, as presented in
Figure 2c, the flute located above is referred to as
, and the one below is
.
The device utilizes ArduCam B0197 camera with Sony IMX179 (1/3.2”) image sensor with a resolution of 8 MPx. Acquired images were saved in JPEG format at a maximum resolution of 3264 × 2448 pixels.
2.2. Algorithm for Corrugated Board Geometrical Feature Identification
Figure 3 presents the flow diagram of the proposed algorithm. RGB image obtained from the device is first subjected to different preprocessing operations. Various versions of the input image are then utilized in order to identify several geometrical features of a 5-layer corrugated board sample, such as its height, flutes’ heights, periods and phase shifts, liners’ and flutes’ thickness. The algorithm has been implemented in Python using the
OpenCV and
geneticalgorithm libraries.
2.2.1. Image Preprocessing
The input of the system was a single frame from the camera. It was an RGB image with dimensions of 3264 × 2448 pixels. The first preprocessing operation is a grayscale conversion into range <0,255>. Next, an 800 × 800 pixels subset of a grayscale image is cut out of the central acquisition area.
Figure 4a presents the final image acquired as a result of described actions. In order to remove small noise from the image (caused by the presence of cellulose fibers), two blurring methods were applied: averaging with a normalized box filter and with a kernel size of 3 × 3 and bilateral filter.
Figure 4b presents the result of these operations. Finally, the blurred image was converted into a binary image (
Figure 4c) by applying lower threshold binarization with a threshold value equal to 75. All the parameters in the preprocessing stage were chosen empirically.
2.2.2. Corrugated Cardboard Thickness Estimation
The thickness of 5-layer corrugated cardboard can be estimated with the same method used for 3-layer samples that was presented in [
25]. The boundary points of outer liners can be identified by applying column-wise scanning of the binary image (
Figure 4c). Pixels in each column of the image are analyzed. The
y coordinate of the first white pixels in each column is saved to
ULEP matrix for scanning from the top of the image towards the bottom. Next, scanning is continued until the first black pixel is recognized. Its
y coordinate is written to
ULIP matrix. As a result, external points of the upper liner are written in the
ULEP matrix, whereas
ULIP contains upper liner internal points. Analogically, in order to determine lower liner boundary points, the direction of column-wise scanning is reversed, starting from the bottom of the image towards the top. In that way, new matrices
LLEP and
LLIP, which respectively store external and internal pixels of the lower liner, are created.
Figure 5 presents the result of this operation.
In order to determine the corrugated board sample height
, the average distance between external points of the upper and lower liner are calculated. It can be expressed as
where
denotes the column index, and
is the total number of columns.
For the purpose of further geometrical features identification, the external boundaries of both upper and lower liners are approximated using linear functions and coordinates from
ULEP and
LLEP matrixes. The resulting linear equations can be expressed as
where
and
denote the parameters of the upper liner approximation, while
and
are the parameters of the lower liner approximation.
2.2.3. Flutes Center Lines and Heights Estimations
At this stage, the corrugated cardboard flutes center lines and heights are estimated. The binary image row sum curve is plotted to find the localization of liners and flutings regions. Analyzing the number of white pixels in each row of the image, as presented in [
25], allows us to determine the approximate location in the image of the bottom and upper liner. The sample is placed horizontally, and curve local maximums are related to the presence of flat layers. Therefore, the occurrence of an additional liner in the middle of the sample should create one additional extremum visible on the curve. In the case of the 5-layered corrugated board sample, which consists of 3 liners and 2 flutes, 3 local maximums should always be detected at this stage. In order to smooth the row sum curve and highlight the maximum resulting from liners, the same version of the Savitzky–Golay filter with 30 interpolation points and a first-degree polynomial was applied. Furthermore, the distance between maximums has to be larger or equal to 20, and the minimal value of the local maximum was equal to 0.4 of the global maximum value.
Figure 6a depicts the original row sum and smoothed curves with 3 local maximums detected. It is also worth noting that the peak values can differ significantly for both the ideal and the creased samples. Their values mainly depend on the overall arrangement of layers and their thickness.
At this point, the row sum curve can be further analyzed. Based on local maximums, the curve is divided into 3 ranges. Each range corresponds to the area of one liner. Ranges borders (black bold dashed line) are determined as middle points between two adjacent local maximums marked as blue bold dots in
Figure 6a. In
Figure 6b, the bottom, middle, and upper liner ranges are marked in green, blue, and red, respectively. In each of these intervals, the subsequent actions are carried out:
The local maximum is identified.
The vertical line with an ordinate equal to the value of 0.9
(for bottom and upper liner regions, or 0.9
for middle liner region) is now plotted. Two intersection points of the curve and plotted line are determined and marked by bold dots visible in
Figure 6b.
The distance between intersection points within each range is calculated and denoted as , and for the upper, middle, and bottom liners, respectively.
For the 5-layer corrugated board samples, the center line and height estimations are calculated separately for each fluting. First, the middle liner approximate location in the image must be determined. Another column-wise scanning of the binary image (
Figure 4c) is carried out. Scanning is limited to the rows with coordinates
, where
and
are consecutive intersection points of the middle liner visible in
Figure 6b. The coordinates of the first white pixels in each column are written into the
MLUP matrix for scanning from the top to the bottom of the image and for reversed direction into
MLBP. A linear approximation of a line passing through the center of the area bounded by
MLUP and
MLBP pixels is performed. It can be expressed as:
where
and
denote the parameters of the middle liner approximation.
Figure 7 shows results of above operations.
Both flutings searching can be now limited based on the boundaries of the liners expressed in Equations (2), (3), and (4). The boundary lines limiting the
searching can be written in the following forms
whereas for limiting the
The boundary lines are depicted in Figure 8 in red and blue, while the center lines are presented in yellow. The center lines are approximated as central lines between two boundary lines, for each flute, respectively, and can be expressed as:
where
,
are the parameters of the center lines.
The heights of the flutes can be approximated using the following formulas
It is worth noting, that flutes height is equal to two times the amplitude of the sinusoidal function.
Figure 8.
The binary image with boundary lines for limiting the searching areas for (blue lines) and (red lines), and the central lines (yellow lines).
Figure 8.
The binary image with boundary lines for limiting the searching areas for (blue lines) and (red lines), and the central lines (yellow lines).
2.2.4. Flute Period Searching Range
Next, the binary image is skeletonized. The result of this operation is presented in
Figure 9a. The presence of protruding fibers in the cross-section of the sample can cause some disturbances in the form of side branches in the skeleton. A custom filtering function is applied to the skeletonized image to filter out the unwanted offshoots. As a result, all side branches with contour lengths less than 50 pixels are removed, see Figure 8b.
The limitation of period searching is necessary for genetic algorithm to provide credible solutions. Values and (the range of the period searching in pixels for -th fluting) are based on calculating the distances between the intersection points of the skeleton contours, with 3 lines parallel to the flutings center line, drawn through the flute area, see Figure 8c. The average distance between successive intersection points and the maximum distance is determined for each fluting. The values , and are taken, where is the average distance between the intersection points for the 3 parallel lines, and denotes the maximal value of the distances between these intersection points for -th fluting. In case of too many disturbances, e.g., due to the presence of long side branches or critical deformation of the sample, the default values , are set.
Figure 8.
(a) Results of the skeletonization process; (b) results after skeletonization process and removing side branches; (c) three parallel green lines for each fluting period limitations.
Figure 8.
(a) Results of the skeletonization process; (b) results after skeletonization process and removing side branches; (c) three parallel green lines for each fluting period limitations.
2.2.5. Application of the Genetic Algorithm for Flutes Parameters Approximation
Genetic algorithm implemented in [
25] enabled the authors to determine sinusoidal function parameters, such as period and phase shift, to asses fluting layer geometrical features. In the case of double-wall corrugated board samples, the genetic algorithm ought to be used for each flute independently.
In the searching process for the parameters of flutes, the following formulas for its approximation were taken into account:
where the parameters
,
, and amplitude
are fluting parameters determined in the previous stages of the proposed algorithm. The solution from the genetic algorithm is a set of two values: phase shift
and the period
, where
i denotes the fluting index (
). Two separate genetic algorithm runs provided an independent set of parameters for each fluting.
In each run, the genetic algorithm takes the eroded version of the binary image as an input, as shown in
Figure 9a. The main reason for utilizing erosion is to narrow down the flute region, so that the sine function approximation is more precise. The phase shift
and period
search is limited by
,
,
, and
, where
i denotes the fluting index. The objective function is defined as a total sum of the common pixels for the eroded image and function expressed in Equation (7) or (8) (depending on the analyzed flute) for the given
and
.
Applying the genetic algorithm, the following parameters were utilized:
Maximal number of iterations: 500;
Population size: 100;
Mutation probability: 0.15;
Elite group ratio: 0.01;
Crossover probability: 0.2;
Parents portion: 0.2;
Crossover type: uniform.
An example of the genetic algorithm result is presented in
Figure 9b.
Figure 9.
(a) The eroded image; (b) an example of the result obtained after the optimization processes using the genetic algorithm (red lines).
Figure 9.
(a) The eroded image; (b) an example of the result obtained after the optimization processes using the genetic algorithm (red lines).
2.2.6. Estimation of the Corrugated Cardboard Layers Thicknesses
Figure 10 depicts a graphic representation of the idea for measuring the thickness of paper layers. The approximate location of flutes in the image is determined based on the sinusoidal function approximations performed in the previous stages of the algorithm. It provides enough information to choose the regions for layers thickness measurement. Areas around layer bonding points are more distorted and have usually higher number of disturbances such as protruding fibers. The area of the upper liner, where the thickness can be measured, is marked in blue. A similar region for the middle and bottom liner is marked in orange and turquoise, respectively. The pink and green colors indicate the areas in which the thickness of the flutings is determined.
Figure 11 shows an example of the result.