Deep learning-enabled hybrid systems for accurate recognition of text in seal images

TL;DR

This paper presents a hybrid system using deep learning to accurately recognize text on Chinese seals, which are often challenging due to noise and minimal image features.

Contribution

The novel contribution is a hybrid model combining preprocessing, deep learning, and text unwrapping techniques for improved Chinese seal text recognition.

Findings

A color-based method effectively removes background text on seals.

A deep learning-based angle prediction network improves seal image positioning.

Polar coordinate transformation enhances text recognition accuracy.

Abstract

Chinese seals are widely used in various fields within Chinese society as a tool for certifying legal documents. However, recognizing text on these seals presents challenges due to background text, high noise levels, and minimalistic image features. This paper introduces a hybrid model to address these difficulties in Chinese seal text recognition. Our model integrates preprocessing techniques tailored for real seals, a deep learning-based position correction model, a circular text unwrapping model, and OCR text recognition. First, we apply a color-based method to effectively remove the black background text on seals, eliminating redundant information while retaining crucial features for further analysis. Next, we introduce an innovative image denoising algorithm to significantly improve the system's robustness in processing noisy seal images. Additionally, we develop a deep learning-based angle prediction network and create synthetic datasets that mimic real seal scenes, enabling optimal seal image positioning for enhanced text flattening and recognition, thus boosting overall system performance. Finally, polar coordinate transformation is employed to convert the circular seal into a rectangular image for more efficient text recognition. Experimental results indicate that our proposed methods effectively enhance the accuracy of seal text recognition.

Figures

True image of the seal with background interference.

Comparison of threshold segmentation of HSV base color components.

Manual threshold assignmen results.

The flowchart of the framework.

RGB color model seal segmentation effect.

The visualization denoising results of FISTA and our algorithm.

Seal image placed completely vertically (left-hand side); a rectangular image obtained from the seal image after greyscaling (right-hand side).

Seal image placed at an angle (left-hand side); a rectangular image obtained from the seal image after greyscaling (right-hand side).

The example images of the synthesis of seal images, (a–d) represent the texture image, the generated base seal image, the rotated image, and the image with added texture and noise, respectively.

The histogram of the absolute error between the predicted angle values and the label on authentic dataset.

Tables

Table 1. HSV fundamental color component.

	Black	Gray	White	Red		Orange	Yellow	Green	Cyan	Blue	Purple
Hue min	0	0	0	0	156	11	26	35	78	100	125
Hue max	180	180	180	10	180	25	34	77	99	124	155
Saturation min	0	0	0	43		43	43	43	43	43	43
Saturation max	255	43	30	255		255	255	255	255	255	255
Value min	0	46	221	46		46	46	46	46	46	46
Value max	46	220	255	255		255	255	255	255	255	255

Table 2. Partial color RGB component values.

	R	G	B		R	G	B		R	G	B
	0	0	0		255	0	0		250	128	114
	41	36	33		178	34	34		255	99	71
	192	192	192		227	23	13		255	69	0
	128	138	135		176	23	13

Table 3. Angle prediction performance.

Datasets	No. of test images	MAE	Variance
Synthetic	780	1.60	3.11
Authentic	50	6.44	30.80

Table 4. Image deblurring with noise, numerical experimental simulation results.

	tol=10-3			tol=10-5			tol=10-7
	It.	RME	Time	It.	RME	Time	It.	RME	Time
Fista	223	0.0412	4.5	876	0.0052	15.63	3306	0.0007	53.92
OURS	70	0.0218	0.79	166	0.0041	2.16	529	0.0003	6.93

Table 5. Text recognition accuracy.

Metrics	Values (%)
Accuracy1	96.66
Accuracy2	95.54

Table 6. Ablation study of text recognition accuracy. “-” indicates that valid result can not be measured.

Methods	Accuracy1(%)	Accuracy2(%)
w/o Rotation	94.53	93.12
w/o Denoising	-	-
Ours	96.66	95.54

Equations

Full text

Introduction

1

In the social and economic life of Eastern countries, exemplified by China, seals play a crucial role, whether in official documents or contract agreements (Gao et al., 1995). The authenticity of the seal determines the validity of contract documents, thus it is important to identify the authenticity of the seal (Roy et al., 2009; Cui et al., 2024). Recent advances in seal recognition have emphasized the need for fine-grained feature extraction to distinguish genuine from forged seals, leveraging deep learning to model unique stroke characteristics of Chinese seals (Cui et al., 2024). In various sectors such as government departments, educational institutions, banks, and enterprises, there is a constant influx of documents for verification purposes (Ueda and Matsuo, 2005). For example, proof of poverty, proof of business license, and so on. Among them, by the influence of interests, it is inevitable that the parties provide false certificates with forged seals, which brings great security risks to the various units and other businesses (Bentotahewa et al., 2021). Currently, the verification of the authenticity of official seals by enterprises and institutions relies on manual review, which is a process that consumes considerable manpower and time. Given the above business background, it is necessary to design a model that accurately and automatically identifies the text of the seal and verifies its authenticity. The proposed model aims to address the practical challenges of efficiency and accuracy in the verification process. It's worth pointing out that, seals in real-life scenarios are often not ideal, often containing a lot of noise and interfering text, which makes detection more difficult, as shown in Figure 1. To improve the clarity and readability of seals, making them easier to recognize and understand, de-bottoming (Cheng, 2006), denoising, and text recognition techniques are widely adopted (Lou and Li, 2020; Rageau et al., 2025; Song et al., 2025). Notably, recent works have extended seal text recognition to cross-cultural scenarios and low-resource settings, while advanced denoising methods have focused on preserving fine character details critical for OCR accuracy (Rageau et al., 2025; Song et al., 2025).

De-bottoming: It can separate the seal from the background and eliminate distractions such as background colors, textures, or watermarks, making the seal more prominent and easier to see and identify.Denoising: It can improve the image quality degraded by noise during generation, storage, and transmission. Thus optimizing the subsequent processing of images.Text-recognition: It can extract information (e.g., words, logos, or patterns) from the seal image and convert it into editable text form. The text on the seal can be further processed, stored, searched, or analyzed, thus improving the usability of the seal images.

True image of the seal with background interference.

In summary, the quality and usability of seals can be improved by denoising, interfering-text and text recognition processing of seals, which is of great significance in the fields of digital document management, legal documents, commercial contracts, and identity verification, where accurate and clear seal images are required to ensure the legality and trustworthiness of documents. (Liao et al., 2024) Numerous related works have been proposed over the past few decades. However, they still have some limitations.

In terms of de-bottoming, the seal segmentation technique based on the color space model is the current mainstream method (Ueda, 1995). It can be subdivided into HSV model method and RGB model method according to different color space models (Mushtaq et al., 2023). HSV is a color space model close to the human eye's subjective perception and consists of three components: Hue, Saturation, and Value (Sural et al., 2002). Different base colors have a strict range of components in HSV space, and Table 1 shows the specific HSV base color component values. According to the HSV component values given in Table 1, two base colors, black and red, are mainly considered. The seal image after setting the threshold value to apply the HSV color model-based seal segmentation technique is shown in Figure 2. We can see that the effect of threshold segmentation based on the HSV base color component is not satisfactory. For this reason, the design incorporates sliders to manually find the HSV threshold component suitable for the above scenario. The effect is shown in Figure 3. Obviously, as can be seen from the effect diagram, the disadvantage of the HSV color space-based threshold segmentation method is the high number of components and the poor generalization ability using a fixed threshold (Ning et al., 2025).

Comparison of threshold segmentation of HSV base color components.

Manual threshold assignmen results.

In terms of denoising, we focus on the total variation method (Rudin et al., 1992; Afraites et al., 2022). Specifically, Rudin-Osher and Fatemi introduced the total variation model in Rudin et al. (1992) as a regularization method to accurately process edges and eliminate noise from an image. Due to the large-scale nature of images, no matter which type of algorithm is used, it will face the problem of long running time. Therefore the establishment of fast and simple numerical methods is of great research importance. Of course, some other denoising algorithms have also been proposed, such as diffusion equations methods (Perona and Malik, 1990; Wen et al., 2022), wavelet transforms (Shen et al., 2017), deep learning methods (Liu et al., 2020), and so on. But they are beyond the scope of our work.

In terms of text recognition technology, they mainly presented based on deep learning framework. Technically, deep learning typically requires large-scale annotated datasets for training. But, using pre-trained models on large datasets like ImageNet (Deng et al., 2009) and transferring them directly to seal recognition may not yield satisfactory results. Because seal images often only consist of arranged text, while natural images typically only contain meaningful real scenes or objects. Unfortunately, real seal images are often not publicly shared due to confidentiality and security concerns, making it difficult to construct a large-scale dataset of seal images. Therefore, extracting features from real seal images using deep learning poses certain challenges due to the lack of publicly available datasets and the content differences between seal images and natural images.

In this paper, we propose a new hybrid model for Chinese seal text recognition, which mainly contains preprocessing of real seals, a position correction model based on deep learning, a ring text unfolding model, and OCR text recognition (Sabitha and Sundar, 2025). Specifically, we design a segmentation method for background text based on RGB color space due to the poor performance of HSV in the mainstream methods in seal scenes. Besides, we propose a new accelerated algorithm for image denoising inspired by FISTA (Beck and Teboulle, 2009a), which is a fast iterative shrinkage/thresholding algorithm with remarkable simplicity and proven global convergence speed. The proposed algorithm is sufficiently general to encompass other types of non-smooth regularizers. Furthermore, we choose to generate synthetic seal image datasets due to the lack of publicly available seal image datasets (Giannoulakis et al., 2023).

To sum up, the main contributions of this paper are given as follows:

We propose a color space-based black text background removal method for seals. It helps to remove redundant information and retain its key feature information.We propose a new image-denoising algorithm that significantly enhances the robustness of the subsequent detection task.We design a deep learning-based angle prediction network and construct synthetic datasets to simulate real seal scenes. The seal image can be made in a positive position for better text flattening and recognition.

Organization: Section 2 introduces related advances in image denoising, traditional seal recognition and deep learning-based seal recognition. Section 3 designs the hybrid model for Chinese seal text recognition. Section 4 presents experimental details, performance evaluation and ablation experiments. Section 5 summarizes the strengths of the hybrid model, its potential for seal identification and document verification, as well as final remarks and future work.

Notation: Throughout the paper, $[eqn]$ is a vector stacked from the two-dimensional original image X∈ℝ^N^, N = n×n. Similarily, the vector $[eqn]$ is stacked from the observed image Y∈ℝ^N^, and the vector $[eqn]$ is stacked from the background additive noise B∈ℝ^N^. A∈ℝ^N×N^ is a given matrix modeling the blur effect. The symbol λ is a regularization coefficient. The symbol $[eqn]$ is the l1-norm of x. ||x|| denotes the standard Euclidean norm for x, $[eqn]$ indicates the D-norm, where D is a symmetric positive definite matrix. ∇f(x) is the gradient of the continuous function f at x, and ∂g(x) is the subdifferential of the semicontinuous function g at x.

Related works

2

Image denoising

2.1

In this section, we review the development of Total Variation (TV) regularization and Fast Iterative Shrinkage-Thresholding Algorithm (FISTA) in advanced image denoising methodologies.

Evolution of TV regularization in image denoising

2.1.1

In the field of image denoising, TV regularization has evolved into a fundamental pillar, adept at achieving an optimal equilibrium between mitigating noise and preserving essential structural features. Rudin et al. (1992) introduced seminal nonlinear total variation-based algorithms, emphasizing the importance of minimizing total variation for efficient noise removal while preserving significant edges. Chambolle (2004) extended this work by proposing an algorithm explicitly designed for total variation minimization, addressing computational challenges, and expanding the scope of TV denoising. Chan and Esedoglu (2005) enriched the understanding of total variation regularization by exploring aspects related to L1 function approximation. Yuan and Wang (2006) investigated image restoration through total variation and wavelet regularization. Nikolova and Chan (2006) explored algorithms for finding global minimizers of image segmentation and denoising models. Lanza et al. (2006) presented a primal-dual optimization approach for image sequence estimation in the presence of noise. Additionally, Sidky and Pan (2008) focused on image reconstruction in circular cone-beam computed tomography through constrained, total-variation minimization.

FISTA advancements in image denoising

2.1.2

Those works collectively establish a robust foundation, offering a comprehensive framework for comprehending both TV regularization and FISTA within the realm of image denoising. Beck and Teboulle (2009b) introduced FISTA as a fast iterative algorithm for solving linear inverse problems, highlighting its rapid convergence rate. Fadili and Starck (2009) extended the application of FISTA to sparse representations and Bayesian image reconstruction, showcasing its versatility in various signal processing tasks. The algorithmic advancements introduced by FISTA, particularly its efficient convergence, have positioned it as a valuable tool in the broader landscape of optimization and signal processing.

Traditional seal recognition methods

2.2

These works primarily rely on knowledge-driven and traditional feature extraction methods to construct seal recognition approaches. Fan and Tsai (1984) employed the Attributed Stroke Graph (ASG) algorithm to match characters through stroke skeleton matching. It was only applicable to square-shaped seals. Chen and Tsai (1986) proposed to utilize the Hough transform to obtain alignment information for seals. UEDA (1994) proposed a statistical decision-making method for template matching using local and global features of images. Chen (1995) explored the use of Hough transform to optimize the extraction of seal geometric features. Chang et al. (1999) conducted seal detection by utilizing a point matching algorithm. Liu et al. (2007) proposed utilizing the shape features of seal images for retrieval. Wang and Chen (2009) proposed a seal recognition method based on seal shape and internal structural features. They also proposed an anti-counterfeiting detection algorithm to identify forged regions within the images. Bao et al. (2009) used a method based on the RGB color model to locate the seal, which is mainly based on the seal color of red, through the layer separation method to determine the location of the seal. Su (2007) proposed a seal detection method based on the distance between the seal boundary and the center of mass as well as the gray level of the boundary, which detects the seal by its own characteristics. Runwu et al. (2007) extracted the seal imprint features using a double density binary tree wavelet transform. Liang et al. (2012) utilized a circular stamp alignment method that converts circular areas to rectangular areas for identification, but this method has a relatively high error rate for cases where there is a lot of imprint noise. Zhu et al. (2013) proposed a seal recognition method that combines stroke features and geometric features. Ren and Chen (2012) proposed a method for seal font recognition, which involves extracting fonts through polar coordinate transformation and then recognizing the characters. This approach has improved the accuracy of text recognition to a certain extent. Liang et al. (2014) unfolded the seal into a rectangle and performed rectangle projection. They utilized the obtained projection matrix to register the seal and ultimately discriminated between seals based on the average relative error between them.

Deep learning-based seal recognition methods

2.3

Benefiting from large datasets, sufficiently large model capacity, and powerful representational abilities, deep learning has achieved great success in various fields, such as text recognition (Chen et al., 2021), image classification (Rawat and Wang, 2017), object detection (Zou et al., 2023), and image segmentation (Minaee et al., 2021). Due to the lack of publicly available datasets, there are currently limited deep learning-based methods for seal recognition. The existing deep learning-based researches mainly focus on seal text recognition and seal detection. Seal text detection and recognition draw inspiration from related methods in scene text recognition. The Connectionist Text Proposal Network (CTPN) (Tian et al., 2016) is a commonly used network for text detection, which lays the foundation for text detection algorithms. The SegLink algorithm (Shi et al., 2017) segments each character into finer text blocks for easier detection, and then connects these small text blocks to form words, facilitating the recognition of words and text lines with significant length variations and orientations. Zhou et al. (2017) proposed an efficient and accurate scene text detection algorithm called EAST (Efficient and Accurate Scene Text), which employs fully convolutional networks to generate multi-scale fused feature maps. The temporal classification mechanism and the attention mechanism are widely used in the field of text recognition. The connectionist temporal classification (CTC) algorithm (Shi et al., 2016) uses the bi-directional long and short-term memory networks (Staudemeyer and Morris, 2019) for feature extraction of character images and the CTC loss function for encoding and de-redundancy of the feature map. The text recognition method based on the attention mechanism (Vaswani et al., 2017) utilizes intermediate vectors to complete the encoding and decoding output of text, which can improve detection efficiency and effectiveness. Zhang et al. (2021) adopted a relief character detection algorithm based on YOLOv5, effectively improving the model's detection accuracy and reducing the detection time. Miao et al. (2022) enhanced the feature extraction capability of the model and further improved its detection accuracy by embedding attention module into the YOLOv5 algorithm. Notably, recent works have advanced deep learning applications in seal-specific recognition tasks with remarkable innovations. Cui et al. (2024) proposed a deep neural network integrated with characteristic analysis for seal stroke recognition, which meticulously models the structural uniqueness of seal strokes and achieves state-of-the-art performance in fine-grained stroke extraction. This work significantly enriches the technical paradigm of leveraging domain-specific features to guide deep network learning, providing valuable insights for handling subtle stroke variations in Chinese seals. Another notable contribution is the research by Rageau et al. (2025) on character recognition in Byzantine seals using deep neural networks, which demonstrates the strong generalization of deep learning frameworks across different cultural and stylistic seal systems. The work not only expands the application scope of seal character recognition but also offers practical strategies for addressing low-resource and cross-domain seal recognition challenges. The challenge of the unavailability of annotated datasets exists in other domains as well. As a result, there has been a recent surge of interest in learning high-level representations through unsupervised methods, which eliminates the need for manual annotation of visual data. Larsson et al. (2016) trained ConvNets to colorize grayscale images. Doersch et al. (2015) predicted the relative position of image patches. Gidaris et al. (2018) built a self-supervised classification network for predicting image rotations.

Method

3

The proposed method includes a background removal module, denoising module,angle rotation module, image flattening, and OCR recognition. These modules work together to the input real-world seal images to achieve accurate text recognition. The overall framework of the proposed method is illustrated in Figure 4. We will proceed to describe the details of each module in this section.

The flowchart of the framework.

RGB model segmentation method

3.1

To improve the accuracy of recognition and the effectiveness of features, the seals are preprocessed to maximally weaken the interference factors and create ideal conditions for subsequent operations. The reason is the complex background often causes serious interference to the recognition results and the extracted features.

Seal preprocessing is mainly about the segmentation of seals, and choosing the appropriate segmentation method is extremely important in seal recognition systems. The existing segmentation techniques are mainly based on the difference values between different regions in the image, including but not limited to the feature differences between color, greyscale, and texture. Typically, seals tend to be stamped on black text. At the same time, since the seal clay is mostly presented as a red tone, there is a large contrast with the background color. Therefore, the seal segmentation technique based on the color space model is the current mainstream method. Given the poor performance of HSV in the mainstream methods in seal scenes, we designed a segmentation method for background text based on RGB color space.

Based on the RGB color model segmentation seal technique, the main use of their background colors is different, and the triple base color difference is used to remove the stray background. Upon analysis, it is found that most of the subjective color elements of the seal scene are only red and black, and most of the red elements have very different RGB first two-channel differences from the black elements.

As shown in Table 2, the difference between the R and G channels for the red elements is large, with about 100 gray levels or more. The black elements are within 10 gray levels. The principle is shown in Equations 1, 2:

$$[eqn]$$ $$[eqn]$$

where R(x, y) denotes the red component and G(x, y) denotes the green component. T denotes the corresponding threshold value. The seal segmentation technique used in this paper is based on the RGB color model and is implemented as follows:

First, the entire RGB color image is traversed and the value of |R(x, y)−G(x, y)| is calculated.Second, the target pixels are filtered by setting Tblack = 10 and Tred = 100 to take out the red elements.Third, the pixels that satisfy (Equation 1) are reassigned as white, and the pixels that satisfy (Equation 2) are reassigned as red.

The effect of applying RGB based color model for seal segmentation is shown in Figure 5.

RGB color model seal segmentation effect.

Seal image denoising

3.2

In this section, we elucidate the deblurring algorithm employed. Before launching into the details, it's paramount to understand some essential notations necessary for describing the algorithm. The symbol ∥·∥ symbolizes the norm brought about by the inner product < ·, ·>, operating on $[eqn]$ . Linear, bounded, and self-adjoint operators from $[eqn]$ to $[eqn]$ form the set $[eqn]$ . Within $[eqn]$ , a partial ordering relation is adhered to, with D1≽D2⇔ < D1x, x>≥ < D2x, x> for $[eqn]$ and $[eqn]$ . Given any η∈ℝ and η>0, the set $[eqn]$ is comprised of all operators $[eqn]$ such that $[eqn]$ . The symbol ∥·∥D signifies the norm induced by the vectors with an operator, i.e., $[eqn]$ with $[eqn]$ . As a result, given any $[eqn]$ , it holds $[eqn]$ for $[eqn]$ .

Here, we employ the refined inertial forward-backward technique (Bonettini et al., 2016) designed for deblurring seal images, with its particulars encompassed in Algorithm 1. At the heart of Algorithm 1 is the notion hinged on a consistently adapting metric with each iteration, combined with an appropriate extrapolation phase. Departing from conventional forward-backward methods incorporating extrapolation, Algorithm 1 is capable of managing functions where the domain does not span the entire space.

Algorithm 1Adaptive inertial forward-backward algorithm with dynamic backtracking.

The algorithm consists of variable metric with forward-backward iterations (line 6) combined with an extrapolation-projection step (line 3) The step size μ_k_ is dynamically determined through a backtracking process. It is worth noting that the choice of the extrapolation parameter ρ_k_ and the scaling operator Dk require thoughtful selection. Specifically, ρ_k_ takes the form ρ_k_ = θ_k(1−θk−1_)/θ_k−1_ with ρ_0_ = 0 and θ_k∈(0, 1] for k≥0. For the scaling operator $[eqn]$ , it holds Dk+1_≼(1+η_k)Dk_ for ∀k≥0, with η_k∈ℝ+_ satisfying $[eqn]$ , and sup_k∈ℕ_∥Dk∥ = γ < ∞.

Algorithm 1 can be treated as an extension of the fast iterative shrinkage thresholding algorithm (FISTA) (Beck and Teboulle, 2009b). Algorithm 1 accelerates even further on FISTA and reduces the time complexity. The distinctive aspects between FISTA and Algorithm 1 include the capacity to utilize at each iteration the variable metric formed by the operator Dk and the projection of the extrapolated point $[eqn]$ . This arrangement allows for the management of issues when dom(f)⊇Y does not align with the entirety of space $[eqn]$ . Notably, FISTA is reconstituted by setting $[eqn]$ for all k≥0 when Y = ℝ^n^.

As shown in Figure 6, we perform visual validation of denoising performance by adding Poisson noise with intensity 0.05 to a clear seal image. The noisy image exhibits obvious interference impairing character readability consistent with real world seal degradation scenarios addressed in Section 1. Compared with the vanilla FISTA denoising result, our proposed algorithm removes noise more thoroughly while preserving fine strokes of Chinese seal characters essential for OCR accuracy. This advantage originates from the dynamic metric adaptation and extrapolation projection steps of our algorithm that balance noise suppression and edge preservation.

The visualization denoising results of FISTA and our algorithm.

Convert sample images to rectangular images

3.3

In general, the critical step in completing text recognition is to convert a circular arrangement of characters into a rectangular region using mathematical transformations. Character recognition is then performed from this region. Figures 7, 8 show the conversion of an input circular seal f(x, y) into a rectangular image g(θ, r).

Seal image placed completely vertically (left-hand side); a rectangular image obtained from the seal image after greyscaling (right-hand side).

Seal image placed at an angle (left-hand side); a rectangular image obtained from the seal image after greyscaling (right-hand side).

Technically, according to Equations 3, 4,

$$[eqn]$$ $$[eqn]$$

the pixel value (θ, r) in the rectangular image has the same value as the corresponding positional pixel value (x, y) in the circular seal.

where x0 and y0 denote the coordinates of the center of the circle in the Cartesian coordinate system, θ∈(0, ..., 359), r∈(0, ..., R) is the height of the unfolded rectangle, and R is the radius of the circle.

Notably, the rectangular image illustrated in Figure 7 is based on a circular seal placed substantially orthogonally. Figure 7 an image of a fully vertically placed seal. In such cases, the unfolded main characters tend to be in consecutive order. This helps to improve the recognition accuracy of OCR.

As can be seen, the right-hand side of Figure 7 shows an example of a rectangular image obtained from the left-hand side of Figure 7 after greyscaling (for reducing the amount of postprocessing computation), followed by a polar coordinate transformation. It shows a continuous arrangement with the main characters in Figure 7.

However, in the real seal scene, the seal that we need to flatten is often not in a vertical state. For instance, a non-vertical input as Figure 8. In such cases, the main characters in the unfolding results of the corresponding non-continuous state are like the right-hand side of Figure 8. This will seriously affect the effect of OCR recognition. Therefore, it is necessary to rotate the angle of the input seal positive, and then proceed to the next step.

The CNN-based angle recognition network

3.4

Due to the lack of publicly available seal image datasets, we chose to generate synthetic datasets. In this way, one can manipulate the text, texture, angle, and other features of the seals with demands. Additionally, we introduce specified noise to simulate real-world variations. This allows us to create a large-scale dataset for training deep-learning models.

Generally, the synthesis of seal images primarily involves generating base images, performing image rotations, adding textures, and adding noise.

Base images generation: The generation of base images includes the creation of external circles, top text, middle text, bottom text, and a central pentagram. The quantity and content of the text are randomly generated.Image rotations: The rotation angle can be set to randomly rotate from 0 to 360 degrees. However, since only rotations at 0, 90, 180, and 270 degrees do not change the size of the image, rotations at other angles will alter the image size.Textures adding: For all rotated images, we apply central cropping to ensure they have the same size. The size is carefully chosen to avoid cropping out any part of the seal. To simulate the texture characteristics of real seals, we select a larger texture image that contains different textures in different regions. Then, we randomly choose regions of various sizes and positions, and linearly blend them with the previously generated seal image.Noise adding: We add Gaussian noise with a random intensity to the blended image to complete the synthesis of the seal image. Figure 9 depicts the process of basic seal generation, rotation, texture addition, and noise application.

The example images of the synthesis of seal images, (a–d) represent the texture image, the generated base seal image, the rotated image, and the image with added texture and noise, respectively.

After generating a sufficient amount of data, we choose VGG16 (Simonyan and Zisserman, 2014) as our model for training. For the choice of training task, since the process of generating the seal images involves rotating the seal images, we select predicting the rotation angle as a pretext task to train the model. The model will be trained to predict a continuous numerical output of the rotation angle based on the input seal image. The training process of the model aims to minimize the difference between the predicted value and the true rotation angle to improve the accuracy of predictions. The simple angle prediction regression model can effectively extract spatial features of the seal images. Moreover, since the training is based on a self-supervised approach, there is no limitation on the available data scale. Deep models can effectively learn the characteristics of the seal images.

** Remark 1**. The VGG16 based angle prediction network is specialized for seal image analysis not a straightforward application of existing architectures. Its innovation and adaptability derive from core design choices aligned with seal recognition constraints. It adopts a self-supervised training paradigm centered on rotation angle prediction addressing the critical challenge of scarce annotated seal data. Trained exclusively on synthetic datasets mimicking seal specific characteristics such as circular text layout texture variations and noise patterns it learns domain adaptive features outperforming direct transfer of natural image pre-trained models. We optimize the network for seal angle correction modifying the final layer to output continuous rotation angles enabling fine grained angle estimation essential for annular text unwrapping while MSE loss minimizes angular deviations critical for subsequent OCR accuracy. The network is inherently integrated with the hybrid system its angle prediction directly enabling precise polar coordinate transformation of circular text to rectangular images resolving the key bottleneck of misaligned text. This specialization ensures the deep learning component leverages seal specific structural priors delivering stable performance on real world seals with partial occlusion or fading and serves as a purpose built module enhancing the overall recognition pipeline.

Experiments

4

Implementation details and datasets

4.1

We employed the classical VGG16 (Simonyan and Zisserman, 2014) model as our training model, modifying the final classification output from 1,000 to 1. The Mean Squared Error (MSE) loss was computed between the true rotation angle and the model's predicted output. The experiments were conducted using a NVIDIA GeForce RTX 3090 GPU. We utilized the Adam optimization algorithm with an initial learning rate of 0.0001. The batch size was set to 8, and the total number of training epochs was 200. The generated seal dataset comprised 3,159 images for the training set and 780 images for the test set. Additionally, we conducted testing on 50 real seal images.

OCR text recognition: The unfolded rectangular text image is first binary encoded, and then the encoded file is fed into the high-precision commercial OCRAPI interface of AliCloud for text recognition to get the result of returning each parameter.

The test conditions were as follows: 84 real scene stamp datasets.

** Remark 2**. The 780 images in the test set are synthetic seal data while the 84 images for OCR accuracy evaluation are real scene seal data. This distinction aligns with the core goal of validating the proposed hybrid system in practical application scenarios. Real seal images are selected to assess OCR performance as they incorporate authentic interference factors such as complex background text uneven ink diffusion scanning noise and partial occlusion which synthetic data cannot fully replicate. The 84 real scene images are randomly sampled from three typical application domains government documents bank checks and enterprise contracts covering diverse seal characteristics including circular shapes 3 to 8 Chinese characters and varying degradation levels. Their distribution is consistent with the synthetic test set in terms of seal type text length and noise intensity ensuring representativeness. To further verify validity we supplemented OCR accuracy on the 780 synthetic test set achieving 98.12% Accuracy 1 and 97.35% Accuracy 2. The slight performance gap between real and synthetic data reflects the practical challenge of real world seal recognition while the 84 real scene images provide more credible evaluation of the system's actual deployment capability.

Performance evaluation

4.2

We evaluated the performance of the angle prediction network on both synthetic and authentic datasets. Mean Absolute Error (MAE) and the variance of the absolute errors were used as the evaluation metric. For the angles of the seal images in the authentic dataset, we obtained the labels through manual annotation.

The performance of angle prediction is shown in Table 3. Our method achieved an average angle prediction error of 1.60 degrees with a variance of 3.11 degrees on the synthetic dataset, demonstrating its capability to accurately predict rotation angles. On the authentic dataset, the performance was slightly lower, with an average error of 6.44 degrees. It is important to note that these results were obtained without using any real data for training, highlighting the effectiveness of our dataset synthesis and training methods. We also plotted a histogram of the angular prediction errors on the authentic dataset. As shown in Figure 10, the majority of errors are small, indicating that our method exhibits good generalization capability.

The histogram of the absolute error between the predicted angle values and the label on authentic dataset.

** Remark 3**. The synthetic seal dataset is generated entirely from scratch independent of existing real seal images to address confidentiality constraints of real seal data. Detailed generation parameters ensuring reproducibility and diversity are specified as follows. Base seal images adopt standardized spatial composition including an outer circle with radius 256 pixels annularly arranged text with 3 to 8 Chinese characters randomly selected from a legal entity name corpus and a central five-pointed star accounting for 10% of the outer circle radius. Text attributes are randomized with font styles including Song Kai Li and Hei character sizes ranging from 15% to 25% of the outer circle radius and spacing with uniform angular distribution and 5° to 10° intervals. Rotation variations span 0° to 360° with 1° increments followed by central cropping to 512 × 512 pixels to preserve complete seal content. Texture blending uses five categories of real seal texture templates such as ink diffusion and paper grain with randomly selected regions of 200 × 200 to 400 × 400 pixels blended linearly at coefficients ranging from 0.1 to 0.3. Noise addition includes Gaussian noise with mean 0 and variance ranging from 0.01 to 0.05 as well as Poisson noise with intensity ranging from 0.02 to 0.08 to simulate common degradation in scanning and printing. These parameterized variations ensure the dataset covers diverse seal styles poses and quality levels providing a reliable foundation for training the angle prediction network.

Image denoising: The issue we need to resolve involves reconstructing an unknown image xtrue from data that has been distorted by noise. These kinds of issues are categorized as inverse problems. Inverse problems can be either well-posed or ill-posed, with the majority falling into the ill-posed category. Bayesian approaches typically address this challenge by minimizing an objective function. This function combines a discrepancy term with a regularization term. Different noise corresponds to different discrepancy functions. Regularization incorporates prior knowledge and potential constraints. The regularization terms can take different paradigms, e.g., one-paradigm two-paradigm, etc. This work focuses on Poisson noise. The discrepancy term, which quantifies the distance from the observed data b∈R^n^, is represented by the generalized Kullback-Leibler (KL) divergence as follows:

$$[eqn]$$

where A∈R^n×n^ is a linear operator modeling the distortion due to the image acquisition system and bg∈R^n^ is a known positive background radiation constant. We assume that all elements in matrix A are non-negative. Moreover, each row and column in matrix A contains at least one positive value. Reference provides a comprehensive description of the image deblurring problem, considering both Poisson and Gaussian noise, along with the KL function. We incorporate hypersurface potential as the regularization term. For an image with equal pixel length and width, both dimensions are denoted by m, where m^2^ = n:

$$[eqn]$$

In summary, Equations 5, 6 can be treated as an optimisation model for the problem of recovering a real image from a noisy image as follows:

$$[eqn]$$

where ρ is a positive parameter that controls the balance between the regularization term and lx≥0, which indicates the non-negative orthant's characteristic function. Naturally, the unknowns (image pixels) must remain non-negative.

$$[eqn]$$

Table 4 presents the iteration counts and computational time required by the Fista algorithm and our approach to bring the relative difference below a specified tolerance, tol. We also provide a summary of the minimization error, $[eqn]$ , given that the optimal solution for both problems is unique. “It” represents the number of iteration cycles, and “Time” indicates the duration in seconds. The time unit reflects the average time in seconds over 10 runs.

** Remark 4**. The VGG16 based angle prediction network is specialized for seal image analysis not a straightforward application of existing architectures. Its innovation and adaptability derive from core design choices aligned with seal recognition constraints. It adopts a self-supervised training paradigm centered on rotation angle prediction addressing the critical challenge of scarce annotated seal data. Trained exclusively on synthetic datasets mimicking seal specific characteristics such as circular text layout texture variations and noise patterns it learns domain adaptive features outperforming direct transfer of natural image pre-trained models. We optimize the network for seal angle correction modifying the final layer to output continuous rotation angles enabling fine grained angle estimation essential for annular text unwrapping while MSE loss minimizes angular deviations critical for subsequent OCR accuracy. The network is inherently integrated with the hybrid system its angle prediction directly enabling precise polar coordinate transformation of circular text to rectangular images resolving the key bottleneck of misaligned text. This specialization ensures the deep learning component leverages seal specific structural priors delivering stable performance on real world seals with partial occlusion or fading and serves as a purpose built module enhancing the overall recognition pipeline.

** Remark 5**. The adoption of the adaptive inertial forward backward algorithm with dynamic backtracking for denoising is tightly aligned with the core requirements of seal text recognition and the inherent characteristics of seal images. Seal text recognition depends critically on preserving fine stroke details while suppressing noise and the algorithm integrates total variation regularization to achieve an optimal balance between the two avoiding over smoothing of subtle stroke structures that are essential for subsequent OCR. Unlike modern learning based denoisers such as DnCNN Restormer and SwinIR it requires no large scale annotated seal datasets which remain scarce due to confidentiality constraints ensuring robust generalization to real world seal degradation. The algorithm's dynamic metric adaptation and extrapolation projection steps enable effective handling of dominant noise types in seal images namely Poisson and Gaussian noise introduced during scanning and printing. Compared to classical methods like BM3D and NLM it eliminates complex patch matching reducing computational overhead while achieving faster convergence with 70 iterations and 0.79 seconds per image at tol = 10^−3^ vs. 223 iterations and 4.5 seconds for vanilla FISTA as validated in our experiments. This efficiency is crucial for practical document verification systems requiring batch processing. The choice prioritizes the synergy of the proposed hybrid system integrating background removal angle correction and text unwrapping rather than standalone denoising innovation and the modular design supports future integration of alternative denoisers for severely degraded scenarios.

OCR text recognition: We tested a total of two metrics: accuracy 1 and accuracy 2, and their formulas are as follows:

$$[eqn]$$ $$[eqn]$$

where n1 represents the total number of correctly identified characters across 84 images as recognized by the model, while N1 indicates the total number of correctly identified characters in those 84 images as recognizable by the human eye. n2 refers to the count of characters accurately recognized by the model in a single image, and N2 corresponds to the number of characters correctly identified by the human eye for that individual image. The experimental results are presented in Table 5.

** Remark 6**. The selection of the FISTA-based adaptive inertial forward-backward denoising method aligns with the core objectives of seal text recognition. This choice is based on the proven effectiveness of FISTA combined with TV regularization which balances noise suppression and edge preservation critical for retaining fine seal stroke details. Our improved algorithm enhances FISTA with dynamic metric adaptation and extrapolation-projection steps achieving faster convergence and lower computational complexity than the original FISTA as shown in Table 4 with 70 iterations and 0.79 seconds per image at tol = 10^−3^ vs. 223 iterations and 4.5 seconds. Unlike deep learning based denoisers such as DnCNN Restormer and SwinIR it requires no large scale annotated datasets or heavy GPU resources running efficiently on conventional hardware. Compared to BM3D and NLM it avoids complex patch matching reducing overhead while achieving superior denoising performance with RME as low as 0.0003. The exclusion of other state of the art denoising algorithms stems from the core innovation of this work which lies in constructing a hybrid system integrating background removal angle correction circular text unwrapping and OCR recognition. Focusing on our proposed denoising algorithm allows us to concentrate on demonstrating the synergy of the hybrid model rather than diverting attention to standalone denoising innovations. Our modular framework readily supports future expansions such as integrating deep learning based denoisers for severely degraded seals.

Ablation experiment: We conducted ablation experiments on key modules of the proposed hybrid system, including rotation correction and image denoising, to evaluate their impacts on final OCR text recognition accuracy. Experimental results are presented in Table 6. Without rotation correction, annular text alignment fails during unwrapping, disrupting character order and causing partial character fragmentation that impairs recognition. The results confirm a noticeable accuracy drop (Accuracy 1: 94.53% vs. 96.66% of the full system), highlighting the necessity of precise angle prediction for text continuity. For the denoising module, seal images contaminated by scanning and printing noise render OCR nearly ineffective, leading to unmeasurable results (denoted as “-” in Table 6). Our customized denoising algorithm effectively suppresses noise while preserving fine character strokes, laying the foundation for high-precision OCR performance. These findings validate that each module addresses critical bottlenecks in seal text recognition, and their integration achieves synergistic gains that reinforce the hybrid system's effectiveness.

** Remark 7**. To further verify the superiority of the RGB color space for seal text segmentation as mentioned in Section 3.1, we conducted comparative experiments between the proposed RGB-based method and the mainstream HSV-based method with parameters optimized via grid search as in Table 1 on the 84 real-scene and 780 synthetic seal datasets used in this study. The RGB method achieved segmentation accuracy 94.1% ± 3.2% on real datasets and 95.3% ± 2.6% on synthetic datasets with background residue rate 3.8% ± 1.5% and 2.9% ± 1.1% respectively while the HSV method only reached 82.3% ± 4.7% segmentation accuracy and 15.6% ± 3.2% background residue rate on real data leading to an 8.24% improvement in OCR Accuracy 1 with RGB at 96.66% vs. HSV at 88.42% as shown in Table 5. This advantage comes from the inherent characteristics of seal scenes where red seals are stamped on black-text backgrounds. The RGB method leverages the significant R-G difference with red elements above 100 and black elements below 10 to directly amplify color contrast and avoids the complex and interdependent parameter tuning of HSV's three components Hue Saturation and Value that results in poor generalization. Fixed HSV thresholds yield unsatisfactory results and require manual adjustment as illustrated in Figure 2 and Section 1. RGB is more robust to real-world variations such as lighting changes and seal fading. Unlike HSV's Hue component which is easily shifted the R-G difference remains stable causing only a 2.1% drop in segmentation accuracy for faded seals compared to 8.7% for HSV. RGB is also more computationally efficient with 0.08 seconds per image vs. 0.21 seconds for HSV making it better suited for the practical demand of real-time seal text recognition in document verification systems.

Conclusion

5

In conclusion, the proposed hybrid model for Chinese seal text recognition achieves notable advancements through the synergy of RGB-based background removal, adaptive inertial forward-backward denoising, and self-supervised deep learning-driven angle prediction, significantly enhancing the accuracy and efficiency of seal text recognition and paving the way for practical applications in seal identification, document authenticity verification, and digital archiving. For future work, we recommend extending the model to recognize seal text in other languages such as English and Japanese to enable cross-linguistic comparative analysis of its accuracy, thereby broadening its applicability and providing valuable insights for cross-cultural seal recognition research.