JPEG XT Image Compression with Hue Compensation for Two-Layer HDR Coding
Hiroyuki Kobayashi, Hitoshi Kiya

TL;DR
This paper introduces a hue compensation technique for JPEG XT HDR image compression that reduces color distortion while maintaining standard compatibility, improving hue accuracy and luminance mapping.
Contribution
It presents a novel hue compensation method based on maximally saturated colors that enhances color fidelity in JPEG XT HDR images without standard incompatibility.
Findings
Reduces hue distortion in LDR images from JPEG XT bitstreams
Maintains luminance mapping quality across different criteria
Ensures full compatibility with JPEG XT standard
Abstract
We propose a novel JPEG XT image compression with hue compensation for two-layer HDR coding. LDR images produced from JPEG XT bitstreams have some distortion in hue due to tone mapping operations. In order to suppress the color distortion, we apply a novel hue compensation method based on the maximally saturated colors. Moreover, the bitstreams generated by using the proposed method are fully compatible with the JPEG XT standard. In an experiment, the proposed method is demonstrated not only to produce images with small hue degradation but also to maintain well-mapped luminance, in terms of three kinds of criterion: TMQI, hue value in CIEDE2000, and the maximally saturated color on the constant-hue plane.
Click any figure to enlarge with its caption.
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsImage Enhancement Techniques · Color Science and Applications · Advanced Vision and Imaging
JPEG XT Image Compression with Hue Compensation for Two-Layer HDR Coding
Hiroyuki KOBAYASHI
Tokyo Metropolitan College of Industrial Technology,
Tokyo, Japan
Hitoshi KIYA
Tokyo Metropolitan University,
Tokyo, Japan
Abstract
We propose a novel JPEG XT image compression with hue compensation for two-layer HDR coding. LDR images produced from JPEG XT bitstreams have some distortion in hue due to tone mapping operations. In order to suppress the color distortion, we apply a novel hue compensation method based on the maximally saturated colors. Moreover, the bitstreams generated by using the proposed method are fully compatible with the JPEG XT standard. In an experiment, the proposed method is demonstrated not only to produce images with small hue degradation but also to maintain well-mapped luminance, in terms of three kinds of criterion: TMQI, hue value in CIEDE2000, and the maximally saturated color on the constant-hue plane.
Index Terms:
Hue compensation, JPEG XT, Two-layer coding, Tone mapping, Color correction, Maximally saturated color
I Introduction
The interest of high dynamic range (HDR) imaging has recently been increasing in various area: photography, medical imaging, computer graphics, on vehicle cameras, astronautics. HDR images have the information of the wide dynamic range of real scenes. However, commonly used display devices which can directly represent HDR images are not popular yet. Therefore, various two-layer encoding method to generate bitstreams with base layer and residual layer, have been proposed for compressing HDR images [1, 2, 3, 4, 5, 6, 7]. ISO/IEC JTC 1/SC 29/WG 1 (JPEG) has developed a series of international standards referred to as the JPEG XT[8, 9, 10, 11, 12]. The JPEG XT has been designed to be backward compatible with the legacy JPEG standard with two-layer coding.
For the base-layer coding, a low dynamic range (LDR) image is generated by a tone-mapping operation (TMO). In the operation, the range of the luminance of an HDR image is compressed by using a tone-mapping (TM) operator, and then an LDR image is produced by combining the compressed luminance and the color information of the original HDR image. However, TMOs only focusing on the luminance cause image colors to be distorted as pointed out in [13, 14, 15, 16, 17].
In this paper, we propose a novel JPEG XT image compression with hue compensation for two-Layer HDR coding. The proposed compensation method utilizes the hue information based on the maximally saturated colors[18], for suppressing color distortions due to the influence of TMOs.
To evaluate the effectiveness of the proposed method, we perform a number of simulations. In the simulations, the proposed method is compared with conventional TMOs in terms of the hue difference used in CIEDE2000[19], the maximally saturated color difference, and Tone Mapped image Quality Index (TMQI)[20].
II Proposed Method
II-A Overview
As shown in Fig. 1, a JPEG XT bitstream consists of base layer and residual layer. A tone-mapped LDR image is decoded from the base layer, and an HDR image is decoded by using both layers. However, the LDR image includes some hue distortion due to the influence of TMO. In order to suppress the hue distortion, we apply a hue compensation process based on the constant hue plane in the RGB color space before encoding LDR images. In the hue compensation process, a hue compensated image is generated by using an LDR image and the maximally saturated colors of the original HDR image. In addition, inverse TMO (TMO*′-1* in Fig. 1) is modified according to the hue compensation. These modifications are applied to only the JPEG XT encoder, and moreover generated bitstreams are fully compatible with the JPEG XT standard. As a result, LDR and HDR images are decoded from the bitstreams by using the standard JPEG XT decoder without any modification.
II-B Constant hue plane
We focus on the constant hue plane in the RGB color space[18]. An input image is a 24-bit full color LDR image and each pixel of the image is represented as . , , and are the R, G, and B components of a pixel , respectively. In the RGB color space, a set of pixels which has the same hue forms a plane, called constant hue plane. The shape of the constant hue plane is the triangle whose vertices correspond to white (), black () and the maximally saturated color () with the same hue as . On the constant hue plane, a pixel can be represented as a linear combination as
[TABLE]
where
[TABLE]
and and are functions that return the maximum and minimum elements of the pixel , respectively. Since , , and exist on the plane and is an interior point of , and , the following equations hold.
[TABLE]
Moreover, the maximally saturated color is given by
[TABLE]
From Eq. (5), the elements of corresponding to the maximum and minimum elements of the pixel become 1 and 0, respectively.
We consider the same pixel representation on the constant hue plane for HDR images and discuss the relation between HDR images and LDR ones. Each pixel of an HDR image is represented as where , , and are generally real numbers. As well as LDR images, we define white, black and the maximally saturated color as , and , where is calculated from Eq. (5) by replacing with , and then the pixel value is also represented as a linear combination as
[TABLE]
where , and are coefficients calculated from , and the maximally saturated color is given by
[TABLE]
.
In general, is not satisfied, because some hue distortion occurs due to the influence of TMO. Therefore, to correct the hue distortion, we replace with as,
[TABLE]
where
[TABLE]
This process corresponds to ‘Hue Compensation’ in Fig. 1. Note that and are on the same constant hue plane.
II-C Procedure of hue compensation
The procedure of the proposed method shown in Fig. 1 is shown as follows.
Generate an LDR image by using a TMO. 2. 2.
Calculate , , and for each pixel value of by Eq. (2). 3. 3.
Calculate for each pixel value of the original HDR image according to Eq. (7). 4. 4.
Generate a compensated image by Eq. (8). 5. 5.
Input to a JPEG XT encoder.
III Experimental results
III-A Hue distortion
We used five HDR images selected from an HDR image database[21]. We adapted two objective metrics to evaluate hue distortion caused in TMOs under the use of three TMOs: JPEG XT default TMO, Reinhard’s local operator[22], and Drago’s TMO[23]. One is , which is the average of euclidean norms of the maximally saturated colors and . The other is the hue differences defined in CIEDE2000 , which was published by the CIE[19].
Table I shows evaluation results in terms of the objective metrics. In the table, the proposed method outperformed the conventional JPEG XT bitstreams for both TMOs. Therefore, the proposed method is demonstrated to be effective for improving hue distortion in terms of not only but also .
III-B Influence on tone mapping
Next, we evaluate the quality of tone-mapped LDR images in terms of TMQI. From Tab. II, the proposed method is shown to offer almost the same TMQI scores as those of the conventional bitstreams. The results show that the proposed one allows us to compensate hue distortion, while maintaining TM performances.
III-C Visual evaluation
We used two HDR images, ‘McKeesPub’ and ‘WillyDesk’, to visually evaluate the quality of images. The images were encoded by the proposed encoder and the conventional JPEG XT one, respectively. In this experiment, the default TM operator of JPEG XT was used as a TM operator. Figure 3 shows decoded LDR images, where (a) and (b) were results produced by using the conventional approach, and (c) and (d) were generated by using the proposed one. From the result, we can confirm there are color differences in some places.
To more clearly demonstrate the differences, maximally saturated color images are shown in Fig. 4. The proposed method is demonstrated to have closer maximally saturated colors to those of the HDR images than the conventional method.
Figure 5 shows euclidean norms of the maximally saturated color and . From these figures, the proposed method is also demonstrated to be effective in reducing hue distortion.
IV Conclusion
In this paper, we proposed a novel two-layer HDR coding method to reduce hue distortion of LDR images due to the influence of TMO. The proposed method enables us to compensate the hue distortion under the use of any TM operator, while maintaining well-mapped luminance. In addition, the proposed one has compatibility with JPEG XT bitstreams. Experimental results showed the effectiveness of the proposed method in terms of three objective metrics: , , and TMQI.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Ishtiaq Rasool Khan, “Two layer scheme for encoding of high dynamic range images,” in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing , March 2008, pp. 1169–1172.
- 2[2] T. Jinno, M. Okuda, and N. Adami, “New local tone mapping and two-layer coding for HDR images,” in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing , March 2012, pp. 765–768.
- 3[3] M. Iwahashi and H. Kiya, “Efficient lossless bit depth scalable coding for HDR images,” in APSIPA ASC, 2012 Asia-Pacific , Dec 2012, pp. 1–4.
- 4[4] M. Iwahashi and H. Kiya, “Two layer lossless coding of HDR images,” in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing , May 2013, pp. 1340–1344.
- 5[5] O. Watanabe, H. Kobayashi, and H. Kiya, “Two-layer lossless HDR coding considering histogram sparseness with backward compatibility to JPEG,” in Picture Coding Symposium (PCS) , June 2018, pp. 11–15.
- 6[6] O. Watanabe, H. Kobayashi, and H. Kiya, “Lossless two-layer coding using histogram packing technique for hdr images,” in Proc. IEEE Int. Symp. on Circuits and Systems , May 2018, pp. 1–5.
- 7[7] H. Kobayashi and H. Kiya, “An Extension of JPEG XT with JPEG 2000,” in 2017 IEEE International Conference on Consumer Electronics - Taiwan (ICCE-TW) , June 2017, pp. 373–374.
- 8[8] T. Richter, “On the standardization of the JPEG XT image compression,” in Picture Coding Symposium (PCS) , Dec 2013, pp. 37–40.
