Next Article in Journal
Time Series Modelling
Previous Article in Journal
Contract Theory-Based Incentive Mechanism for Full Duplex Cooperative NOMA with SWIPT Communication Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Reliable Recurrence Algorithm for High-Order Krawtchouk Polynomials

by
Khaled A. AL-Utaibi
1,*,†,
Sadiq H. Abdulhussain
2,†,
Basheera M. Mahmmod
2,†,
Marwah Abdulrazzaq Naser
3,†,
Muntadher Alsabah
4,† and
Sadiq M. Sait
5,†
1
Department of Computer Engineering, University of Ha’il, Ha’il 682507, Saudi Arabia
2
Department of Computer Engineering, University of Baghdad, Al-Jadriya, Baghdad 10071, Iraq
3
Department of Architectural Engineering, University of Baghdad, Al-Jadriya, Baghdad 10071, Iraq
4
Department of Electronic and Electrical Engineering, University of Sheffield, Sheffield S1 4ET, UK
5
Department of Computer Engineering, Interdisciplinary Research Center for Intelligent Secure Systems, Research Institute, King Fahd University of Petroleum & Minerals, Dhahran 31261, Saudi Arabia
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Entropy 2021, 23(9), 1162; https://doi.org/10.3390/e23091162
Submission received: 3 August 2021 / Revised: 25 August 2021 / Accepted: 1 September 2021 / Published: 3 September 2021
(This article belongs to the Section Signal and Data Analysis)

Abstract

:
Krawtchouk polynomials (KPs) and their moments are promising techniques for applications of information theory, coding theory, and signal processing. This is due to the special capabilities of KPs in feature extraction and classification processes. The main challenge in existing KPs recurrence algorithms is that of numerical errors, which occur during the computation of the coefficients in large polynomial sizes, particularly when the KP parameter (p) values deviate away from 0.5 to 0 and 1. To this end, this paper proposes a new recurrence relation in order to compute the coefficients of KPs in high orders. In particular, this paper discusses the development of a new algorithm and presents a new mathematical model for computing the initial value of the KP parameter. In addition, a new diagonal recurrence relation is introduced and used in the proposed algorithm. The diagonal recurrence algorithm was derived from the existing n direction and x direction recurrence algorithms. The diagonal and existing recurrence algorithms were subsequently exploited to compute the KP coefficients. First, the KP coefficients were computed for one partition after dividing the KP plane into four. To compute the KP coefficients in the other partitions, the symmetry relations were exploited. The performance evaluation of the proposed recurrence algorithm was determined through different comparisons which were carried out in state-of-the-art works in terms of reconstruction error, polynomial size, and computation cost. The obtained results indicate that the proposed algorithm is reliable and computes lesser coefficients when compared to the existing algorithms across wide ranges of parameter values of p and polynomial sizes N. The results also show that the improvement ratio of the computed coefficients ranges from 18.64% to 81.55% in comparison to the existing algorithms. Besides this, the proposed algorithm can generate polynomials of an order ∼8.5 times larger than those generated using state-of-the-art algorithms.

1. Introduction

Digital image processing plays an essential role in several aspects of our daily lives. Image signals are subject to several processes such as transmission [1], enhancement [2], transformation [3], hiding [4], and compression [5,6]. Similarly to image processing, speech signals processing is also essential [7], and involves several stages such as transfer [8], acquisition [9], and coding [10]. Pattern recognition, which is considered an automated process, is widely used in various applications such as computer vision [11], statistical data analysis [12], information retrieval [13], shot boundary detection [14], and bio-informatics [15]. However, the accuracy of extracting the significant features in these essential signal processing approaches is crucial [16]. Feature extraction, in particular, is used to reduce the dimensionality of the signals to a finite size [17,18]. Specifically, a finite number of features can be used to represent the signals. These finite features can be considered the most significant ones and need to be extracted using efficient methods. As such, to achieve the best signal representation, a fast and robust feature extraction mechanism becomes necessary. To this end, such features’ extraction mechanism needs to meet the desired accuracy concerns by extracting the most significant features efficiently with low processing times. Furthermore, the energy compaction and localization of the signals can also be considered as essential factors in signal compression [19]. This is attributed to the fact that using fewer effective coefficients results in a more accurate representation of the signals. Hence, orthogonal polynomials are an effective tool that can be applied to meet these desired requirements and features characterization.
Continuous and discrete orthogonal polynomials are commonly used in many signal processing applications and feature characteristics. Continuous orthogonal polynomials are used in speech and image applications, for example, in pattern recognition, robot vision, face recognition, object classification, hiding information, data compression, template matching, and in edge detection for image data compression [20,21,22,23]. The performance of orthogonal polynomials is evaluated according to their ability to extract distinct features from signals in a fast and efficient way. This special ability of feature extraction can be quantified using properties such as (a) energy compaction; (b) signal representation without redundancy; (c) numerical stability; and (d) localization [24,25,26].
Discrete orthogonal polynomials are widely used to extract features from images [27]. There are different types of discrete polynomials. Examples of these include discrete Tchebichef polynomials [28], Chebyshev polynomials [29], discrete Charlier polynomials [26], discrete Krawtchouk polynomials (DKPs), and discrete Meixner polynomials [30]. Among these polynomials, DKPs are widely exploited in image processing. This is due to their salient characteristics, which can be used to extract local features from images. Specifically, by exploiting the localization property of the DKPs, images can be efficiently represented by using a finite number of features [31]. The localization property is carried out by controlling the parameter value (p) of the DKPs. Typically, discrete orthogonal moments are generated using DKPs. Discrete orthogonal moments are extensively exploited in image and signal processing [11,32,33,34], coding theory [35], and information theory [36,37]. However, reconstructing a signal using moments and maintaining the orthogonality has to date been considered a challenging task. In addition to this, the discretization error is another challenge that appears when reconstructing the signal, especially when moments are used in the implementation. This discretization error, however, increases with the moments’ order. For example, when the order of the moments increases, the discretization error increases accordingly. As such, the accuracy of the moments’ computation is reduced, resulting in an inaccurate representation of images [38,39,40].
Several studies have been performed on the discrete Krawtchouk polynomials and methods developed to efficiently compute their coefficients, for example see [25,31,41,42,43,44]. These research works utilize a three-term recurrence algorithm [25]. In addition, the hypergeometric series and gamma functions are widely applied in image processing [25]. However, the aforementioned research works use functions that require a long time to execute and process the signals. Furthermore, these functions become numerically unstable when the order of the moments increases. Instead, a three-terms recurrence algorithm can be applied to come up with the aforementioned time and accuracy issues. To this end, Yap et al. [41] presented a recurrence algorithm in the n direction to calculate the Krawtchouk polynomial coefficients (KPCs). Due to the propagation error, this recurrence algorithm becomes unstable—especially when the polynomial size increases. In general, such a propagation error increases through the computation of polynomial coefficients. This is attributed to the fact that pitfalls may happen even when small errors in floating numbers occur. As such, there is an essential need to reduce the number of recurrences, especially when the polynomial size is increased. Furthermore, such a reduction could also lead to a reduction in the propagation error, thereby leading to a more stable computation of polynomial coefficients, as desired. The work in [31] proposes a modified recurrence algorithm in the n direction (RAN) by partitioning the KP array into two partitions. Therefore, only 50% of the coefficients need to be computed. However, the partitioning of the KP array generates a larger polynomial size, which is undesirable. On a similar basis, the work in [42] proposes a recurrence algorithm in the x direction (RAX) by partitioning the KP plane into two partitions. Specifically, the x direction of the recurrence algorithm is used to compute the KPCs. The results show that the RAX algorithm outperforms the RAN algorithm. It is worth noting that the RAN and RAX algorithms use a symmetric property to compute the polynomial coefficients of the second portion. A novel bi-recursive relation algorithm in the n direction (BRRN) was proposed in [43]. In this method, the KP array is divided into four partitions. However, the KPC coefficients are computed for two partitions only, i.e., 50% of the coefficients are computed. Then, a symmetric property is used to compute the KPCs for the remaining partitions. The results indicate that the BRRN algorithm provides higher gain than the RAX algorithm for limited values of parameter p, i.e., the polynomial size. Abdulhussain et al. [44] developed an algorithm and presented new properties of orthogonal polynomials such that the KP plane is divided into four portions and only the KPCs for one portion are computed. For this, the size of the generated polynomials is increased, but it is still limited, especially for parameter p less than 0.25 and greater than 0.75. This is because the initial values or sets become zero as the polynomial size increases. Recently, the work in [25] proposed a recurrence relation algorithm that has the ability to compute KPCs with very large sizes. However, the proposed algorithm is limited to the parameter value of  p = 0.5 .
The existing algorithms suffer from the following limitations: (1) no initial value is provided; (2) the propagation error is high; and (3) the implementation of these algorithms is limited to a specific value of the parameter p. They also suffer from numerical instabilities, especially when the polynomials orders and sizes become high. Therefore, an advanced and reliable recurrence algorithm for high-order polynomials and large sizes is required. Therefore, a new recurrence algorithm is presented in this paper, which handles the numerical instabilities issue of using high orders of polynomials and large sizes. The proposed algorithm is able to compute the KPCs for all values of the parameter p. In addition to this, this paper presents the development of a new mathematical model for computing the initial value of p. In particular, the initial value is accurately computed for all values of parameter p. Furthermore, a new relation to compute the values of the initial sets is derived. To this end, a diagonal recurrence relation is introduced. The proposed diagonal recurrence algorithm is derived from the existing n and x directions of the recurrence algorithm. The diagonal and the existing recurrence algorithm are exploited to compute the KP coefficients. The KP coefficients are then used for one partition after dividing the KP plane into four partitions. To compute the KP coefficients in other partitions, a symmetric property relation is utilized.
Organization of the paper: This paper is organized as follows. Section 2 presents the mathematical formulations of the orthogonal polynomials and moments. In Section 3, the methodology of the proposed recurrence algorithm is provided. This methodology involves providing a discussion about the initial value selection of parameter p. In addition, this section explains how the Krawtchouk polynomial’s coefficients can be computed. In order to characterize the performance of the proposed approaches, Section 4 provides the numerical results. Finally, conclusions are discussed in Section 5.
Notation: In this paper, the operator transpose is denoted by ( · ) T and a b denotes the binomial coefficients.

2. Preliminaries

This section presents the Krawtchouk polynomials and their recurrence relation. To this end, the n-th order of the Krawtchouk polynomials based on the hypergeometric series is given as
K ^ n p ( x ) = 2 F 1 n x N + 1 ; 1 p .
The weighted function ω ( x , p ) and the norm function ρ ( n , p ) are used to generate the weighted and normalized KP coefficients as given in [31]. To this end, the weighted and normalized KP coefficients can be written as in (2) and (3), respectively:
ω ( x , p ) = N 1 x p x ( 1 p ) N x 1
ρ ( n , p ) = ( 1 ) n 1 p p n n ! ( N + 1 ) n
The Pochhammer symbol ( · ) c , which is known as an ascending or rising factorial function, can be written as [45]
( a ) c = Γ ( a + c ) Γ ( a ) = a ( a + 1 ) ( a + 2 ) ( a + c 1 ) ,
where Γ ( . ) denotes the Gamma function. To this end, using the weight and norm functions, the weighted and normalized Krawtchouk polynomials of the n-th order for a signal of size N are given as [31]
K n p x = ω ( n , x ) ρ ( n , x ) K ^ n p ( x ) ,
K n p x = N 1 n N 1 x p 1 p n + x 2 F 1 n x N + 1 ; 1 p , n , x = 0 , 1 , , N 1 ; p ( 0 , 1 ) ,
where 2 F 1 describes the hypergeometric series and can be written as
2 F 1 n x N + 1 ; 1 p = k = 0 ( n ) k ( x ) k ( N + 1 ) k , k ! 1 p k .

3. Proposed Recurrence Algorithm

This section describes the methodology of the proposed recurrence algorithm.

3.1. Computing the Initial Value

The problem with traditional approaches for computing the initial value in the n = 0 and x = 0 directions is the numerical instability. For example, the traditional methods provide zero values of the initial K 0 p 0 —which is unstable. The initial value can be computed as
K 0 p 0 = ( 1 p ) N 1 .
The expression in (8) makes the initial value ( K 0 p 0 ) decrease to zero for different values of parameter p, especially for large polynomial sizes N. Figure 1 shows the values of K 0 p 0 for different values of parameter p and size N. The results show that the value of K 0 p 0 starts to fall to zero when p becomes larger than 0.1. Specifically, as the values of parameter p increase, the value of K 0 p 0 falls to zero. For example, for p = 0.15 , the value of K 0 p 0 becomes zero for N > 5000 while for p = 0.4 , the value of K 0 p 0 becomes zero earlier for N > 2000 . This makes it impossible to compute the rest of the KP coefficients’ values. Therefore, there is an essential need to find an efficient method for computing the initial value of p, which prevents the initial value ( K 0 p 0 ) from dropping to zero. To this end, this paper identifies the suitable non-zero values in the KP plane that need to be used as an initial value. As such, there is an essential need to plot the values of coefficient K 0 p x for different values of parameter p. Figure 2 shows the plots of the values of coefficient K 0 p x for different values of parameter p. Clearly, the results in Figure 2 show that the values of K 0 p x start with a small number and gradually reach the peak. Then, the values drop to a very small number. In addition, we observe that using non-small values as an initial set of parameter p seems useful to compute other values of the KP coefficients.
Figure 2 demonstrates that the peak values can be located at x = N p . In this paper, the value of x = N p is denoted by x 0 . To this end, a general formula for computing K 0 p x 0 can be written as
K 0 p x 0 = K 0 p ( N p ) × ω ( N p ; p ) ρ ( 0 ; p ) , K 0 p x 0 = 1 × N 1 N p p N p 1 p N p + N 1 1 , K 0 p x 0 = N 1 N p p N p 1 p N p + N 1 .
Computing K 0 p x 0 using expression (9) may also lead to unstable numerical values of coefficients with errors, especially for high-order polynomials. This is because the binomial coefficients function tends to be very large and close to infinity. To demonstrate this behavior, Figure 3 is provided.
Figure 3 shows that the initial values ( K 0 p x 0 ) are still inaccurate where these values record either NaN or Inf values. This is due to the nature of the polynomial coefficients that are obtained by the expression in (9). Thus, the initial values ( K 0 p x 0 ) seem difficult to be computed for large polynomial sizes (N). To overcome this issue, this paper proposes an efficient and suitable approach that makes the value of K 0 p x 0 commutable. It is worth noting that the values obtained from the polynomial coefficients’ formula, especially the Gamma function, should be reduced when the coefficients become large since their argument value is increased. This can be achieved using arg = exp ( ln ( a r g ) ) = e ln ( arg ) and the initial values can be computed as
K 0 p ( x 0 ) = e 0.5 × z ,
where z is given as
z = ln Γ ( N ) log Γ ( x 0 + 1 ) log Γ ( N x 0 ) x 0 ln 1 p p + ( N 1 ) ln ( 1 p ) .
A proof of expression (10) is presented in Appendix A.
Figure 4 shows a plot of the proposed initial values of ( K 0 p x 0 ) in the developed expression in (10) for various values of parameter p as a function of polynomials size N. The results show that the proposed initial values are more computable for wide ranges of parameter p and large polynomial sizes N, as desired. Hence, this signifies the feasibility of the proposed formula for practical implementations compared with state-of-the-art equations.

3.2. The Fundamental Computation of the Initial Values

Typically, for any orthogonal polynomial, the computation of coefficients requires the evaluation of a significant number of fundamental initials. Thus, based on the first initial value K 0 p x 0 , computed using the proposed formula, the KP coefficients are obtained K 0 p ( x 1 ) , K 1 p ( x 0 ) , and K 1 p ( x 1 ) (see Figure 5). Therefore, this section shows how the aforementioned coefficients values are computed.
First, K 0 p ( x 1 ) is computed using the proposed derived formula, which provides the two terms relation between the K 0 p ( x 0 ) and K 0 p ( x 1 ) . To this end, this relation/ratio between the coefficients can be formulated as
K 0 p ( x 1 ) K 0 p ( x 0 ) = N 1 N p + 1 p N p + 1 ( 1 p ) N p + N 2 N 1 N p p N p ( 1 p ) N p + N 1 , = ( N 1 ) ! ( N p + 1 ) ! ( N N p 2 ) ! ( N 1 ) ! ( N p ) ! ( N N p 1 ) ! · 1 p p , = N N p 1 N p + 1 · p 1 p ,
where x 1 = x 0 + 1 = N p + 1 . Thus, the expression in (11) can be further simplified to:
K 0 p ( x 1 ) = N N p 1 N p + 1 · p 1 p K 0 p ( x 0 ) .
Then, K 1 p x 0 and K 1 p x 1 can be computed using a two-term recurrence relation with K 0 p x 0 and K 0 p x 1 , respectively. To derive the recurrence relation of the proposed approach, the following formulas are used:
K 0 p x = ω K p ( x , N ) ,
K 1 p x = ω K p ( x , N ) , p ( N 1 ) x ( N 1 ) p ( 1 p ) .
From (13) and (), K 1 p x can be simplified to:
K 1 p x = p ( N 1 ) x ( N 1 ) p ( 1 p ) K 0 p x .
Using the expression in (15), K 1 p x 0 and K 1 p x 1 can be further simplified to
K 1 p x 0 = p ( N 1 ) N p ( N 1 ) p ( 1 p ) K 0 p x 0 = p ( N 1 ) p ( 1 p ) K 0 p x 0
K 1 p x 1 = p ( N 1 ) ( N p + 1 ) ( N 1 ) p ( 1 p ) K 0 p x 1 = p + 1 ( N 1 ) p ( 1 p ) K 0 p x 1 .

3.3. The Computation of the Initial Sets

In this section, the computation of the initial sets is discussed. These initial sets are shown in Figure 6. Figure 6 shows parts of the KP coefficients, which are covered in this section. The initial sets are defined in the ranges of x = x 0 , x 1 and n = 2 , 3 , , x .
To compute the values of the initial set, the recurrence in the n direction is used. To this end, the formulation of recurrence is given as
K n p x = α 1 n , x K n 1 p x α 2 n , x K n 2 p x , α 1 n , x = ( N 2 n + 1 ) p + n x 1 p ( 1 p ) n ( N n ) , α 2 n , x = ( n 1 ) ( N n + 1 ) n ( N n ) , x = x 0 , x 1 and n = 2 , 3 , , x .
After computing the initial sets, the values in the ranges x = x 0 , x 1 and n = 0 , 1 , , x are used as the initials to compute the rest of the KP coefficients values.

3.4. Computation of the Coefficients Values for KP

In this section, the rest of the coefficient values are computed. These coefficients are shown in Figure 7. As depicted in Figure 7, there are two main parts, which are located at the left (Part 1) and the right (Part 2) sides of the initial sets. In addition, the coefficients are located at the right side of the initial sets and can be divided into three sub-parts. These parts are Part 2-1, Part 2-2, and Part 2-3. The detailed description of the computation of each part is presented in the following subsections.

3.4.1. Computation of the Coefficients Located at Part 1

In this section, the values of KP coefficients in Part 1, shown in Figure 7, are computed using a backward x recurrence relation. The backward recurrence relation is obtained from the traditional recurrence relation in the x direction as
K n p ( x 1 ) = β 1 n , x K n p ( x ) β 2 n , x K n p ( x + 1 ) , β 1 n , x = ( N 2 x 1 ) p n + x p ( 1 p ) x ( N x ) , β 2 n , x = ( N x 1 ) ( x + 1 ) x ( N x ) , n = 0 , 1 , , x 0 and x = x 0 , x 0 1 , , n .
The values of KP coefficients become unstable as the index of x goes towards n. This is because the values of the coefficients tend to be less than 10 7 . To overcome this issue, the condition of a threshold value is used to stop the recurrence for each value of index n. The proposed condition is given by
| K n ( x ) | < 10 5 and | K n ( x + 1 ) | < 10 7 .

3.4.2. Computation of the Coefficients Located at Part 2-1

In this section, the values of KP coefficients in Part 2-1, given in Figure 7, were computed using a forward x recurrence relation as given in (21):
K n p ( x + 1 ) = γ 1 n , x K n p ( x ) γ 2 n , x K n p ( x 1 ) γ 1 n , x = ( N 2 x 1 ) p n + x p ( 1 p ) ( x + 1 ) ( N x 1 ) γ 2 n , x = ( N x ) x ( x + 1 ) ( N x 1 ) n = 0 , 1 , , x 0 and x = x 0 , x 0 + 1 , , N n 1
The aforementioned recurrence relation, which is used to compute the values in Part 2-1, is subject to the following condition:
| K n ( x ) | < 10 5 and | K n ( x + 1 ) | < 10 7 .

3.4.3. Computation of the Coefficients Located at Part 2-2

This section presents two new recurrence relations’ approaches to compute the KP coefficient values diagonally. This diagonal calculation is given in Part 2-2 Figure 7. The values in the diagonal of Figure 7 are then used to compute the coefficients’ values in Part 2-3 in Figure 7. This is because the recurrence relation in the n direction cannot be used to compute the coefficients’ values. Consequently, some values in Part 2 become zero, which results from the condition used to prevent the occurrence of unstable values.
This paper derives the recurrence relations provided in Figure 8. From Figure 8a, it can be seen that the elements computed for x 0 and x 1 can be used to compute the coefficients along the main diagonal n = x and n = x 1 . Furthermore, to compute the coefficients’ values of KP K n p ( x + 1 ) , the coefficient value K n + 1 p ( x ) is computed using the n direction recurrence algorithm. The similarity across the main diagonal ( n = x ) is exploited for simplicity where K n p ( x + 1 ) = K n + 1 p ( x ) . To this end, the KP coefficients along n = x 1 are computed as
K n p ( x + 1 ) = δ 1 n , x , K n p ( x ) δ 2 n , x , K n 1 p ( x ) , δ 1 n , x = ( N 2 x 1 ) p n + x p ( 1 p ) x ( N x ) , δ 2 n , x = ( N x ) x ( x + 1 ) ( N x 1 ) , x = x 0 + 1 , x 0 + 2 , N 2 1 and n = x .
To compute the values at the main diagonal where n = x , a new recurrence relation approach is developed. This is achieved by combining both n and x directions recurrences. Suppose that the values at ( n , x + 1 ) , and ( n 1 , x + 1 ) are known (see circulated values I and K in Figure 8d). Then, the value at n + 1 , x + 1 (see circulated values L in Figure 8d) can be computed using the n direction recurrence relation as
K n + 1 p ( x + 1 ) = α 1 n + 1 , x + 1 , K n p ( x + 1 ) α 2 n + 1 , x + 1 , K n 1 p ( x + 1 ) .
The value at ( n 1 , x + 1 ) can be computed using the x direction recurrence relation as
K n 1 p ( x + 1 ) = γ 1 n 1 , x , K n 1 p ( x ) γ 2 n 1 , x , K n 1 p ( x 1 ) .
Substituting Equation (25) in (24) yields the following general expression of the recurrence relation:
K n + 1 p ( x + 1 ) = α 1 n + 1 , x + 1 K n p ( x + 1 ) α 2 n + 1 , x + 1 γ 1 n 1 , x K n 1 p ( x ) γ 2 n 1 , x K n 1 p ( x 1 ) = α 1 n + 1 , x + 1 K n p ( x + 1 ) α 2 n + 1 , x + 1 γ 1 n 1 , x K n 1 p ( x ) + α 2 n + 1 , x + 1 γ 2 n 1 , x K n 1 p ( x 1 ) = η 1 n , x , K n p ( x + 1 ) η 2 n , x K n 1 p ( x ) + η 3 n , x K n 1 p ( x 1 ) η 1 n , x = α 1 n + 1 , x + 1 = ( N 2 n 1 ) p + n x 1 p ( 1 p ) ( n + 1 ) ( N n 1 ) η 2 n , x = α 2 n + 1 , x + 1 γ 1 n 1 , x = n ( N n ) ( ( N 2 x 1 ) p + x n + 1 ) 2 p ( 1 p ) ( n + 1 ) ( N n 1 ) ( x + 1 ) ( N x 1 ) η 3 n , x = α 2 n + 1 , x + 1 γ 2 n 1 , x = n ( N n ) x ( N x ) ( n + 1 ) ( N n 1 ) ( x + 1 ) ( N x 1 ) x = x 1 , x 1 + 1 , , N / 2 1 ; and n = x
This recurrence relation is termed as the four-term recurrence relation in the n x direction. This new development approach is used to compute the KP coefficients in the range x = x 1 + 1 , x 1 + 2 , , N / 2 + 1 and n = x 1 , and x = x 1 + 1 , x 1 + 2 , , N / 2 and n = x as shown in Figure 9:

3.4.4. Computation of the Coefficients Located at Part 2-3

This section presents the computation of the KP coefficients located at Part 2-3 in Figure 7. These values are computed using (21) in the ranges n = x 1 , x 1 + 1 , N / 2 2 and n + 2 x N n + 1 . However, the following condition should be met:
| K n ( x ) | < 10 5 and | K n ( x + 1 ) | < 10 7 .

3.5. Computation of the Rest of the KP Coefficients

This subsection provides the computation of the rest of the KP coefficients. To this end, the rest of the coefficients can be computed using a similarity relation of the KP. The coefficients in the ranges x = 0 , 1 , , N / 2 1 and n = x + 1 , x + 2 , , N x 1 are given as
K n p x = K x p n .
The coefficients in the ranges x = 0 , 1 , , N 1 and n = N x , N x + 1 , , N 1 are computed using the following expression:
K n p x = ( 1 ) N n x 1 K N n p N x .
In addition, to calculate the KP coefficients for p > 0.5 , firstly the value of p is set to 1 p . Then, the KP coefficients are computed using the proposed methodology. Finally, the following formula is applied for all coefficients [44]:
K n p x = ( 1 ) n K n p N x 1 .

3.6. Summary of the Proposed Algorithm

In this subsection, a summary of the proposed algorithm is presented. To this end, a flow chart of the proposed recurrence is shown in Figure 10. In addition to this, a pseudo-code is presented (see Algorithm 1) for more clarification. In addition, 3D plots of the KP coefficients are given in this subsection.
Algorithm 1 Computation of Krawtchouk polynomials using the proposed algorithm.
     Input: N , p
                   N represents the size of the Krawtchouk polynomial,
                   p represents the parameter of the Krawtchouk polynomials.
     Output: K n p x
1: F l a g =False
2: if   p > 0.5   then
3:      F l a g =True;       p p 1
4: end if
5: x 0 N p ,       x 1 x 0 + 1
6: Compute K 0 p x 0 using (10)
7: Compute K 0 p x 1 using (12)
8: Compute K 1 p x 0 and K 1 p x 1 using (16) and (17)
9:▹ Compute initial set
10: for x = x 0 : x 1 do
11:     for  n = 2 : x  do
12:         Compute K n p x using (18)
13:     end for
14: end for
15:▹ Compute coefficient values in Part 1
16: for n = 0 : x 0 do
17:     for  x = x 0 : 1 : n do▹ inner loop
18:         Compute K n p x using (19)
19:         if  | K n ( x ) | < 10 5 and | K n ( x + 1 ) | < 10 7  then
20:            Exit inner loop
21:         end if
22:     end for
23: end for
24:▹ Compute coefficient values in Part 2-1
25: for n = 0 : x 0 do
26:     for  x = x 0 : N n 1 do▹ inner loop
27:         Compute K n p x using (21)
28:         if  | K n ( x + 1 ) | < 10 7 and | K n ( x ) | < 10 5  then
29:            Exit inner loop
30:         end if
31:     end for
32: end for
33:▹ Compute coefficient values in Part 2-2
34: for x = x 0 : N / 2 1 do
35:      n x
36:     Compute K n p x using (23)
37: end for
38: for x = x 1 : N / 2 1 do
39:      n x
40:     Compute K n p x using (26)
41: end for
42:▹ Compute coefficient values in Part 2-3
43: for n = x 1 : N / 2 2 do
44:     for  x = n + 2 : N n 1 do▹ inner loop
45:         Compute K n p x using (21)
46:         if  | K n ( x ) | < 10 5 and | K n ( x + 1 ) | < 10 7  then
47:            Exit inner loop
48:         end if
49:     end for
50: end for
51: Compute the rest of the coefficients using the similarity relations (28) and (29)
52: if F l a g =True then
53:     Apply (30)
54: end if
Figure 11 and Figure 12 show a 3D plot of the KP coefficients, which are generated using the proposed recurrence algorithm with N = 2000 and different values of the p parameter ranging between <0.5 and >0.5, respectively.

4. Numerical Results and Analyses

This section presents the results obtained using the proposed recurrence algorithm. In addition, a comprehensive comparison is conducted with the existing recurrence algorithms. The comparison is carried out in terms of the energy compaction, reconstruction error, and computation cost.

4.1. Energy Compaction Analysis

The order of moments n impacts the process of signal reconstruction, energy compaction, and information retrieval. The order of the KP moments is given by n = 0 , 1 , 2 , , N 1 . The energy compaction is utilized to check the impact of using KP to transform a large fraction of the signal energy into relatively few coefficients of moments. To find the impact of using the KP parameter (p) on the energy compaction property, the procedure given by [46] is employed. The stationary Markov sequence with length N and zero mean is analyzed. A matrix L with covariance coefficients ( ρ ) is defined as [27]:
L = 1 ρ ρ N 1 ρ 1 ρ N 1 ρ 1
The matrix L is then transformed to the Krawtchouk domain. As such, the coefficients in the main diagonal of the transformed matrix ( S ) are computed. The matrix S represents the variance σ l 2 , which can be computed as
S = R L R T ,
where R denotes the KP matrix and ( · ) T refers to the matrix transpose operation. In addition, the normalized restriction error ( J m ) can be computed using:
J m = q = m N 1 σ q 2 q = 0 N 1 σ q 2 ,
m = 0 , 1 , , N 1 ,
where σ q 2 represents the order of σ l 2 sorted in descending order. In the experiment, the normalized restriction error is performed by considering different covariance coefficients ( ρ ) and different values of the parameters M N P .
Figure 13 shows the normalized restriction error for different values of parameters (p) with the covariance coefficient ρ = 0.93 . It can be observed from Figure 13 that when the value of p is equal to 1 p , the normalized restriction error becomes equal. For example, the normalized restriction error for p = 0.05 is equal to p = 1 0.05 = 0.95 . In addition, the energy compaction is influenced by the KP parameter p. For instance, as the parameter p increases from 0.05 to 0.45 , the performance of the KP in terms of energy compaction is changed. Furthermore, the energy compaction at parameter p = 0.45 shows better performance for parameter p = 0.05 because the normalized restriction error ( J m ) reaches zero values. However, small values of parameter p shows better performance in terms of feature extraction, as proven in [44]. Thus, it can be concluded that KP provides further performance improvement as the parameter p reaches 0.5. Furthermore, a more accurate result can be achieved when the parameter p is deviates from 0.5 [44].

4.2. Analysis of Reconstruction Error

In this section, the proposed recurrence algorithm is evaluated by carrying out reconstruction error analysis (REA). This REA was conducted for the proposed and the existing works. The REA was performed using an image formed from 16 well-known images as shown in Figure 14. In addition, the comparison was performed on an image with a large size, i.e., ( 4096 × 4096 ). Different values of parameter p were considered in the analysis. These values are p = 0.1 , 0.2 , 0.3 , and 0.4 .
First, the WNKP (R) is generated using the proposed and existing algorithms. Then, the KMs ( ψ ) of the image are computed. Then, the image is reconstructed from the computed moments using a limited number of moments. Finally, the normalized mean square error (NMSE) is calculated between the input image and the reconstructed version of the image. Hence, the NMSE is given as [44]
NMSE ( I , I R e c ) = x , y I ( x , y ) I R e c ( x , y ) 2 x , y I ( x , y ) 2 ,
where parameters I and I R e c denote the original image and the reconstructed image, respectively.
The NMSE and the reconstructed image for p = 0.1 and p = 0.2 are shown in Figure 15 and Figure 16, respectively. The first row depicts the reconstructed images by utilizing the FRK [44], while the second row represents the reconstructed images using the proposed algorithm. The FRK algorithm is unable to reconstruct the image of the low-order moments. In addition, it is unable to reconstruct the image with high orders. However, the proposed algorithm is capable of fully reconstructing the image of different order values. In addition, the NMSE is minimized in the proposed algorithm using a moment order of 680, which is 16 % . Figure 15 shows that the proposed algorithm achieves an NMSE of 0.72 while the FRK algorithm records a value of 0.84. This implies that the proposed algorithm outperforms the FRK algorithm. Moreover, the NMSE reaches zero when the proposed algorithm is used, while it records 0.64 when the FRK is used. The limitation with the FRK algorithm is due to the initial set that was computed, which makes the KPCs values tend towards zero, and thus, the NMSE is increased. Figure 17 provides a plot of experiments using p = 0.3 . The results show that the proposed algorithm provides better NMSE than the FRK starting from a moment order of 680. In addition, the performance improvement increases when the moment order increases until it reaches the full order of (4096). At the full order, the NMSE using the proposed algorithm reaches 0, while it reaches 0.18 using the FRK algorithm.
Figure 18 shows a new performance evaluation using p = 0.4 . The results show that the proposed algorithm has the ability to accurately generate the KP coefficients while for the FRK, the KP coefficients remain inaccurate. This is attributed to the zero initial value obtained in the FRK algorithm. It is also worth noting that the proposed algorithm is able to generate KP coefficients for large polynomial sizes and at a high polynomial order, which was experimentally found to be greater than 8192.
Finally, this paper provides a comparison of a maximum polynomial size between the proposed and existing algorithms. The maximum size is obtained for different values of the parameter p. For each recurrence algorithm, the polynomial (R) is computed first with a size and order of N × N . Then, the following criterion is applied:
E r r = s u m ( d i a g o n a l ( R × R T ) I ( N ) ) < T h ,
where T h is the threshold value over which 10 5 is chosen. I ( N ) is the identity matrix with a size of N × N . It is worth noting that the maximum value of N is set to 20,480. Table 1 lists the obtained maximum size for each algorithm for different values of parameter p. This table demonstrates that the proposed algorithm is capable of generating an orthogonal polynomial with a large size and for different values of parameter p. The proposed algorithm outperforms the existing recurrence algorithms for all values of the parameters p considered. For example, at p = 0.05 , the proposed algorithm generates a size of 82× larger than the RAN algorithm, 243× larger than the RAX algorithm, and 16× larger than the FRK algorithm. Thus, the proposed recurrence algorithm can be used to process large signals sizes quickly and accurately.

4.3. Computation of the Cost Analysis

The computation cost is considered an important factor to evaluate the performance of the proposed recurrence algorithm [44]. Thus, the computation cost of the proposed algorithm is compared with the existing works. These algorithms the are recurrence algorithm in the x direction (RAX), the recurrence algorithm in the n direction (RAN), and FRK. The computation cost is performed using the number of computed coefficients. Table 2 shows the ratio of computed coefficients (RCCs) using the proposed algorithm for different polynomials’ sizes. Full moments’ orders are considered. From Table 2, it can be observed that the RCC for small values of p and 1 p achieves a low percentage. This percentage increases as the value of p increases towards 0.5. The average RCC for p = 0.05 and p = 0.95 is 9.22% while for p = 0.5 , the average RCC is 20.35%. This is because the effective coefficient is shaping a circle for p = 0.5 , and they are shaping a rotated ellipse as the parameter p deviates towards 0 or 1, which allows the number of effective coefficients to be reduced. Consequently, the percentage of the computed coefficients is reduced.
Table 3 demonstrates the performance improvement ratio between the proposed and the existing algorithms, namely RAN, RAX, and FRK. The RAN and RAX algorithms compute 50% of the KPCs for all values of parameter p because the n x plane is divided into two portions. On the other hand, the FRK algorithm computes 25% of the KPCs as it divides the n x plane into four partitions. The improvement ratio between the proposed and existing algorithms is obtained as
Improvement Ratio = 1 RCC of the proposed algorithm RCC of the existing algorithm .
According to Table 3, the proposed polynomial shows an improvement ratio of 18.64% at p = 0.5 when compared to the FRK algorithm and 59.32% when compared to the RAN and the RAX algorithm. The improvement ratio increases as the value of the parameter p deviates towards 0 and 1. For example, the results show that at parameter p = 0.25 , the proposed method achieves an improvement ratio of 29.18% compared to the FRK algorithm, and 64.59% compared to other algorithms. In addition, a maximum improvement ratio of 63.11% is achieved by the proposed algorithm when it compares with the FRK algorithm while it is 81.55% when it compares with the RAN and RAX algorithms.

5. Conclusions

This paper described that state-of-the-art algorithms suffer from high error and that the implementation of these algorithms is limited to a specific value of parameter p. In addition to this, the state-of-the-art algorithms do not provide any computation of the initial value. Furthermore, to date, no algorithm is proposed for computing the KP coefficients with high-order polynomial and large polynomial sizes. To address these limitations, a new recurrence relation was proposed in this paper. To this end, a new initial value was presented and derived. In addition to this, a new diagonal recurrence relation was introduced. The proposed algorithm divided the KP plane into four triangles and only the coefficients in the upper triangle are computed. The coefficients in the upper triangle were divided into fundamental initial sets, initial sets, Part-1 and Part-2, respectively. The n-recurrence, x-recurrence, backwards x-recurrence, and diagonal recurrence relations were used to compute the values of the coefficients in the upper triangle. In addition, the identities were used to compute the values of the coefficients in the other triangles. The proposed algorithm was evaluated and compared with the existing recurrence algorithms. The comparison was carried out based on the reconstruction error, energy compaction, and computation cost. The experimental results showed that the proposed algorithm achieves a remarkable improvement over the existing algorithms in terms of the maximum size generated and the number of coefficients computed. Although the proposed algorithm outperforms state-of-the-art algorithms, the computational complexity is still high and can be further reduced. This can be achieved by implementing the proposed algorithm in a multi-processing environment (parallelizing) rather than in sequential form, as considered in this paper. Our future work is also directed towards implementing the proposed algorithm for KP with other orthogonal polynomials. This is expected to result in a new OP that has the potential of using orthogonal polynomials as well as the properties of KP coefficients.

Author Contributions

Conceptualization, S.H.A., K.A.A.-U. and B.M.M.; methodology, S.H.A. and B.M.M.; software, S.H.A., K.A.A.-U. and M.A.N.; validation, M.A., S.M.S. and M.A.N.; formal analysis, M.A.; investigation, M.A. and K.A.A.-U.; writing—original draft preparation, S.H.A., M.A., M.A.N. and B.M.M.; writing—review and editing, K.A.A.-U., S.M.S. and M.A.; visualization, S.H.A. and B.M.M.; supervision, S.H.A. and S.M.S.; project administration, S.H.A. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

All data are available within the manuscript.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A. Proof of Equation (10)

This section presents a proof through Equation (10):
K 0 p ( x 0 ) = N 1 N p p N p 1 p N p + N 1 = N 1 N p p N p 1 p N p + N 1 1 / 2 = ( N 1 ) ! ( x 0 ) ! ( N x 0 1 ) ! × p x 0 ( 1 p ) N 1 ( 1 p ) x 0 1 / 2 = Γ ( N ) Γ ( x 0 + 1 ) Γ ( N x 0 ) × 1 p p x 0 ( 1 p ) N 1 1 / 2
By taking the exponential and natural log ( e log ), then (A1) can be simplified to:
K 0 p ( x 0 ) = e log Γ ( N ) Γ ( x 0 + 1 ) Γ ( N x 0 ) × 1 p p x 0 ( 1 p ) N 1 1 / 2 = e 1 2 log Γ ( N ) Γ ( x 0 + 1 ) Γ ( N x 0 ) × 1 p p x 0 ( 1 p ) N 1 = e 1 2 log Γ ( N ) log Γ ( x 0 + 1 ) log Γ ( N x 0 ) × 1 p p x 0 ( 1 p ) N 1 = e 1 2 log Γ ( N ) log Γ ( x 0 + 1 ) log Γ ( N x 0 ) x 0 log ( 1 p p ) + ( N 1 ) log ( 1 p ) .

References

  1. Chen, Y.; Lin, W.; Wen, Y.; Wang, B.; Zhang, S.; Zhang, Y.; Yu, S. Image Signal Transmission Passing over a Barrier enabled by Optical Accelerating Beams. In Imaging Systems and Applications; Optical Society of America: Washington, DC, USA, 2020; p. JF1E-5. [Google Scholar]
  2. Park, K.; Chae, M.; Cho, J.H. Image Pre-Processing Method of Machine Learning for Edge Detection with Image Signal Processor Enhancement. Micromachines 2021, 12, 73. [Google Scholar] [CrossRef]
  3. Xiao, H. A Nonlinear Modulation Algorithm based on Orthogonal Polynomial in MIMO Radar. In Proceedings of the 2020 International Conference on Microwave and Millimeter Wave Technology (ICMMT), Shanghai, China, 20–23 September 2020; pp. 1–3. [Google Scholar] [CrossRef]
  4. Radeaf, H.S.; Mahmmod, B.M.; Abdulhussain, S.H.; Al-Jumaeily, D. A steganography based on orthogonal moments. In ICICT ’19—International Conference on Information and Communication Technology; ACM Press: New York, NY, USA, 2019; pp. 147–153. [Google Scholar] [CrossRef]
  5. Naser, M.A.; Alsabah, M.; Mahmmod, B.M.; Noordin, N.K.; Abdulhussain, S.H.; Baker, T. Downlink Training Design for FDD Massive MIMO Systems in the Presence of Colored Noise. Electronics 2020, 9, 2155. [Google Scholar] [CrossRef]
  6. Alsabah, M.; Naser, M.A.; Mahmmod, B.M.; Noordin, N.K.; Abdulhussain, S.H. Sum Rate Maximization Versus MSE Minimization in FDD Massive MIMO Systems With Short Coherence Time. IEEE Access 2021, 9, 108793–108808. [Google Scholar] [CrossRef]
  7. Guido, R.C.; Pedroso, F.; Contreras, R.C.; Rodrigues, L.C.; Guariglia, E.; Neto, J.S. Introducing the Discrete Path Transform (DPT) and its applications in signal analysis, artefact removal, and spoken word recognition. Digit. Signal Process. 2021, 117, 103158. [Google Scholar] [CrossRef]
  8. Azam, M.H.; Berger, J.; Guernouti, S.; Poullain, P.; Musy, M. Parametric PGD model used with orthogonal polynomials to assess efficiently the building’s envelope thermal performance. J. Build. Perform. Simul. 2021, 14, 132–154. [Google Scholar] [CrossRef]
  9. Antonir, A.; Wijenayake, C.; Ignjatović, A. Acquisition of high bandwidth signals by sampling an analog chromatic derivatives filterbank. In Proceedings of the 2021 IEEE International Symposium on Circuits and Systems (ISCAS), Daegu, Korea, 22–28 May 2021; pp. 1–5. [Google Scholar] [CrossRef]
  10. Vlašić, T.; Ralašić, I.; Tafro, A.; Seršić, D. Spline-like Chebyshev polynomial model for compressive imaging. J. Vis. Commun. Image Represent. 2020, 66, 102731. [Google Scholar] [CrossRef]
  11. Abdulhussain, S.H.; Mahmmod, B.M.; Naser, M.A.; Alsabah, M.Q.; Ali, R.; Al-Haddad, S.A.R. A Robust Handwritten Numeral Recognition Using Hybrid Orthogonal Polynomials and Moments. Sensors 2021, 21, 1999. [Google Scholar] [CrossRef] [PubMed]
  12. Barranco-Chamorro, I.; Grentzelos, C. Some uses of orthogonal polynomials in statistical inference. Comput. Math. Methods 2020, e1144. [Google Scholar] [CrossRef]
  13. Krishnamoorthy, R.; Devi, S.S. Image retrieval using edge based shape similarity with multiresolution enhanced orthogonal polynomials model. Digit. Signal Process. 2013, 23, 555–568. [Google Scholar] [CrossRef]
  14. Idan, Z.N.; Abdulhussain, S.H.; Mahmmod, B.M.; Al-Utaibi, K.A.; Al-Hadad, S.; Sait, S.M. Fast Shot Boundary Detection Based on Separable Moments and Support Vector Machine. IEEE Access 2021, 9, 106412–106427. [Google Scholar] [CrossRef]
  15. Nafees, S.; Rice, S.H.; Phillips, C. Analyzing Genomic Data Using Tensor-based Orthogonal Polynomials. In Proceedings of the 2018 ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics, Washington, DC, USA, 29 August–1 September 2018; p. 584. [Google Scholar]
  16. Igawa, R.A.; Barbon Jr, S.; Paulo, K.C.S.; Kido, G.S.; Guido, R.C.; Júnior, M.L.P.; da Silva, I.N. Account classification in online social networks with LBCA and wavelets. Inf. Sci. 2016, 332, 72–83. [Google Scholar] [CrossRef] [Green Version]
  17. Hameed, I.M.; Abdulhussain, S.H.; Mahmmod, B.M. Content-based image retrieval: A review of recent trends. Cogent Eng. 2021, 8, 1927469. [Google Scholar] [CrossRef]
  18. Yang, L.; Su, H.; Zhong, C.; Meng, Z.; Luo, H.; Li, X.; Tang, Y.Y.; Lu, Y. Hyperspectral image classification using wavelet transform-based smooth ordering. Int. J. Wavelets Multiresolut. Inf. Process. 2019, 17, 1950050. [Google Scholar] [CrossRef]
  19. Guariglia, E.; Silvestrov, S. Fractional-Wavelet Analysis of Positive definite Distributions and Wavelets on D ( C ) . In Engineering Mathematics II; Silvestrov, S., Rančić, M., Eds.; Springer International Publishing: Cham, Switzerland, 2016; pp. 337–353. [Google Scholar]
  20. Jassim, W.A.; Raveendran, P. Face recognition using discrete Tchebichef-Krawtchouk transform. In Proceedings of the 2012 IEEE International Symposium on Multimedia, Irvine, CA, USA, 10–12 December 2012; pp. 120–127. [Google Scholar]
  21. Mahmmod, B.M.; Abdulhussain, S.H.; Naser, M.A.; Alsabah, M.; Mustafina, J. Speech Enhancement Algorithm Based on a Hybrid Estimator. In IOP Conference Series: Materials Science and Engineering; IOP Publishing: Bristol, UK, 2021; Volume 1090, p. 012102. [Google Scholar] [CrossRef]
  22. Abdulhussain, S.H.; Ramli, A.R.; Hussain, A.J.; Mahmmod, B.M.; Jassim, W.A. Orthogonal polynomial embedded image kernel. In Proceedings of the International Conference on Information and Communication Technology, Baghdad, Iraq, 15–16 April 2019; pp. 215–221. [Google Scholar]
  23. Wang, W.; Zhao, J. Hiding depth information in compressed 2D image/video using reversible watermarking. Multimed. Tools Appl. 2016, 75, 4285–4303. [Google Scholar] [CrossRef]
  24. Wang, Y.; Vilermo, M.; Yaroslavsky, L. Energy compaction property of the MDCT in comparison with other transforms. In Audio Engineering Society Convention 109; Audio Engineering Society: New York, NY, USA, 2000. [Google Scholar]
  25. Mahmmod, B.M.; Abdul-Hadi, A.M.; Abdulhussain, S.H.; Hussien, A. On Computational Aspects of Krawtchouk Polynomials for High Orders. J. Imaging 2020, 6, 81. [Google Scholar] [CrossRef]
  26. Abdul-Hadi, A.M.; Abdulhussain, S.H.; Mahmmod, B.M. On the computational aspects of Charlier polynomials. Cogent Eng. 2020, 7, 1763553. [Google Scholar] [CrossRef]
  27. Zhu, H.; Liu, M.; Shu, H.; Zhang, H.; Luo, L. General form for obtaining discrete orthogonal moments. LET Image Process. 2010, 4, 335. [Google Scholar] [CrossRef]
  28. Mukundan, R.; Ong, S.; Lee, P. Image analysis by Tchebichef moments. IEEE Trans. Image Process. 2001, 10, 1357–1364. [Google Scholar] [CrossRef]
  29. Mizel, A.K.E. Orthogonal functions solving linear functional differential equationsusing chebyshev polynomial. Baghdad Sci. J. 2008, 5, 143–148. [Google Scholar]
  30. Abdulhussain, S.H.; Mahmmod, B.M. Fast and efficient recursive algorithm of Meixner polynomials. J. Real-Time Image Process. 2021, 1–13. [Google Scholar] [CrossRef]
  31. Yap, P.T.; Paramesran, R.; Ong, S.H. Image analysis by krawtchouk moments. IEEE Trans. Image Process. 2003, 12, 1367–1377. [Google Scholar] [CrossRef] [Green Version]
  32. Yap, P.T.; Paramesran, R. Local watermarks based on Krawtchouk moments. In Proceedings of the 2004 IEEE Region 10 Conference TENCON 2004, Chiang Mai, Thailand, 24 November 2004; pp. 73–76. [Google Scholar] [CrossRef]
  33. Akhmedova, F.; Liao, S. Face Recognition with Discrete Orthogonal Moments. In Recent Advances in Computer Vision; Springer: Cham, Switzerland, 2019; pp. 189–209. [Google Scholar]
  34. Tsougenis, E.D.; Papakostas, G.A.; Koulouriotis, D.E. Image watermarking via separable moments. Multimed. Tools Appl. 2015, 74, 3985–4012. [Google Scholar] [CrossRef]
  35. Zhou, Z.; Li, X.; Tang, C.; Ding, C. Binary LCD codes and self-orthogonal codes from a generic construction. IEEE Trans. Inf. Theory 2018, 65, 16–27. [Google Scholar] [CrossRef]
  36. Heo, J.; Kiem, Y.H. On characterizing integral zeros of Krawtchouk polynomials by quantum entanglement. Linear Algebra Appl. 2019, 567, 167–179. [Google Scholar] [CrossRef]
  37. Pierce, J.R. An Introduction to Information Theory: Symbols, Signals and Noise; Courier Corporation: Chelmsford, MA, USA, 2012. [Google Scholar]
  38. Liao, S.X.; Pawlak, M. On the accuracy of Zernike moments for image analysis. IEEE Trans. Pattern Anal. Mach. Intell. 1998, 20, 1358–1364. [Google Scholar] [CrossRef] [Green Version]
  39. Liao, S.X.; Pawlak, M. On image analysis by moments. IEEE Trans. Pattern Anal. Mach. Intell. 1996, 18, 254–266. [Google Scholar] [CrossRef]
  40. Kamgar-Parsi, B.; Kamgar-Parsi, B. Evaluation of quantization error in computer vision. In Physics-Based Vision: Principles and Practice: Radiometry, Volume 1; CRC Press: Boca Raton, FL, USA, 1993; p. 293. [Google Scholar]
  41. Yap, P.T.; Raveendran, P.; Ong, S.H. Krawtchouk moments as a new set of discrete orthogonal moments for image reconstruction. In Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN’02 (Cat. No.02CH37290), Honolulu, HI, USA, 12–17 May 2002; pp. 908–912. [Google Scholar] [CrossRef]
  42. Jassim, W.A.; Raveendran, P.; Mukundan, R. New orthogonal polynomials for speech signal and image processing. LET Signal Process. 2012, 6, 713–723. [Google Scholar] [CrossRef]
  43. Zhang, G.; Luo, Z.; Fu, B.; Li, B.; Liao, J.; Fan, X.; Xi, Z. A symmetry and bi-recursive algorithm of accurately computing Krawtchouk moments. Pattern Recognit. Lett. 2010, 31, 548–554. [Google Scholar] [CrossRef]
  44. Abdulhussain, S.H.; Ramli, A.R.; Al-Haddad, S.A.R.; Mahmmod, B.M.; Jassim, W.A. Fast Recursive Computation of Krawtchouk Polynomials. J. Math. Imaging Vis. 2018, 60, 285–303. [Google Scholar] [CrossRef]
  45. Abramowitz, M.; Stegun, I.A. Handbook of Mathematical Functions: With Formulas, Graphs, and Mathematical Tables; Dover Publications: Mineola, NY, USA, 1964. [Google Scholar]
  46. Jain, A.K. Fundamentals of Digital Image Processing; Prentice-Hall, Inc.: Hoboken, NJ, USA, 1989. [Google Scholar]
Figure 1. The computation of the initial values ( K 0 p 0 ) as a function of different polynomial sizes using Equation (8).
Figure 1. The computation of the initial values ( K 0 p 0 ) as a function of different polynomial sizes using Equation (8).
Entropy 23 01162 g001
Figure 2. Plots of K 0 p x for a wide range of parameter p and N = 500 .
Figure 2. Plots of K 0 p x for a wide range of parameter p and N = 500 .
Entropy 23 01162 g002
Figure 3. The computation of the initial values ( K 0 p x 0 ) as a function of different polynomial sizes using Equation (9).
Figure 3. The computation of the initial values ( K 0 p x 0 ) as a function of different polynomial sizes using Equation (9).
Entropy 23 01162 g003
Figure 4. The computation of the initial sets’ values ( K 0 p x 0 ) as a function of different polynomial sizes using Equation (10).
Figure 4. The computation of the initial sets’ values ( K 0 p x 0 ) as a function of different polynomial sizes using Equation (10).
Entropy 23 01162 g004
Figure 5. The fundamental computation of initial values according to the x and n directions in the KP plane.
Figure 5. The fundamental computation of initial values according to the x and n directions in the KP plane.
Entropy 23 01162 g005
Figure 6. A diagram shows the location of initial sets in the KP plane.
Figure 6. A diagram shows the location of initial sets in the KP plane.
Entropy 23 01162 g006
Figure 7. A diagram shows the parts’ locations in the KP coefficients’ plane in the x and n directions based on the proposed algorithm.
Figure 7. A diagram shows the parts’ locations in the KP coefficients’ plane in the x and n directions based on the proposed algorithm.
Entropy 23 01162 g007
Figure 8. A diagram shows the coefficients’ locations that are used to compute the values in Part 2-2.
Figure 8. A diagram shows the coefficients’ locations that are used to compute the values in Part 2-2.
Entropy 23 01162 g008
Figure 9. A diagram shows a location of the coefficients in Part 2-2.
Figure 9. A diagram shows a location of the coefficients in Part 2-2.
Entropy 23 01162 g009
Figure 10. Flowchart of the proposed algorithm.
Figure 10. Flowchart of the proposed algorithm.
Entropy 23 01162 g010
Figure 11. 3D plot of the KP coefficients computed for N = 2000 and p < 0.5 .
Figure 11. 3D plot of the KP coefficients computed for N = 2000 and p < 0.5 .
Entropy 23 01162 g011
Figure 12. 3D plot of the KP coefficients computed for N = 2000 and p > 0.5 .
Figure 12. 3D plot of the KP coefficients computed for N = 2000 and p > 0.5 .
Entropy 23 01162 g012
Figure 13. Energy compaction for different values of the parameter p.
Figure 13. Energy compaction for different values of the parameter p.
Entropy 23 01162 g013
Figure 14. Evaluation of an image used for REA.
Figure 14. Evaluation of an image used for REA.
Entropy 23 01162 g014
Figure 15. The NMSE performance comparing the proposed algorithm and the RAK algorithm [44] with p = 0.1 .
Figure 15. The NMSE performance comparing the proposed algorithm and the RAK algorithm [44] with p = 0.1 .
Entropy 23 01162 g015
Figure 16. The NMSE performance comparing the proposed algorithm and the RAK algorithm [44] with p = 0.2 .
Figure 16. The NMSE performance comparing the proposed algorithm and the RAK algorithm [44] with p = 0.2 .
Entropy 23 01162 g016
Figure 17. The NMSE performance comparing the proposed algorithm and the RAK algorithm [44] with p = 0.3 .
Figure 17. The NMSE performance comparing the proposed algorithm and the RAK algorithm [44] with p = 0.3 .
Entropy 23 01162 g017
Figure 18. The NMSE performance comparing the proposed algorithm and the RAK algorithm [44] with p = 0.4 .
Figure 18. The NMSE performance comparing the proposed algorithm and the RAK algorithm [44] with p = 0.4 .
Entropy 23 01162 g018
Table 1. Maximum size of KP that is generated using the proposed and existing algorithms.
Table 1. Maximum size of KP that is generated using the proposed and existing algorithms.
pAlgorithmpAlgorithm
RANRAXFRKProposedRANRAXFRKProposed
0.0524884123620,4800.55926932242820,480
0.10324132225020,4800.60808812288020,480
0.15392196225220,4800.65706708336820,480
0.20462276298020,4800.70618618305820,480
0.25538436340020,4800.75538490340020,480
0.30618676305820,4800.80462318298020,480
0.357101234336820,4800.85390202225220,480
0.408141428288020,4800.90322140225020,480
0.459361220242820,4800.9524088123620,480
Table 2. The ratio comparison of the computed coefficients of the proposed recurrence algorithm.
Table 2. The ratio comparison of the computed coefficients of the proposed recurrence algorithm.
Krawtchouk Parameter (p)
0.05,
0.95
0.1,
0.9
0.15,
0.85
0.2,
0.8
0.25,
0.75
0.3,
0.7
0.35,
0.65
0.4,
0.6
0.45,
0.55
0.5
Polynomial size (N)102410.0313.3115.5617.2418.5219.5120.2420.7521.0521.16
20489.4812.7414.9916.6817.9718.9619.6920.2020.5020.60
30729.2512.5114.7616.4517.7418.7319.4719.9720.2720.38
40969.1312.3814.6316.3217.6118.6019.3419.8520.1420.24
51209.0512.3014.5416.2317.5318.5219.2519.7620.0620.16
61448.9912.2414.4816.1717.4718.4619.1919.7020.0020.10
71688.9512.1914.4416.1317.4218.4119.1519.6519.9520.05
81928.9112.1514.4016.0917.3818.3819.1119.6219.9220.02
Average9.2212.4814.7316.4117.7118.7019.4319.9420.2420.34
Table 3. Comparing the improvement ratio of the computed coefficients of the proposed algorithm and the existing algorithms.
Table 3. Comparing the improvement ratio of the computed coefficients of the proposed algorithm and the existing algorithms.
Krawtchouk Polynomial Parameter (p)
0.05,
0.95
0.1,
0.9
0.15,
0.85
0.2,
0.8
0.25,
0.75
0.3,
0.7
0.35,
0.65
0.4,
0.6
0.45,
0.55
0.5
Proposed9.2212.4814.7316.4117.7118.7019.4319.9420.2420.34
FRK25.0025.0025.0025.0025.0025.0025.0025.0025.0025.00
RAN and RAX50.0050.0050.0050.0050.0050.0050.0050.0050.0050.00
Improvement
over
FRK
63.1150.0941.1034.3529.1825.2222.2820.2519.0518.64
Improvement
over
RAN and RAX
81.5575.0570.5567.1864.5962.6161.1460.1259.5259.32
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

AL-Utaibi, K.A.; Abdulhussain, S.H.; Mahmmod, B.M.; Naser, M.A.; Alsabah, M.; Sait, S.M. Reliable Recurrence Algorithm for High-Order Krawtchouk Polynomials. Entropy 2021, 23, 1162. https://doi.org/10.3390/e23091162

AMA Style

AL-Utaibi KA, Abdulhussain SH, Mahmmod BM, Naser MA, Alsabah M, Sait SM. Reliable Recurrence Algorithm for High-Order Krawtchouk Polynomials. Entropy. 2021; 23(9):1162. https://doi.org/10.3390/e23091162

Chicago/Turabian Style

AL-Utaibi, Khaled A., Sadiq H. Abdulhussain, Basheera M. Mahmmod, Marwah Abdulrazzaq Naser, Muntadher Alsabah, and Sadiq M. Sait. 2021. "Reliable Recurrence Algorithm for High-Order Krawtchouk Polynomials" Entropy 23, no. 9: 1162. https://doi.org/10.3390/e23091162

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop