Skip to main content
Log in

Vehicle license plate super-resolution using soft learning prior

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper proposes a new algorithm to perform single-frame image super-resolution (SR) of vehicle license plate (VLP) using soft learning prior. Conventional single-frame SR/interpolation methods such as bi-cubic interpolation often experience over-smoothing near the edges and textured regions. Therefore, learning-based methods have been proposed to handle these shortcomings by incorporating a learning term so that the reconstructed high-resolution images can be guided towards these models. However, existing learning-based methods employ a binary hard-decision approach to determine whether the prior models are fully relevant or totally irrelevant. This approach, however, is inconsistent with many practical applications as the degree of relevance for the prior models may vary. In view of this, this paper proposes a new framework that adopts a soft learning approach in license plate super-resolution. The method integrates image SR with optical character recognition (OCR) to perform VLP SR. The importance of the prior models is estimated through relevance scores obtained from the OCR. These are then incorporated as a soft learning term into a new regularized cost function. Experimental results show that the proposed method is effective in handling license plate SR in both simulated and real experiments.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Baker S, Kanade T (2002) Limits on super-resolution and how to break them. IEEE Trans Pattern Anal Mach Intell 24:1167–1183

    Article  Google Scholar 

  2. Blu T, Thevenaz P, Unser M (2004) Linear interpolation revitalized. IEEE Trans Image Process 13:710–719

    Article  MathSciNet  Google Scholar 

  3. Chen L, Yap K.-H (2005) Regularized interpolation using kronecher product for still images. IEEE International Conference on image processing, pp. 1014–1017, Sept

  4. Datsenko D, Elad M (2007) Example-based single document image super-resolution: a global map approach with outlier rejection. J Math Signal Process 18:103–121

    MathSciNet  MATH  Google Scholar 

  5. El-Khamy SE, Hadhoud MM, Dessouky MI, Salam BM et al (2005) Efficient implementation of image interpolation as an inverse problem. Digital Signal Process 15:137–152

    Article  Google Scholar 

  6. Farsiu S, Robinson MD, Elad M, Milanfar P (2004) Fast and robust multiframe super resolution. IEEE trans Image Process 13:1327–1344

    Article  Google Scholar 

  7. Freeman WT, Jones TR, Pasztor EC (2002) Example based super-resolution. IEEE Comput Graph Appl 22:56–65

    Article  Google Scholar 

  8. He Y, Yap K.-H, Chen L, Chau L.-P (2007) A nonlinear least square technique for simultaneous image registration and super-resolution. IEEE Transactions on Image Processing, vol. 16, pp. 2830–2841

  9. Hong KP, Paik JK, Kim HJ, Lee CH (1996) An edge-preserving image interpolation system for a digital camcorder. IEEE Trans Consum Electron 42:279–284

    Article  Google Scholar 

  10. Hwang JW, Lee HS (2004) Adaptive image interpolation based on local gradient features. IEEE Signal Process Lett 11:359–362

    Article  Google Scholar 

  11. Kang MG, Katsagelos AK (1992) Simultaneous iterative image restoration and evaluation of the regularization parameter. IEEE Trans Signal Process 40:2329–2334

    Article  Google Scholar 

  12. Kazemi FM, Samadi S, Poorreza HR, Akbarzadeh-T M.-R (2007) Vehicle Recognition Using Curvelet Transform and SVM. Fourth International Conference on Information Technology, pp. 516–521

  13. Li X, Orchard MT (2001) New edge-directed interpolation. IEEE Trans Image Process 10:1521–1527

    Article  Google Scholar 

  14. Lin Z, Shum HY (2004) Fundamental limits of reconstruction-based super-resolution algorithms under local translation. IEEE Trans Pattern Anal Mach Intell 26:83–97

    Article  Google Scholar 

  15. Nijhuis JAG, Ter Brugge MH, Helmholt KA, Pluim JPW et al (1995) Car license plate recognition with neural networks and fuzzy logic. IEEE International Conference on Neural Networks, pp. 2232–2236

  16. Pu H, Wei H, Dong-Feng W, Yong-Jie Z (2003) Car license plate feature extraction and recognition based on multi-stage classifier. International Conference on Machine Learning and Cybernetics, pp. 128–132

  17. Ramponi G (1999) Warped distance for space-variant linear image interpolation. IEEE Trans Image Process 8:629–639

    Article  Google Scholar 

  18. Rosenfeld A, Kak CA (1982) Digital picture processing, 2nd edn. Academic Press, London

    Google Scholar 

  19. Shyang-Lih C, Li-Shien C, Yun-Chung C, Sei-Wan C (2004) Automatic license plate recognition. IEEE Trans Intell Transp Syst 5:42–53

    Article  Google Scholar 

  20. Suresh KV, Rajagopalan AN (2006) A discontinuity adaptive method for super-resolution of license plates. Graphics and Image Processing Computer Vision, vol. 4338/2006, pp. 24–34

  21. Yap K-H, He Y, Tian Y, Chau L-P (2009) A nonlinear L1-norm approach for joint image registration and super-resolution. IEEE Signal Process Lett 16:981–984

    Article  Google Scholar 

  22. Zhang Y, Zhang C (2003) A new algorithm for character segmentation of license plate. IEEE International Conference on Intelligent Vehicles Symposium, pp. 106–109

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kim-Hui Yap.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tian, Y., Yap, KH. & He, Y. Vehicle license plate super-resolution using soft learning prior. Multimed Tools Appl 60, 519–535 (2012). https://doi.org/10.1007/s11042-011-0821-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-011-0821-2

Keywords

Navigation