This paper presents a H.264/AVC intra encoder design with mode decision based on rate-distortion (R-D) optimization. Reducing the computational complexity of the R-D optimized mode decision is critical to successful application of H.264/AVC to real-ti...
This paper presents a H.264/AVC intra encoder design with mode decision based on rate-distortion (R-D) optimization. Reducing the computational complexity of the R-D optimized mode decision is critical to successful application of H.264/AVC to real-time full high definition (HD) video applications. For that purpose we proposed a fast rate estimation, developed to quickly estimate the rate cost. To reduce the time for estimation of "rate", we proposed three simple, yet sufficiently accurate, models for three most time-consuming reference tables, i.e., coeff_token, total_zeros, and run_before tables, respectively. The rate estimation error obtained by the proposed simple model for the three tables were "zero" with about 80% probability. With fast rate estimation employed, we achieved R-D performance with only 0.001 dB increase of PSNR at 0.234% increase of the bit-rate. The total H.264 encoding with CAVLC using the proposed fast rate estimation scheme was reduced to 40% compared to that with actual CAVLC execution.