Finite Order Entropy Rate Estimation for Multibit Strong PUF Classes

Finite Order Entropy Rate Estimation for Multibit Strong PUF Classes based on Minimax estimators Center Dirichlet Mixture (CDM) estimator and other entropy estimators, including the MLE, JVHW, WY, and the approximate Profile Maximum Likelihood (PML). This work is used by Bendary, Ahmed, et al. "Estimating the Unpredictability of Multi-Bit Strong PUF Classes." Cryptology ePrint Archive (2024). E. W. Archer, I. M. Park, and J. W. Pillow, “Bayesian Entropy Estimation for Binary Spike Train Data Using Parametric Prior Knowledge,” in Advances in Neural Information Processing Systems 26, C. J. C. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K. Q. Weinberger, Eds. Curran Associates, Inc., 2013, pp. 1700–1708. J. Jiao, K. Venkat, Y. Han, and T. Weissman, “Minimax Estimation of Functionals of Discrete Distributions,” IEEE Transactions on Information Theory, vol. 61, no. 5, pp. 2835–2885, 2015. Y. Wu and P. Yang, “Minimax Rates of Entropy Estimation on Large Alphabets via Best Polynomial Approximation,” IEEE Transactions on Information Theory, vol. 62, no. 6, pp. 3702–3720, 2016. D. S. Pavlichin, J. Jiao, and T. Weissman, “Approximate Profile Maximum Likelihood,” J. Mach. Learn. Res., vol. 20, pp. 122:1 122:55, 2019.