... the true objective function after it obtains new observations. In this work, we improve the exploitation of TS by incorporating the ε -greedy policy, a well-established selection strategy in reinforcement learning. We first delineate two extremes of TS, namely the generic TS and the sample-average TS...