We discuss several basic number-theoretic problems such as, for instance, solving polynomial equations and finding best rational approximations. It is difficult and sometimes impossible to solve these problems explicitly, but it turns out that they are related to certain chaotic dynamical systems. We explain how to use these ideas to shed some light on statistical properties of solutions. In this talk we will take a journey through Number Theory, Statistical Physics, the Theory of Dynamical Systems and back.