Observability is a budget

You can afford to log everything until you cannot. Decide the budget before the bill arrives. Sampling is not a failure, it is the answer.