As someone who didn't use credit cards during my first two years of living abroad, I learned to withdraw a certain amount of cash each week with my debit card — and I stuck to that amount. This way, I'd avoid extraneous ATM fees each time I used one that was out-of-network, which was 100% of the time.
Otherwise, I'm charged hefty foreign transaction fees — which add up fast — such as 3% with every purchase when using Chase's Freedom debit card. So now, I use my debit card and visit ATMs as little as possible while continuing to pay in cash as often as possible.
In addition, certain cities tend be cash-only more than others. For instance, I was surprised how many restaurants didn't accept cards in Berlin, whereas it's the norm in Reykjavik. Also, if you find yourself at street fairs and farmers' markets, or negotiating housing, having the country's currency on hand will be to your advantage.
However, if you do use credit and debit cards on your trip, make sure the one you're using doesn't charge foreign transaction fees. For instance, Charles Schwab's Bank Visa Platinum debit card is a good option. Plus, the company will reimburse you for any ATM fees that were not in your network.
Rewards credit cards like the Chase Sapphire Reserve credit card are also optimal for traveling.