Here’s a really simple rule of thumb:
Which devices in your home do you reply upon to keep the place warm? They will be your primary energy consumption. And given the limited efficiency of cooling devices the same reasoning applies for those.
No devices are entirely efficient and in most cases are constrained by thermodynamics such that they will never be entirely efficient. Hence heat is generated.
On the day you’re struggling to keep your place cool because of all the phone chargers that you have plugged in, then you have a problem.
I would respectfully submit that most people are several orders of magnitude away from that.