Coffee shops are different from cafes
Cannabis is legal (with some limits) in The Netherlands, and many travelers flock to Amsterdam only to experience some of the local, uh, specialties. Keep in mind that cannabis is prohibited in the Netherlands unless it is purchased and used on-site at a coffee shop.
Also, don't assume that all cities follow Amsterdam's policies. Some towns, particularly those close the German and Belgian borders, have enacted legislation prohibiting non-residents of the Netherlands from purchasing cannabis at their coffee shops. It's probable that similar policies will be implemented across the country soon.
If all you want is a cup of coffee and a slice of banana bread, stay away from the coffee shops; those brownies aren't the type you're searching for. Instead, seek out a cafe to satisfy your hot chocolate craving.