I don’t know how many others from Baltimore are here. Like with most places in any city, consistency can be up or down, so I’ll try and give recommendations close to where you’ll be. That way, even if it’s disappointing, at least you didn’t have to travel too far.
Atwater’s is still my favorite bakery in Baltimore, but it’s more because my location is the perfect all-around neighborhood bakery (along with other “feel good” reasons.) Truthfully, they are very inconsistent since they factory-fied their operation and opened many new locations. One such location is in Canton. The Canton location serves their own ice cream, too (might be seasonal.) In order, my safest items are: carrot cake, cheesecake, muffin. (Of course the cheesecake I purchased from them this weekend was underbaked.) You might not be as picky.
In Fells Point not too far from you is a new-ish bakery, Pitango Bakery + Cafe. I haven’t been in half a year, but it was very different, yet still good, similar to Pitango’s nearby gelato shop (meaning the gelato is also different yet good). It is expensive, however, so their off days feel worse than they probably are. I haven’t visited enough to make safe recommendations.
If you make your way to Fells Point, the tacos you refer to were probably from Tortilleria Sinaloa. They make their own corn tortillas every morning. They also fry those tortillas into chips. I go here just to stock up on the chips.
Not far from there is Patisserie Poupon, which has my favorite chocolate chip cookie. (The oatmeal cookie is great, too.) You will see lots of recommendations for their croissants and Frasier cake. I can’t recommend either. The pastry case looks enticing, but turnover is the issue here. Same goes for the macarons. Go for the non-croissant items that are made daily: chocolate souffle (like a muffin), kouign aman, puff pastry with caramelized onion/olives, madeline. Brioche is good, but too expensive.
If you visit any of these, please let us know what you think. Have a safe trip.