For walking around travel photography I currently prefer to go as light as possible. I have a Pixel 6a and a Canon G5X II. The G5X is a 1" sensor, 24-100mm equivalent. I find it much more usable than the Sony RX 100s.
The main limitation for me with the 1" sensor cameras is the lack of anything wider than 24mm equivalent. The advantages compared to the 6a are DOF and shutter speed control and higher resolution, all of which are less of an issue than I anticipated, and much better ergonomics. The advantages of the 6a are an ultrawide lens, bigger screen, on device editing and computational photography. The phone is very good at low light photography and it's much easier than taking a burst and combining later in software, carrying a tripod (not allowed in many places) or a large aperture lens (especially if I want deeper DOF). I'm using the phone more and more.
It helps that essentially everything I photograph is a static subject that doesn't need shutter speed or DOF control.
For these purposes, I don't see any real advantage to a larger sensor or carrying more gear, so I'm with you.