You need the app, because that's how you add podcasts and also you can use it to verify your Overcast account if you don't want to give them your email address, but once you do the initial verification for Sync you can indeed brows to overcast.fm, view your podcasts, and listen to episodes from there. You can also listen to partially listened to episodes from device to device.
@acarson Yes I have the app already, just haven’t used it in a while.