Not sure your specific configuration (and thus limitations for tools and such), but I've had a good experience taking a tiny punch and hammering a small river in the middle (to give the drill bit some amount of purchase to start), then drilling out the rivet.
Hope that's helpful!