Ok I gave up WP8.1 as it seems to always having a problem in app resume.
I just ported my WP8.1 game to UWP… everything works flawlessly besides app resume is instant like my Android.
I’m decided to deprecate my WP8.1 and Win8 project for UWP moving forward.
Cheers!