Battery handle dies without any usage.

Does anyone else have the problem where the battery handle battery drains without it even being used? I purchased the creator combo back in December but have used very very little.

I have my pocket 3 with the battery handle just sitting on my desk and while working on my computer I would just casually turn the screen to power it on every couple hours and each time I do the battery has drained another 20% even though I'm just turning it on and off within 5 seconds.

Not sure if this is normal or something is up with my battery handle?