Break from Mini-pill when should I restart

I was advised by my doctor to have a small break (3-7days) since I was bleeding nearly every week from my mini pill. She said to allow myself to bleed fully before going back onto the pill. I’ve now been off the pill for 4 days and have no sign of bleeding, can I go back onto the pill or do I have to wait for my period however long that may be before going back onto the pill. I’m pretty sure I’m not pregnant as I was very strict about taking my pill had it on an alarm on my phone and never missed it.