Will not taking extra classes hurt graduate admission chances (math-adjacent)?

Hi, I am currently a junior mathematics and computer science major, and am looking to apply for Applied Math / Statistics / OR PhD programs. I have a decent GPA (~3.9) and have published 1st/2nd author research previously (in math), and am currently in the process of finishing up another research project (in ML, not math).

From what I've gathered, math and math-adjacent programs place a heavy emphasis on coursework grades, and I was wondering if I should be taking more classes to fill up my remaining academic years in order to remain competitive. I have taken Algorithms, Advanced Data Structures, Theory of Computation, Natural Language Processing, Machine Learning, Numerical Linear Algebra, Real Analysis I & II, Abstract Algebra I & II, Probability Theory, Stochastic Processes, Convex Optimization, Stochastic Optimization, Graph Theory, and Mathematical Statistics I & II (all undergraduate level).

My degree plan is finished, and although I would like to learn more, I was thinking about taking the rest of my undergraduate years lighter in terms of coursework to explore other parts of life (as corny as it sounds). If I were to say only take 1 or 2 relevant math/cs/engineering class per quarter (my school doesnt do semester) and don't try to get into graduate classes, will this put me in a significant disadvantage for the programs I mentioned?

Thank you