It depends on your understanding of abstract mathematics.

Everything in the universe is a "pattern". Patterns are by definition mathematical in essence. Therefore, everything in the Universe has a mathematical aspect to it.

As Tegmark observes: "Most scientists recognize some mathematical properties to the universe. I recognize only mathematical properties.

This concept was originally developed by Eugene Wigner.

https://en.wikipedia.org/wiki/The_Unreasonable_Effectiveness_of_Mathematics_in_the_Natural_Sciences
In a world where evolution is the self-organization and increasing complexity of patterns among relational values , what is the objection to the concept of mathematics as being an essential aspect to the universal fabric?

The common misconception is that therefore mathematics must be causal, but that is a false dichotomy.

Mathematics are not causal but are "guiding equations" by which reality is or is not allowed to express itself.