It would be more accurate to say that physics is the fundamental science, and all other sciences are built on it.
I would say is a good explanation. I've always though of it as: physics is applied math, chemistry is a subset of physics, biology is a subset of chemistry. I feel that since physics is the closest to math, it is the most "pure".