Concrete is strong not only because of the cement paste but also because of the relatively inert fine and coarse aggregates that is binded together to form concrete. Aggregates are not only cheaper but it also give greater volume stability and durability to concrete.
Aggregates are used to provide bulk to concrete. Concrete is made using two types of sizes to increase density: fine and coarse. Fine aggregates fill up the voids left by the coarse aggregates in concrete. It also helps in providing workability in wet concrete. Other than that it provides uniformity in the concrete mixture. The resultant effect is enhanced plasticity in the concrete mix. It also prevent segregation of cement paste and coarse aggregates. This is particularly important when the delivery point is some distance away from the batching plant.