Some say the Egyptians didn't build the pyramids??

Heard the Egyptians just moved in and digged holes in the monuments but not actually build them because of the lack of evidence of how they build these structures.