[mothered]

unfortunately the delivery man has to scan the tracking number before handing over the package, which makes it essential and Apple can still track me

As said, that's the way almost every major carrier operates.

Always do your research prior to the SE. Never assume otherwise.