There are actually two slightly different ways to delete an app on the Home screen on iPhone and ‌iPad‌. Press and hold the app for one second, then select the Remove App action from the pop-up menu.