When 'Offline use' is disabled via site configuration (disabled features), you can still see the 'Download' inside the activity information menu. So we could disable that button or directly not show it.