I've been told this is functioning properly, but I have 2 reasons why I believe it's broken:

Reason 1:

In the users section there are only 2 options for data visibility: "All Records" or "Only Assigned Data".

If they are the latter, they can only see contacts and opportunities that they are assigned OR following.

You are suggesting that doesn't apply to tasks for those objects.

A contact can only have one assigned user, but that assigned user is not always the one doing the task. We delegate certain tasks to specific teams/users - just like any business. You are suggesting that this task system isn't designed for Delegation. Which I believe is a downgrade from the previous tasks UI.

Reason 2:

The grey circles that appear to unassigned users are still links that the user can click and be taken to the correct record. If they are a follower, they can see all the information for the contact. Including the tasks view, showing the task they are assigned.

If they can see the task and all details in a contact that they are following, why shouldn't they be able to see it from the tasks view?

PROBLEM:

In order for my users to see the tasks in full view, I have to change their data visibility to "All Records" which is not ideal when we have certain privacy policies that need to outline who has access to certain data.