Cache avatar (by user id) for 10 minutes at ui side after it is queried at the first time.

Remove the cached one instantly for the current user once he changed it in settings.