Task cache as non root user

When running a task as user: botbot, I can not use cache: ... as part of that task, since the cache dir is owned by root, with other not being writable. Is this a limitation or can I somehow set the ownership of the cache dir beforehands? The https://concourse-ci.org/tasks.html#caches does not state such an option.