this is a workaround to the fact that readwise use cursor pagination instead of offset pagination, proper handling will be added later
also refactor a little the worker pool