Ethically Aligned Opportunistic Scheduling for Productive Laziness
Han Yu, Chunyan Miao, Yongqing Zheng, Lizhen Cui, Simon Fauvel and, Cyril Leung

TL;DR
This paper introduces a distributed scheduling approach that balances worker productivity and wellbeing by recommending personalized work-rest schedules, leading to ethically aligned and highly efficient workforce management.
Contribution
It proposes a novel Computational Productive Laziness (CPL) method that personalizes work-rest schedules using local data, promoting worker wellbeing and superlinear collective productivity.
Findings
Workers spend 70% effort to complete 90% tasks on average.
CPL outperforms existing scheduling approaches in ethical alignment.
Achieves superlinear productivity through opportunistic resting.
Abstract
In artificial intelligence (AI) mediated workforce management systems (e.g., crowdsourcing), long-term success depends on workers accomplishing tasks productively and resting well. This dual objective can be summarized by the concept of productive laziness. Existing scheduling approaches mostly focus on efficiency but overlook worker wellbeing through proper rest. In order to enable workforce management systems to follow the IEEE Ethically Aligned Design guidelines to prioritize worker wellbeing, we propose a distributed Computational Productive Laziness (CPL) approach in this paper. It intelligently recommends personalized work-rest schedules based on local data concerning a worker's capabilities and situational factors to incorporate opportunistic resting and achieve superlinear collective productivity without the need for explicit coordination messages. Extensive experiments based on…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Ethically Aligned Opportunistic Scheduling for Productive Laziness
Han Yu1,2,3, Chunyan Miao1,2,3, Yongqing Zheng4,5, Lizhen Cui4, Simon Fauvel2 and Cyril Leung6
1School of Computer Science and Engineering, Nanyang Technological University (NTU), Singapore
2Joint NTU-UBC Research Centre of Excellence in Active Living for the Elderly (LILY), NTU, Singapore
3Alibaba-NTU Singapore Joint Research Institute, Singapore
4School of Software Engineering, Shandong University, Jinan, Shandong, China
5Shanda Dareway Software Co. Ltd, Jinan, Shandong, China
6Department of Electrical and Computer Engineering, The University of British Columbia, Vancouver, BC, Canada
Corresponding Authors: [email protected], [email protected]
Abstract
In artificial intelligence (AI) mediated workforce management systems (e.g., crowdsourcing), long-term success depends on workers accomplishing tasks productively and resting well. This dual objective can be summarized by the concept of productive laziness. Existing scheduling approaches mostly focus on efficiency but overlook worker wellbeing through proper rest. In order to enable workforce management systems to follow the IEEE Ethically Aligned Design guidelines to prioritize worker wellbeing, we propose a distributed Computational Productive Laziness (CPL) approach in this paper. It intelligently recommends personalized work-rest schedules based on local data concerning a worker’s capabilities and situational factors to incorporate opportunistic resting and achieve superlinear collective productivity without the need for explicit coordination messages. Extensive experiments based on a real-world dataset of over 5,000 workers demonstrate that CPL enables workers to spend 70% of the effort to complete 90% of the tasks on average, providing more ethically aligned scheduling than existing approaches.
Introduction
In today’s world, artificial intelligence (AI) has been employed to manage large-scale workforces such as crowdsourcing systems (?; ?; ?). For example, in DiDi Chuxing, AI technologies are deployed to dynamically match drivers to tasks in order to enhance operation efficiency (?). Human workers become fatigued or bored over long sessions of work, which can cause inefficacy (?). A recent study found that short breaks significantly improve workers’ motivation while maintaining the quality of work (?). However, existing AI approaches for workforce management in crowdsourcing mostly do not explicitly incorporate rest into their recommendations (?).
From an ethically aligned design perspective (?), it is desirable to incorporate breaks into scheduling approaches in order to prioritize workers’ wellbeing. Nevertheless, as highlighted in (?), ethically aligned AI approaches need to be designed such that they balance the concern for human wellbeing while still achieve their design objectives. In this paper, we set out to address this challenge by proposing an ethically aligned opportunistic scheduling approach that can achieve “productive laziness” - Computational Productive Laziness (CPL).
Originally conceptualized in social sciences literature, productive laziness (?) is a rule-of-thumb guideline on how workers should approach their work in order to achieve work-life balance. The general idea is to work when you are highly efficient, and rest otherwise. CPL coordinates workers to work when situational factors induce high efficiency or demand working, and rest when they do not. Thus, it is important to identify factors influencing workers’ productivity and the urgency of work. We formulate the problem of achieving productive laziness in large-scale systems as a multi-objective constrained optimization problem. Following the Lyapunov optimization-based framework (?), we analyse the interaction dynamics involved in a workforce management system and derive a novel Work-Rest Index (WRI) which expresses the interplay among four aspects affecting worker effort output:
Situational factors: the current workload pending in each worker’s backlog, and how long they have been pending (as tracked by the system); 2. 2.
Worker performance: each worker’s productivity based on past observation data; 3. 3.
System-level preference: the emphasis, given by the system operators, on achieving high collective productivity compared to allowing for workers to be more rested; and 4. 4.
Personal preference: each worker’s mood at a given time which is used to infer the level of productivity that can be expected from the worker in the immediate future following the happy-productive worker thesis (?).
Based on this index, CPL dynamically determines the timing and amount of work a worker should perform in order to conserve the collective effort output while maintaining a high level of collective productivity in the system. It can be implemented in a distributed manner as a personal scheduling agent with a computational time complexity of . This enables it to effectively support the need for real-time scheduling for large-scale workforce management. CPL allows human values to be codified and algorithmically guide the recommendations by the scheduling agent to balance worker wellbeing and system throughput. Through extensive numerical experiments based on a large-scale real-world dataset containing over 5,000 workers’ performance characteristics, CPL is shown to significantly outperform alternative approaches, consistently achieving superlinear collective productivity (?).
Related Work
Existing AI-powered workforce management approaches (?) can be divided into two main categories: (1) the direct approaches and (2) the indirect approaches.
Some direct approaches seek to balance the division of labour among workers in a situation-aware manner through data-driven deliberation (?; ?; ?; ?; ?; ?; ?; ?). Others design reputation and/or incentive mechanisms to motivate workers to work harder (?; ?; ?; ?; ?; ?). They generally leave it up to the workers to plan their rest breaks. There are approaches which implicitly limit how long a worker can continuously work by setting a budget on the number of tasks they are allocated (?; ?). However, these approaches do not opportunistically take advantage of periods when a worker a highly productive (e.g., periods of good mood in our approach). Such ad hoc planning may not help the system maintain high collective productivity. With CPL, a desirable balance between worker wellbeing and collective productivity can be achieved.
Indirect approaches (?) seek to induce good mood among workers in order to improve their productivity. This is based on the happy-productive worker thesis (?), which suggests that good (bad) mood improves (hampers) productivity. They also do not explicitly recommend resting to workers.
A recent work (?) is starting to explore how to opportunistically schedule rest. However, it does not account for how long tasks have been pending in workers’ backlog and can lead to schedules which do not make business sense. Without considering the urgency of the tasks, it is vulnerable to workers misreporting their mood. With the conceptual queue technique developed in this paper, CPL considers workers’ wellbeing, system objectives and situational factors in a more holistic manner, and is better able to deal with misbehaving workers trying to game the system.
The Proposed CPL Scheduling Approach
The system model in this paper consists of a set of workers and a set of tasks at any given time slot .
- •
Workers are associated with personal profiles. Each profile contains information on a worker ’s task backlog queue and his maximum productivity which indicates the maximum workload he can complete in a given time slot . The granularity of can be adjusted to fit any given system’s requirements. The ground truth of may not be directly observable. With analytics tools such as Turkalytics (?), it can be tracked and estimated statistically.
- •
Tasks are associated with task profiles. The most important information for our purpose is the task deadline which is expressed in terms of number of time slots since task creation before which a given task must be completed.
The number of workers and tasks available in a given system at different time slots may differ.
We model the dynamics of a worker ’s task backlog queue following previous research (?; ?):
[TABLE]
where is the number of new tasks delegated to worker during time slot ; and is the number of tasks completed by worker during time slot . Based on the ‘happy-productive worker’ thesis which suggests that productivity is positively correlated to mood (?), can be expressed as a function of ’s current mood and how much effort he spends on the tasks:
[TABLE]
where is the normalized effort worker spends during time slot . is worker ’s mood during time slot , where 1 denotes the most positive mood. It can be self-reported by a worker using tools such as MoodPanda (http://moodpanda.com/), or through facial image analytics (e.g., in-vehicle monitoring of drivers’ mood (?)). Here, we treat as an external parameter to CPL and do not assume that the system is capable of predicting future mood values.
Deriving the Work-Rest Index
In order to take task pending time into account, we propose a conceptual queue technique. Let denote a conceptual queue which is being managed by a CPL agent on behalf of a worker . The queuing dynamics of this conceptual queue is defined as:
[TABLE]
where is an indicator function. Its value is 1 if and only if [condition] is satisfied; otherwise, it evaluates to 0. When first created, a conceptual queue is empty. The conceptual queue starts from 0 at (i.e. ). Its size increases by if and only if worker ’s pending task queue is not empty at time slot and worker rests during this time slot. Its size decreases in the same way as .
For simplicity of notation, we denote as . Then, equation (3) can be re-expressed as:
[TABLE]
By re-arranging the above inequality, we have:
[TABLE]
Summing both sides of the above inequality over all yields:
[TABLE]
Thus, we have:
[TABLE]
Since , the above inequality is simplified as:
[TABLE]
From equation (8), it can be observed that the effect of the conceptual queue is to signal the scheduling approach as to when the need to reduce pending workload shall take precedence over helping workers plan their rest. By ensuring that the computed values satisfy the queueing stability requirement of for the conceptual queue, a scheduling approach will ensure that tasks do not stay pending indefinitely.
By jointly considering and , the Lyapunov function (?) which measures the overall concentration of work among workers in a given system during time slot is:
[TABLE]
A large value of indicates that tasks are highly concentrated among a small number of workers and/or that tasks have been pending for a long period of time. Both of these scenarios are undesirable from a system productivity perspective and shall be avoided as much as possible. The constant term is included to simplify subsequent derivations without affecting the physical meaning of the formulation. We adopt the time-averaged Lyapunov drift, , to measure the changes in the degree of seriousness of these two scenarios over time.
We formulate a joint {effort output + drift} optimization objective function as:
[TABLE]
which shall be minimized. controls the emphasis placed on conserving worker effort compared to getting more work done. A larger value can be interpreted as stronger emphasis on allowing workers to rest more. This value can be set by the system operators to express system-level preference on how to utilize the collective productivity of the workers. , and are vectors containing the workers’ effort output values, the backlog queue sizes, and the self-reported mood during time slot , respectively.
Based on equation (1) and equation (9), the time-averaged Lyapunov drift can be expressed as:
[TABLE]
This formulation enables simultaneous modelling of the absolute sizes of the real and the conceptual queues, the distribution of congestions among these queues, and the fluctuations of these queues over time. All three quantities should be minimized in order to optimize our design objectives. In this way, we translate system-level efficiency and worker wellbeing requirements into queueing system stability concepts. Then, through maintaining queue system stability, CPL achieves these desirable objectives.
Since neither nor can be infinite in real-world systems, we can simplify as:
[TABLE]
where and for all and are constant values. As we only aim to influence with recommendations, we only retain terms containing . In this way, by substituting equation (12) into equation (10), we obtain the following objective function:
Minimize:
[TABLE]
Subject to:
[TABLE]
[TABLE]
By minimizing equation (13) subject to Constraints (14) and (15), we simultaneously minimize the time-averaged total worker effort output while maximizing the time-averaged collective productivity in a given system. To minimize equation (13), at each time slot , we need to compute the values of the expression for all . For simplicity of notation, we denote as the Work-Rest Index (WRI), . This index enables a scheduling agent to efficiently search through a very large solution space to determine if the current situation is more suitable for work or rest.
Opportunistic Work-Rest Scheduling
Algorithm 1 presents a distributed implementation of the CPL approach as a scheduling agent for each worker. For a worker , if , it sets and computes the corresponding value; otherwise, it advises the worker to rest for the current time slot. The computational time complexity of Algorithm 1 is , making it highly scalable. The algorithm implements computationally the intuition that the more pending tasks in a worker’s backlog queue, the longer these tasks have been pending, the more emphasis on worker wellbeing by system operators, and the higher the worker’s current mood, the more effort should be expended towards completing tasks (subject to the physical limitations of the worker’s effort output per time slot).
WRI incorporates the ethical considerations (?) by prioritizing worker wellbeing considerations through recommending opportunistic rest breaks, and allowing stakeholders to influence the AI recommendations by expressing their preferences through and . The recommendations from CPL are given to a worker in the form of the number of tasks he should complete over a given time slot (a 0 value indicates that the worker should rest) so as to make it actionable enough for the worker to follow.
Experimental Evaluation
To evaluate the performance of CPL under realistic settings, we compare it against four alternative approaches through extensive simulations. The characteristics of worker agents in the simulation are derived from the Tianchi dataset (http://dx.doi.org/10.7303/syn7373599) released by Alibaba. This real-world dataset contains information regarding 5,547 workers’ reputation (i.e. quality of work) and maximum productivity (i.e. the maximum number of tasks a worker can complete per time slot). This dataset allows us to construct realistic simulations.
Experiment Settings
The five comparison approaches are:
The Max Effort (ME) approach: under this approach, a worker agent always works as long as there are tasks in its backlog queue regardless of its mood. 2. 2.
The Mood Threshold (MT) approach: under this approach, a worker agent works whenever and there are tasks in its backlog queue, where is a predetermined mood threshold used by MT. 3. 3.
The Mood and Workload threshold (MW) approach: this approach jointly considers a worker agent ’s current mood and workload to determine how much effort to exert. Whenever , worker exerts up to the maximum effort subject to there being enough tasks in its backlog queue, where is a predetermined mood threshold used by MW. 4. 4.
The Affective Crowdsourcing (AC) approach (?) which is similar to CPL but does not take task pending time into account. 5. 5.
The CPL approach proposed in this paper.
The approach used to delegate tasks to worker agents under all comparison approaches is SMVM (?). It dynamically distributes tasks among workers in a situation-aware manner in order to avoid over concentration of workload. At each time slot, SMVM determines how many tasks to delegate to each worker agent in the simulations (i.e. SMVM computes for all and ) based on its current reputation and workload. The principle implemented by SMVM is that the higher a worker agent’s reputation and the lower its current workload, the more tasks should be delegated to it. SMVM can be replaced by any other approach (?; ?) as long as such an approach can determine the values of for all and .
In order to create different experiment conditions, we vary the value of between 5 and 100 in increments of 5. The values of and are varied between 0.05 and 1 in increments of 0.05. The system workload is measured in relation to the maximum collective productivity of the worker agent population, . In this equation, is a worker agent ’s reputation and . We adopt the concept of load factor (LF) from (?; ?) to denote the overall workload placed on the system. It is computed as the ratio between the number of new tasks delegated to the worker agents during time slot , , and the maximum collective productivity of the system (i.e. ). We vary LF between 5% to 100% in 5% increments.
Throughout the experiments, the mood for each worker agent during time slot , , is randomly generated in the range of following a uniform distribution. This eliminates the possibility for any of the comparison approaches to predict a worker agent’s future mood based on previous observations, thereby focusing the experimental comparisons on the effectiveness of the scheduling strategies. Under each LF setting, the simulation is run for time slots. All tasks must be completed within 3 time slots after they have been delegated.
Evaluation Metrics
The performances of the five approaches in the experiments are compared using the following metrics:
The time-averaged worker effort output, . The smaller the value, the better the performance of an approach. 2. 2.
The time-averaged task expiry rate, , where is the number of tasks in ’s backlog which passed their deadlines during a given time slot . The smaller the value, the better the performance of an approach. 3. 3.
The time-averaged task completion rate, , where is the total number of tasks waiting to be completed in the system during a given time slot . The larger the value, the better the performance of an approach.
Since worker agents under the ME approach consistently expend the most effort and achieve the highest task completion rate, we use ME as the baseline for comparing the performance of other approaches under different LF, , , and settings.
Results and Discussions
Figures 1(a)–1(d) show the time-averaged task expiry rates achieved by MT, MW, AC and CPL respectively under various experiment settings. As MT uses mood as the threshold to control worker effort output, the changes in task expiry are directly related to mood values (Figure 1(a)). On average, 29% of the tasks under MT expire before they can be completed. MW is also a threshold-based approach. However, its threshold consists of a combination of workers’ mood and their current workload. Thus, its task expiry rate increases with both mood and LF with the effect of mood being more significant (Figure 1(b)). On average, 30% of the tasks under MW expire before they can be completed. AC is not a threshold-based scheduling approach. A worker can indicate to AC his desire to rest by adjusting the value of the control variable . As and LF values increase, an increasing percentage of tasks expire under AC. On average, 7.5% of the tasks under AC expire before they can be completed, which is significantly lower than MT and MW. As AC only considers mood and workload when making work-rest recommendations, workers may fall into the condition in which their mood and workload trigger AC to recommend resting. However, their workload is also not low enough to cause the task delegation approach to delegate new tasks to them. Therefore, AC continues to recommend resting until pending tasks pass their deadlines and become expired. This problem is addressed by CPL as it takes task pending time into account with the conceptual queue technique when optimizing work-rest scheduling. As shown in Figure 1(d), increases in and LF values result in an increasing percentage of tasks expire under CPL. The task expiry rate under CPL is lower than that under AC. On average, 5.4% of the tasks under CPL expire before they can be completed, which is significantly lower than MT, MW and AC considering the scale of the experiment.
The time-averaged effort output achieved by all five approaches is shown in Figure 1(e). Compared to ME, all other approaches achieved significant savings in effort as LF increases. This is partially due to the SMVM task delegation approach used in the simulations. When LF is low, tasks are mostly concentrated on worker agents with good reputation. In this case, the task backlogs of individual worker agents who have been delegated tasks tend to be relatively high, which makes scheduling approaches allocate less time for these workers to rest in order to meet task deadlines. As LF increases, the workload is spread more evenly among a larger segment of the worker agent population, creating more opportunities for scheduling approaches to slot in rest breaks. The values achieved by MT, MW and AC stabilize between 20% and 40% while that of CPL stabilizes around 60%. MW achieves the lowest worker agent effort output. The time-averaged task completion rates achieved by all five approaches are shown in Figure 1(f). It can be observed that CPL achieves the highest values which stabilize around 85% and are higher than AC, MT and MW by 22%, 90% and 108%, respectively.
Figure 1(g) shows the performance landscape of MT, MW, AC and CPL as a percentage of ME under different control parameter settings. MW and MT both use mood thresholds ( and , respectively) to control effort output. The higher the mood threshold values, the lower the effort output (and hence the task completion rates) achieved by MW and MT. On the other hand, mood serves as one of the inputs to AC and CPL. Both AC and CPL allow a worker agent to specify a general emphasis on conserving effort using variables and , respectively. The larger the values of these variables, the more emphasis is placed on effort conservation. By varying the value in CPL, we can control the trade-off between worker effort output and task completion rate (from spending 92% of the ME effort output and achieving 99% of the ME task completion rate, to spending 53% of the ME effort output and achieving 78% of the ME task completion rate). CPL consistently and significantly outperforms both MT and MW, conserving significant worker effort while achieving high task throughput. In effect, CPL limits the range of trade-off between work and rest achieved by AC based on consideration of an additional situational factor – the task pending time – in order to achieve better collective performance. In the worst case scenario in which and are set to 1, indicating that workers are unwilling to work under any mood condition, the worker effort output and the task completion rates achieved by both MT and MW are 0. This is expected as in MT and MW, mood is used as the threshold to control effort output. However, under AC, mood is only one of the situational factors considered by the approach. CPL adds in task pending time on top of the situational factors used by AC to make scheduling decisions. Even under scenarios in which is set to 100 (indicating that workers place very high emphasis on rest), CPL is still able to maintain a long-term average effort output of 53% taking advantage of favourable working conditions whenever possible to achieve average task completion rates of about 78%. This is more advantageous from a business perspective compared to the worst case performance by AC of about 50%.
When we compute the averages of the results shown in Figure 1(g) over their respective setting variables (i.e. , , and ), we obtain Figure 1(h) showing the overview of their performances. The diagonal dotted line represents linear productivity, meaning that an increase in effort output results in a directly proportional increase in collective productivity. It can be observed that ME, MT and MW all fall on the linear productivity line, whereas AC and CPL are significantly above this line in a region of superlinear productivity (?). Under AC and CPL, an increase in effort output results in a disproportionally larger increase in collective productivity, indicating that the collective productivity achieved is larger than the sum of individual workers’ productivity. Overall, CPL achieves 89% of ME task completion rate with 69% of the ME worker effort output, which is the most desirable work-rest trade-off among the five approaches from a system perspective.
Conclusions and Future Work
Improving collective productivity is an important problem facing many social and economic systems. How to dynamically adapt workers’ work-rest schedules in response to changing situations in order to maintain a high level of productivity and worker wellbeing remains an open research question. The proposed CPL approach translates considerations on workers’ mood, workload and pending time of the tasks in their backlogs into actionable personalized work-rest schedules. It establishes a framework to model complex relationships between work and rest, and helps workers optimize the balance between work and rest in order to achieve superlinear collective productivity. Taking into account its polynomial time complexity, CPL is an effective and scalable approach to help workers benefit from opportunistic rest. By nudging workers to be ‘lazy’ at opportune times, CPL achieves collective productivity which is larger than the sum of individual productivity. It provides a way to design ethically aligned workforce management systems that sustain long-term effective participation by promoting productive laziness among workers.
In future research, we plan to testbed CPL in a crowdsourcing platform (?) to reach out to more diverse users and study how to improve the approach in the presence of various behaviour patterns and how to foster trust (?) with user by explaining the rationale behind the recommendations.
Acknowledgments
This research is supported, in part, by Nanyang Technological University, Nanyang Assistant Professorship (NAP) and the National Research Foundation, Prime Minister’s Office, Singapore under its IDM Futures Funding Initiative.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[Basu Roy et al . 2015] Basu Roy, S.; Lykourentzou, I.; Thirumuruganathan, S.; Amer-Yahia, S.; and Das, G. 2015. Task assignment optimization in knowledge-intensive crowdsourcing. VLDB Journal 24(4):467–491.
- 2[Chai et al . 2017] Chai, Y.; Miao, C.; Sun, B.; Zheng, Y.; and Li, Q. 2017. Crowd science and engineering: concept and research framework. International Journal of Crowd Science 1(1):2–8.
- 3[Chen et al . 2015] Chen, C.; Cheng, S.-F.; Lau, H. C.; and Misra, A. 2015. Towards city-scale mobile crowdsourcing: Task recommendations under trajectory uncertainties. In IJCAI , 1113–1119.
- 4[Dai et al . 2013] Dai, P.; Lin, C. H.; Mausam; and Weld, D. S. 2013. POMDP-based control of workflows for crowdsourcing. Artificial Intelligence 202:52–85.
- 5[Dai et al . 2015] Dai, P.; Rzeszotarski, J. M.; Paritosh, P.; and Chi, E. H. 2015. And now for something completely different: Improving crowdsourcing workflows with micro-diversions. In CSCW , 628–638.
- 6[Grossmann, Brienza, and Bobocel 2017] Grossmann, I.; Brienza, J. P.; and Bobocel, D. R. 2017. Wise deliberation sustains cooperation. Nature Human Behaviour 1(0061):doi:10.1038/s 41562–017–0061.
- 7[Heymann and Garcia-Molina 2011] Heymann, P., and Garcia-Molina, H. 2011. Turkalytics: Analytics for human computation. In WWW , 477–486.
- 8[Ho, Jabbari, and Vaughan 2013] Ho, C.-J.; Jabbari, S.; and Vaughan, J. W. 2013. Adaptive task assignment for crowdsourced classification. In ICML , I–534–I–542.
