Lines Matching full:dispatch

36 	 * Order clearing SCHED_RESTART and list_empty_careful(&hctx->dispatch)  in __blk_mq_sched_restart()
38 * blk_mq_dispatch_rq_list(). So dispatch code won't see SCHED_RESTART, in __blk_mq_sched_restart()
39 * meantime new request added to hctx->dispatch is missed to check in in __blk_mq_sched_restart()
67 goto dispatch; in blk_mq_dispatch_hctx_list()
73 dispatch: in blk_mq_dispatch_hctx_list()
84 * Returns -EAGAIN if hctx->dispatch was found non-empty and run_work has to
109 if (!list_empty_careful(&hctx->dispatch)) { in __blk_mq_do_dispatch_sched()
124 * same queue and if we didn't dispatch then there's in __blk_mq_do_dispatch_sched()
163 * dispatch batching requests from same hctx at a time. in __blk_mq_do_dispatch_sched()
212 * Returns -EAGAIN if hctx->dispatch was found non-empty and run_work has to
226 if (!list_empty_careful(&hctx->dispatch)) { in blk_mq_do_dispatch_ctx()
244 * same queue and if we didn't dispatch then there's in blk_mq_do_dispatch_ctx()
261 /* round robin for fair dispatch */ in blk_mq_do_dispatch_ctx()
276 * If we have previous entries on our dispatch list, grab them first for in __blk_mq_sched_dispatch_requests()
277 * more fair dispatch. in __blk_mq_sched_dispatch_requests()
279 if (!list_empty_careful(&hctx->dispatch)) { in __blk_mq_sched_dispatch_requests()
281 if (!list_empty(&hctx->dispatch)) in __blk_mq_sched_dispatch_requests()
282 list_splice_init(&hctx->dispatch, &rq_list); in __blk_mq_sched_dispatch_requests()
288 * requests from the dispatch list. This is to avoid the case where in __blk_mq_sched_dispatch_requests()
289 * we only ever dispatch a fraction of the requests available because in __blk_mq_sched_dispatch_requests()
295 * We want to dispatch from the scheduler if there was nothing in __blk_mq_sched_dispatch_requests()
296 * on the dispatch list or we were able to dispatch from the in __blk_mq_sched_dispatch_requests()
297 * dispatch list. in __blk_mq_sched_dispatch_requests()
328 * A return of -EAGAIN is an indication that hctx->dispatch is not in blk_mq_sched_dispatch_requests()