Vlastimil Babka 23771235bb mm, page_alloc: don't retry initial attempt in slowpath ... After __alloc_pages_slowpath() sets up new alloc_flags and wakes up kswapd, it first tries get_page_from_freelist() with the new alloc_flags, as it may succeed e.g. due to using min watermark instead of low watermark. It makes sense to to do this attempt before adjusting zonelist based on alloc_flags/gfp_mask, as it's still relatively a fast path if we just wake up kswapd and successfully allocate. This patch therefore moves the initial attempt above the retry label and reorganizes a bit the part below the retry label. We still have to attempt get_page_from_freelist() on each retry, as some allocations cannot do that as part of direct reclaim or compaction, and yet are not allowed to fail (even though they do a WARN_ON_ONCE() and thus should not exist). We can reuse the call meant for ALLOC_NO_WATERMARKS attempt and just set alloc_flags to ALLOC_NO_WATERMARKS if the context allows it. As a side-effect, the attempts from direct reclaim/compaction will also no longer obey watermarks once this is set, but there's little harm in that. Kswapd wakeups are also done on each retry to be safe from potential races resulting in kswapd going to sleep while a process (that may not be able to reclaim by itself) is still looping. Link: http://lkml.kernel.org/r/20160721073614.24395-4-vbabka@suse.cz Signed-off-by: Vlastimil Babka <vbabka@suse.cz> Acked-by: Michal Hocko <mhocko@suse.com> Acked-by: Mel Gorman <mgorman@techsingularity.net> Acked-by: David Rientjes <rientjes@google.com> Signed-off-by: Andrew Morton <akpm@linux-foundation.org> Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>		2016-07-28 16:07:41 -07:00
..
kasan	mm, kasan: switch SLUB to stackdepot, enable memory quarantine for SLUB	2016-07-28 16:07:41 -07:00
backing-dev.c	mm, vmscan: move LRU lists to node	2016-07-28 16:07:41 -07:00
balloon_compaction.c	mm: balloon: use general non-lru movable page feature	2016-07-26 16:19:19 -07:00
bootmem.c
cleancache.c
cma.c	mm/cma: silence warnings due to max() usage	2016-05-27 14:49:37 -07:00
cma.h
cma_debug.c
compaction.c	mm, compaction: don't isolate PageWriteback pages in MIGRATE_SYNC_LIGHT mode	2016-07-28 16:07:41 -07:00
debug.c
debug_page_ref.c
dmapool.c
early_ioremap.c
fadvise.c	mm/fadvise.c: do not discard partial pages with POSIX_FADV_DONTNEED	2016-06-09 14:23:11 -07:00
failslab.c
filemap.c	mm: move most file-based accounting to the node	2016-07-28 16:07:41 -07:00
frame_vector.c
frontswap.c	mm, frontswap: convert frontswap_enabled to static key	2016-07-26 16:19:19 -07:00
gup.c	thp: file pages support for split_huge_page()	2016-07-26 16:19:19 -07:00
highmem.c	mm/highmem: make nr_free_highpages() handles all highmem zones by itself	2016-05-19 19:12:14 -07:00
huge_memory.c	mm, THP: clean up return value of madvise_free_huge_pmd	2016-07-28 16:07:41 -07:00
hugetlb.c	mm: hwpoison: remove incorrect comments	2016-07-28 16:07:41 -07:00
hugetlb_cgroup.c	mm, hugetlb_cgroup: round limit_in_bytes down to hugepage size	2016-05-20 17:58:30 -07:00
hwpoison-inject.c
init-mm.c
internal.h	mm, page_alloc: remove fair zone allocation policy	2016-07-28 16:07:41 -07:00
interval_tree.c
Kconfig	mm: CONFIG_ZONE_DEVICE stop depending on CONFIG_EXPERT	2016-07-28 16:07:41 -07:00
Kconfig.debug
khugepaged.c	mm: convert zone_reclaim to node_reclaim	2016-07-28 16:07:41 -07:00
kmemcheck.c
kmemleak-test.c
kmemleak.c	kmemleak: don't hang if user disables scanning early	2016-07-28 16:07:41 -07:00
ksm.c	mm: do not pass mm_struct into handle_mm_fault	2016-07-26 16:19:19 -07:00
list_lru.c
maccess.c	x86: remove more uaccess_32.h complexity	2016-05-22 17:21:27 -07:00
madvise.c	mm: make mmap_sem for write waits killable for mm syscalls	2016-05-23 17:04:14 -07:00
Makefile	thp: extract khugepaged from mm/huge_memory.c	2016-07-26 16:19:19 -07:00
memblock.c	mm/memblock.c: fix index adjustment error in __next_mem_range_rev()	2016-07-28 16:07:41 -07:00
memcontrol.c	mm: fix memcg stack accounting for sub-page stacks	2016-07-28 16:07:41 -07:00
memory-failure.c	mm: hwpoison: remove incorrect comments	2016-07-28 16:07:41 -07:00
memory.c	thp: introduce CONFIG_TRANSPARENT_HUGE_PAGECACHE	2016-07-26 16:19:19 -07:00
memory_hotplug.c	mem-hotplug: alloc new page from a nearest neighbor node when mem-offline	2016-07-28 16:07:41 -07:00
mempolicy.c	mm, vmscan: move LRU lists to node	2016-07-28 16:07:41 -07:00
mempool.c	Revert "mm, mempool: only set __GFP_NOMEMALLOC if there are free elements"	2016-07-28 16:07:41 -07:00
memtest.c
migrate.c	mm: remove reclaim and compaction retry approximations	2016-07-28 16:07:41 -07:00
mincore.c	mm, fs: remove remaining PAGE_CACHE_* and page_cache_{get,release} usage	2016-04-04 10:41:08 -07:00
mlock.c	mm, vmscan: move LRU lists to node	2016-07-28 16:07:41 -07:00
mm_init.c
mmap.c	mm: fix use-after-free if memory allocation failed in vma_adjust()	2016-07-28 16:07:41 -07:00
mmu_context.c	mm/mmu_context, sched/core: Fix mmu_context.h assumption	2016-04-28 11:44:19 +02:00
mmu_notifier.c
mmzone.c	mm, page_alloc: inline the fast path of the zonelist iterator	2016-05-19 19:12:14 -07:00
mprotect.c	mm: thp: check pmd_trans_unstable() after split_huge_pmd()	2016-07-26 16:19:19 -07:00
mremap.c	mm: thp: check pmd_trans_unstable() after split_huge_pmd()	2016-07-26 16:19:19 -07:00
msync.c
nobootmem.c
nommu.c	mm: introduce fault_env	2016-07-26 16:19:19 -07:00
oom_kill.c	mm, oom: tighten task_will_free_mem() locking	2016-07-28 16:07:41 -07:00
page-writeback.c	mm: remove reclaim and compaction retry approximations	2016-07-28 16:07:41 -07:00
page_alloc.c	mm, page_alloc: don't retry initial attempt in slowpath	2016-07-28 16:07:41 -07:00
page_counter.c
page_ext.c	mm: use early_pfn_to_nid in page_ext_init	2016-05-27 14:49:37 -07:00
page_idle.c	mm, vmscan: move lru_lock to the node	2016-07-28 16:07:41 -07:00
page_io.c	mm: add cond_resched() to generic_swapfile_activate()	2016-07-28 16:07:41 -07:00
page_isolation.c	mm/page_isolation: clean up confused code	2016-07-26 16:19:19 -07:00
page_owner.c	mm/page_owner: use stackdepot to store stacktrace	2016-07-26 16:19:19 -07:00
page_poison.c	mm: check the return value of lookup_page_ext for all call sites	2016-06-03 15:06:22 -07:00
pagewalk.c
percpu-km.c
percpu-vm.c
percpu.c	percpu: fix synchronization between synchronous map extension and chunk destruction	2016-05-25 11:48:25 -04:00
pgtable-generic.c
process_vm_access.c
quicklist.c
readahead.c	mm, memcg: use consistent gfp flags during readahead	2016-07-26 16:19:19 -07:00
rmap.c	mm: move most file-based accounting to the node	2016-07-28 16:07:41 -07:00
shmem.c	mm: move most file-based accounting to the node	2016-07-28 16:07:41 -07:00
slab.c	mm/slab: use list_move instead of list_del/list_add	2016-07-26 16:19:19 -07:00
slab.h	mm, kasan: switch SLUB to stackdepot, enable memory quarantine for SLUB	2016-07-28 16:07:41 -07:00
slab_common.c	mm: charge/uncharge kmemcg from generic page allocator paths	2016-07-26 16:19:19 -07:00
slob.c
slub.c	mm, kasan: switch SLUB to stackdepot, enable memory quarantine for SLUB	2016-07-28 16:07:41 -07:00
sparse-vmemmap.c
sparse.c	make __section_nr() more efficient	2016-07-28 16:07:41 -07:00
swap.c	mm, pagevec: release/reacquire lru_lock on pgdat change	2016-07-28 16:07:41 -07:00
swap_cgroup.c
swap_state.c	mm: move most file-based accounting to the node	2016-07-28 16:07:41 -07:00
swapfile.c	mm, frontswap: convert frontswap_enabled to static key	2016-07-26 16:19:19 -07:00
truncate.c	truncate: handle file thp	2016-07-26 16:19:19 -07:00
userfaultfd.c	mm, fs: get rid of PAGE_CACHE_* and page_cache_{get,release} macros	2016-04-04 10:41:08 -07:00
util.c	mm: move most file-based accounting to the node	2016-07-28 16:07:41 -07:00
vmacache.c
vmalloc.c	mm: charge/uncharge kmemcg from generic page allocator paths	2016-07-26 16:19:19 -07:00
vmpressure.c
vmscan.c	mm: bail out in shrink_inactive_list()	2016-07-28 16:07:41 -07:00
vmstat.c	mm: remove reclaim and compaction retry approximations	2016-07-28 16:07:41 -07:00
workingset.c	mm, workingset: make working set detection node-aware	2016-07-28 16:07:41 -07:00
z3fold.c	mm/z3fold.c: avoid modifying HEADLESS page and minor cleanup	2016-06-03 16:02:55 -07:00
zbud.c
zpool.c
zsmalloc.c	zsmalloc: Delete an unnecessary check before the function call "iput"	2016-07-28 16:07:41 -07:00
zswap.c	mm/zswap: use workqueue to destroy pool	2016-05-20 17:58:30 -07:00