Timofey Titovets 440c840cb4 Btrfs: compression heuristic: replace heap sort with radix sort ...

Slowest part of heuristic for now is kernel heap sort()
It's can take up to 55% of runtime on sorting bucket items.

As sorting will always call on most data sets to get correctly
byte_core_set_size, the only way to speed up heuristic, is to
speed up sort on bucket.

Add a general radix_sort function.
Radix sort require 2 buffers, one full size of input array
and one for store counters (jump addresses).

That increase usage per heuristic workspace +1KiB
8KiB + 1KiB -> 8KiB + 2KiB

That is LSD Radix, i use 4 bit as a base for calculating,
to make counters array acceptable small (16 elements * 8 byte).

That Radix sort implementation have several points to adjust,
I added him to make radix sort general usable in kernel,
like heap sort, if needed.

Performance tested in userspace copy of heuristic code,
throughput:
    - average <-> random data: ~3500 MiB/s - heap  sort
    - average <-> random data: ~6000 MiB/s - radix sort

Signed-off-by: Timofey Titovets <nefelim4ag@gmail.com>
[ coding style fixes ]
Signed-off-by: David Sterba <dsterba@suse.com>

2018-01-22 16:08:15 +01:00

..

9p

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

adfs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

affs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

afs

afs: Fix missing error handling in afs_write_end()

2018-01-02 10:02:19 +00:00

autofs4

autofs: fix careless error in recent commit

2017-12-14 16:00:48 -08:00

befs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

bfs

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

btrfs

Btrfs: compression heuristic: replace heap sort with radix sort

2018-01-22 16:08:15 +01:00

cachefiles

mm: remove __GFP_COLD

2017-11-15 18:21:06 -08:00

ceph

ceph: drop negative child dentries before try pruning inode's alias

2017-12-08 11:07:12 +01:00

cifs

CIFS: don't log STATUS_NOT_FOUND errors for DFS

2017-12-06 12:48:01 -06:00

coda

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

configfs

configfs: make ci_type field, some pointers and function arguments const

2017-10-19 16:15:16 +02:00

cramfs

cramfs: fix MTD dependency

2017-12-17 12:20:58 -08:00

crypto

Merge tag 'fscrypt-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tytso/fscrypt

2017-11-14 11:35:15 -08:00

debugfs

debugfs: Remove redundant license text

2017-11-07 20:25:03 +01:00

devpts

pty: Repair TIOCGPTPEER

2017-08-24 13:23:03 -07:00

dlm

Merge tag 'configfs-for-4.15' of git://git.infradead.org/users/hch/configfs

2017-11-14 14:44:04 -08:00

ecryptfs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

efivarfs

VFS: Kill off s_options and helpers

2017-07-11 06:09:21 -04:00

efs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

exofs

Merge branch 'for-4.14/block' of git://git.kernel.dk/linux-block

2017-09-07 11:59:42 -07:00

exportfs

Merge branch 'rebased-statx' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs

2017-03-03 11:38:56 -08:00

ext2

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

ext4

ext4: fix crash when a directory's i_size is too small

2017-12-11 15:00:57 -05:00

f2fs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

fat

fs/fat/inode.c: fix sb_rdonly() change

2017-11-29 18:40:43 -08:00

freevxfs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

fscache

Merge tag 'afs-next-20171113' of git://git.kernel.org/pub/scm/linux/kernel/git/dhowells/linux-fs

2017-11-16 11:41:22 -08:00

fuse

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

gfs2

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

hfs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

hfsplus

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

hostfs

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

hpfs

hpfs: don't bother with the i_version counter or f_version

2017-12-10 12:58:18 -08:00

hugetlbfs

fs/hugetlbfs/inode.c: change put_page/unlock_page order in hugetlbfs_fallocate()

2017-11-29 18:40:43 -08:00

isofs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

jbd2

Merge tag 'libnvdimm-for-4.15' of git://git.kernel.org/pub/scm/linux/kernel/git/nvdimm/nvdimm

2017-11-17 09:51:57 -08:00

jffs2

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

jfs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

kernfs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

lockd

nlm_shutdown_hosts_net() cleanup

2017-11-27 16:45:11 -05:00

minix

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

ncpfs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

nfs

Merge tag 'nfs-for-4.15-3' of git://git.linux-nfs.org/projects/anna/linux-nfs

2017-12-16 13:12:53 -08:00

nfs_common

lockd: fix "list_add double add" caused by legacy signal interface

2017-11-27 16:45:11 -05:00

nfsd

kernel: make groups_sort calling a responsibility group_info allocators

2017-12-14 16:00:49 -08:00

nilfs2

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

nls

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

notify

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

ntfs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

ocfs2

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

omfs

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

openpromfs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

orangefs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

overlayfs

ovl: fix overlay: warning prefix

2017-12-14 11:14:52 +01:00

proc

proc: fix coredump vs read /proc/*/stat race

2018-01-19 10:09:41 -08:00

pstore

treewide: Switch DEFINE_TIMER callbacks to struct timer_list *

2017-11-21 15:57:05 -08:00

qnx4

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

qnx6

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

quota

quota: Check for register_shrinker() failure.

2017-11-29 16:46:48 +01:00

ramfs

mm: make pagevec_lookup() update index

2017-09-06 17:27:26 -07:00

reiserfs

Merge branch 'for_linus' of git://git.kernel.org/pub/scm/linux/kernel/git/jack/linux-fs

2017-11-30 18:38:47 -05:00

romfs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

squashfs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

sysfs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

sysv

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

tracefs

VFS: Don't use save/replace_mount_options if not using generic_show_options

2017-07-06 03:31:46 -04:00

ubifs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

udf

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

ufs

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

xfs

Merge tag 'xfs-4.15-fixes-10' of git://git.kernel.org/pub/scm/fs/xfs/xfs-linux

2018-01-05 12:59:32 -08:00

aio.c

Merge branch 'misc.compat' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs

2017-11-17 11:54:55 -08:00

anon_inodes.c

Replace <asm/uaccess.h> with <linux/uaccess.h> globally

2016-12-24 11:46:01 -08:00

attr.c

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

bad_inode.c

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

binfmt_aout.c

fs: fix kernel_read prototype

2017-09-04 19:05:15 -04:00

binfmt_elf_fdpic.c

Merge branch 'work.misc' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs

2017-11-17 12:54:01 -08:00

binfmt_elf.c

Merge branch 'for-linus' of git://git.armlinux.org.uk/~rmk/linux-arm

2017-11-16 12:50:35 -08:00

binfmt_em86.c

…

binfmt_flat.c

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

binfmt_misc.c

fs/binfmt_misc.c: node could be NULL when evicting inode

2017-10-13 16:18:33 -07:00

binfmt_script.c

exec: load_script: kill the onstack interp[BINPRM_BUF_SIZE] array

2017-10-03 17:54:25 -07:00

block_dev.c

Merge branch 'for-4.15/block' of git://git.kernel.dk/linux-block

2017-11-14 15:32:19 -08:00

buffer.c

mm, pagevec: remove cold parameter for pagevecs

2017-11-15 18:21:06 -08:00

char_dev.c

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

compat_binfmt_elf.c

fs/binfmt: Convert obsolete cputime type to nsecs

2017-02-01 09:13:51 +01:00

compat_ioctl.c

Merge branch 'work.misc' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs

2017-11-17 12:54:01 -08:00

compat.c

fs/compat.c: trim unused includes

2017-04-17 12:52:27 -04:00

coredump.c

Merge branch 'misc.compat' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs

2017-11-17 11:54:55 -08:00

dax.c

Revert "mm: replace p??_write with pte_access_permitted in fault + gup paths"

2017-12-15 18:53:22 -08:00

dcache.c

kmemcheck: remove annotations

2017-11-15 18:21:04 -08:00

dcookies.c

Replace <asm/uaccess.h> with <linux/uaccess.h> globally

2016-12-24 11:46:01 -08:00

direct-io.c

Merge branch 'for-4.15/block' of git://git.kernel.dk/linux-block

2017-11-14 15:32:19 -08:00

drop_caches.c

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

eventfd.c

Merge tag 'docs-4.13' of git://git.lwn.net/linux

2017-07-03 21:13:25 -07:00

eventpoll.c

Merge branch 'akpm' (patches from Andrew)

2017-11-17 16:56:17 -08:00

exec.c

exec: Weaken dumpability for secureexec

2018-01-03 10:13:36 -08:00

fcntl.c

fcntl: don't cap l_start and l_end values for F_GETLK64 in compat syscall

2017-11-15 08:08:36 -05:00

fhandle.c

Merge branch 'work.misc' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs

2017-11-17 12:54:01 -08:00

file_table.c

fs, mm: account filp cache to kmemcg

2017-11-15 18:21:04 -08:00

file.c

Merge branch 'work.misc' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs

2017-11-17 12:54:01 -08:00

filesystems.c

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

fs_pin.c

Merge branch 'linus' into locking/core, to resolve conflicts

2017-11-07 10:32:44 +01:00

fs_struct.c

sched/headers: Prepare for new header dependencies before moving code to <linux/sched/task.h>

2017-03-02 08:42:35 +01:00

fs-writeback.c

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

inode.c

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

internal.h

fs: expose do_unlinkat for built-in callers

2017-11-10 08:48:46 -05:00

ioctl.c

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

iomap.c

Merge branch 'work.iov_iter' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs

2017-11-17 12:08:18 -08:00

Kconfig

fs/Kconfig: kill CONFIG_PERCPU_RWSEM some more

2017-07-12 16:26:00 -07:00

Kconfig.binfmt

ARM: enable elf_fdpic on systems with an MMU

2017-09-10 19:31:46 -04:00

libfs.c

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

locks.c

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

Makefile

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

mbcache.c

fs/mbcache.c: make count_objects() more robust

2017-11-29 18:40:43 -08:00

mount.h

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

mpage.c

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

namei.c

autofs: revert "autofs: fix AT_NO_AUTOMOUNT not being honored"

2017-11-29 18:40:43 -08:00

namespace.c

VFS: Handle lazytime in do_mount()

2017-12-09 20:16:33 -05:00

no-block.c

…

nsfs.c

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

open.c

ovl: don't allow writing ioctl on lower layer

2017-09-05 12:53:12 +02:00

pipe.c

pipe: add proc_dopipe_max_size() to safely assign pipe_max_size

2017-11-17 16:10:03 -08:00

pnode.c

mnt: Make propagate_umount less slow for overlapping mount propagation trees

2017-05-23 08:41:17 -05:00

pnode.h

mnt: Tuck mounts under others instead of creating shadow/side mounts.

2017-02-04 00:01:06 +13:00

posix_acl.c

sched/headers: Prepare to remove <linux/cred.h> inclusion from <linux/sched.h>

2017-03-02 08:42:31 +01:00

proc_namespace.c

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

read_write.c

Merge branch 'work.iov_iter' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs

2017-11-17 12:08:18 -08:00

readdir.c

Merge branch 'linus' into locking/core, to resolve conflicts

2017-11-07 10:32:44 +01:00

select.c

Merge branch 'misc.compat' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs

2017-11-17 11:54:55 -08:00

seq_file.c

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

signalfd.c

Merge branch 'misc.compat' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs

2017-11-17 11:54:55 -08:00

splice.c

locking/atomics: COCCINELLE/treewide: Convert trivial ACCESS_ONCE() patterns to READ_ONCE()/WRITE_ONCE()

2017-10-25 11:01:08 +02:00

stack.c

…

stat.c

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

statfs.c

Rename superblock flags (MS_xyz -> SB_xyz)

2017-11-27 13:05:09 -08:00

super.c

sget(): handle failures of register_shrinker()

2017-12-18 15:05:07 -05:00

sync.c

Merge branch 'for-4.15/block' of git://git.kernel.dk/linux-block

2017-11-14 15:32:19 -08:00

timerfd.c

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

userfaultfd.c

userfaultfd: clear the vma->vm_userfaultfd_ctx if UFFD_EVENT_FORK fails

2018-01-04 16:45:09 -08:00

utimes.c

License cleanup: add SPDX GPL-2.0 license identifier to files with no license

2017-11-02 11:10:55 +01:00

xattr.c

lsm: fix smack_inode_removexattr and xattr_getsecurity memleak

2017-10-04 18:03:15 +11:00